Automatic extraction of semantic relationships from images using ontologies and SVM classifiers

Jin Woo Jeong, Kyung Wook Park, Ouk Seh Lee, Dong Ho Lee

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Extracting high-level semantic concepts from low-level visual features of images is a very challenging research. Although traditional machine learning approaches just extract fragmentary information of images, their performance is still not satisfying. In this paper, we propose a novel system that automatically extracts high-level concepts such as spatial relationships or natural-enemy relationships from images using combination of ontologies and SVM classifiers. Our system consists of two phases. In the first phase, visual features are mapped to intermediate-level concepts (e.g, yellow, 45 angular stripes). And then, a set of these concepts are classified into relevant object concepts (e.g, tiger) by using SVM-classifiers. In this phase, revision module which improves the accuracy of classification is used. In the second phase, based on extracted visual information and domain ontology, we deduce semantic relationships such as spatial/natural-enemy relationships between multiple objects in an image. Finally, we evaluate the proposed system using color images including about 20 object concepts.

Original languageEnglish
Title of host publicationMultimedia Content Analysis and Mining - International Workshop, MCAM 2007, Proceedings
PublisherSpringer Verlag
Pages184-194
Number of pages11
ISBN (Print)9783540734161
DOIs
StatePublished - 2007
EventInternational Workshop on Multimedia Content Analysis and Mining, MCAM 2007 - Weihai, China
Duration: 30 Jun 20071 Jul 2007

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4577 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Workshop on Multimedia Content Analysis and Mining, MCAM 2007
Country/TerritoryChina
CityWeihai
Period30/06/071/07/07

Keywords

  • Automatic image annotation
  • Content-based image retrieval
  • Machine learning
  • Ontology
  • Semantic annotation
  • Support vector machine

Fingerprint

Dive into the research topics of 'Automatic extraction of semantic relationships from images using ontologies and SVM classifiers'. Together they form a unique fingerprint.

Cite this