Full-automatic high-level concept extraction from images using ontologies and semantic inference rules

Abstract

One of the big issues facing current content-based image retrieval is how to automatically extract the semantic information from images. In this paper, we propose an efficient method that automatically extracts the semantic information from images by using ontologies and the semantic inference rules. In our method, MPEG-7 visual descriptors are used to extract the visual features of image which are mapped to the semi-concept values. We also introduce the visual and animal ontology which are built to bridge the semantic gap. The visual ontology facilitates the mapping between visual features and semi-concept values, and allows the definition of relationships between the classes describing the visual features. The animal ontology representing the animal taxonomy can be exploited to identify the object in an image. We also propose the semantic inference rules that can be used to automatically extract high-level concepts from images by applying them to the visual and animal ontology. Finally, we discuss the limitations of the proposed method and the future work.