An Information Theoretic Approach to Content Based Image Retrieval.

We propose an information theoretic approach to the representation and comparison of color features in digital images to handle various problems in the area of content-based image retrieval. The interpretation of color histograms as joint probability density functions enables the use of a wide range of concepts from information theory to be considered in the extraction of color features from images and the computation of similarity between pairs of images. The entropy of an image is a measure of the randomness of the color distribution in an image. Rather than replacing color histograms as an image representation, we demonstrate that image entropy can be used to augment color histograms for more efficient image retrieval. We propose an indexing algorithm in which image entropy is used to drastically reduce the search space for color histogram computations. Our experimental tests applied to an image database with 10,000 images suggest that the image entropy-based indexing algorithm is scalable for image retrieval of large image databases. We also proposed a new similarity measure called the maximum relative entropy measure for comparing image feature vectors that represent probability density functions. This measure is an improvement of the Kullback-Leibler number in that it is non-negative and satisfies the identity and symmetry axioms. We also propose a new usability paradigm called Query By Example Sets (QBES) that allows users, particularly novice users, the ability to express queries in terms of multiple images

Advanced content-based semantic scene analysis and information retrieval: the SCHEMA project

The aim of the SCHEMA Network of Excellence is to bring together a critical mass of universities, research centers, industrial partners and end users, in order to design a reference system for content-based semantic scene analysis, interpretation and understanding. Relevant research areas include: content-based multimedia analysis and automatic annotation of semantic multimedia content, combined textual and multimedia information retrieval, semantic -web, MPEG-7 and MPEG-21 standards, user interfaces and human factors. In this paper, recent advances in content-based analysis, indexing and retrieval of digital media within the SCHEMA Network are presented. These advances will be integrated in the SCHEMA module-based, expandable reference system

Digital Image Access & Retrieval

The 33th Annual Clinic on Library Applications of Data Processing, held at the University of Illinois at Urbana-Champaign in March of 1996, addressed the theme of "Digital Image Access & Retrieval." The papers from this conference cover a wide range of topics concerning digital imaging technology for visual resource collections. Papers covered three general areas: (1) systems, planning, and implementation; (2) automatic and semi-automatic indexing; and (3) preservation with the bulk of the conference focusing on indexing and retrieval.published or submitted for publicatio

Fusing MPEG-7 visual descriptors for image classification

This paper proposes three content-based image classification techniques based on fusing various low-level MPEG-7 visual descriptors. Fusion is necessary as descriptors would be otherwise incompatible and inappropriate to directly include e.g. in a Euclidean distance. Three approaches are described: A “merging” fusion combined with an SVM classifier, a back-propagation fusion combined with a KNN classifier and a Fuzzy-ART neurofuzzy network. In the latter case, fuzzy rules can be extracted in an effort to bridge the “semantic gap” between the low-level descriptors and the high-level semantics of an image. All networks were evaluated using content from the repository of the aceMedia project1 and more specifically in a beach/urban scene classification problem