Image Slicing and Statistical Layer Approaches for Content-Based Image Retrieval

Two new approaches for colour features representation and comparison in digital images to handle various problems in the field of content-based image retrieval are proposed. The first approach is a double-layered system utilising a new technique, which is based on image slicing, combined with statistical features extracted and compared in each layer (ISSL). The images database is filtered in the first layer based on the similarities of brightness compared with the query image and ranked in the second layer, based on the similarities of the contrast values between the query image and the set of candidate images retrieved through the first layer. Although different distance measurements are available, the city block known as L1-norm distance measurement is used. This is due to its speed efficiency and accuracy. Different experiments are applied to different database sets, containing different number of images. The results show that the approach is scalable to the varying size of the database, robust, accurate, and fast. A comparison between the colour histogram approach and the proposed approach shows that the proposed system is more accurate and the speed of performance is much better. A new paradigm to choose the proper threshold value is proposed based on the autocorrelation of the distance vector. Moreover, an image retrieval system based on entropy as a visual discriminator is developed and compared with ISSL. The results show that the proposed ISSL approach is able to achieve better precision and reaches higher recall levels as compared with entropy approach. The second proposed technique for colour based retrieval is the Eigenvalues approach. Findings show that the interpretation of the Eigenvalues, as identity or signature for the square matrix, makes it possible to map this concept to the different bands of the image. The approach relies on calculating the accumulative distances between the query image and the images database, using the accumulative Eigenvalues of each band. The approach is tested, using different image queries over different database sets and the results are promising. Furthermore, the proposed approach is compared with ISSL approach and entropy approach, using different query images over a database set of 2000 images. In addition, a shape-based retrieval system is proposed. The system is double-layered, in which the first layer is used to filter the images database based on colour similarity. This allows the reduction in the number of candidate images, which need to be manipulated, using the shape retrieval technique in the second layer. The technique utilises a low-level image processing operations with “Dilate” as a morphological operator. Laplacian of Gaussian (LoG) is used to smoothen and detect the edges of the objects. Dilate on the other hand is used to solidify the object and fill in the holes, and correlation coefficient is proposed as a new means to shape similarity measurement. Experiments show that the approach is fast, flexible, and the retrieval of images is highly accurate. It is also able to overcome the numerous problems that are associated with the usage of the low-level image processing operation in image retrieval

Image database retrieval using neural networks

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The broad objective of this work has been to achieve retrieval of images from large unconstrained databases using image content. The problem is typified by the need to locate a target image within a database where no numerical indexing terms exist. Here, retrieval is based on important features within in an image and uses sample images or user sketches to specify a query. A typical query might be framed as "Find all images similar to this one", for example. The aim of this work has been to show how neural networks can provide a practical, flexible and robust solution to this problem. A neural network is basically an adaptive information filter which can be used to extract the salient characteristics of a data set during a training phase. The transformation learnt by the network can map the images into compact indices which support very rapid fuzzy matching of images across the database. This learning process optimises the performance of the code with respect to the contents of the database. We assess the applicability of several neural network architectures and learning rules for a practical coding scheme and investigate how the system parameters affect the performance of the system. We introduce a novel learning law which has a number of advantages over existing paradigms. In-depth mathematical analysis and extensive empirical tests are used to corroborate the arguments presented throughout. This thesis aims to show the nature of the image retrieval problem, how current research trends attempt to tackle it and how neural networks can offer us a real alternative to conventional approaches

An OAI-based Digital Library Framework for Biodiversity Information Systems

Biodiversity information systems (BISs) involve all kinds of heterogeneous data, which include ecological and geographical features. However, available information systems offer very limited support for managing such data in an integrated fashion, and integration is often based on geographic coordinates alone. Furthermore, such systems do not fully support image content management (e.g., photos of landscapes or living organisms), a requirement of many BIS end-users. In order to meet their needs, these users - e.g., biologists, environmental experts - often have to alternate between distinct biodiversity and image information systems to combine information extracted from them. This cumbersome operational procedure is forced on users by lack of interoperability among these systems. This hampers the addition of new data sources, as well as cooperation among scientists. The approach provided in this paper to meet these issues is based on taking advantage of advances in Digital Library (DL) innovations to integrate networked collections of heterogeneous data. It focuses on creating the basis for a biodiversity information system under the digital library perspective, combining new techniques of content-based image retrieval and database query processing mechanisms. This approach solves the problem of system switching, and provides users with a flexible platform from which to tailor a BIS to their needs

A Digital Library Framework for Biodiversity Information Systems

Biodiversity information systems (BISs) involve all kinds of heterogeneous data, which include ecological and geographical features. However, available information systems offer very limited support for managing such data in an integrated fashion. Furthermore, such systems do not fully support image content management (e.g., photos of landscapes or living organisms), a requirement of many BIS end-users. In order to meet their needs, these users - e.g., biologists, environmental experts - often have to alternate between distinct biodiversity and image information systems to combine information extracted from them. This cumbersome operational procedure is forced on users by lack of interoperability among these systems. This hampers the addition of new data sources, as well as cooperation among scientists. The approach provided in this paper to meet these issues is based on taking advantage of advances in Digital Library (DL) innovations to integrate networked collections of heterogeneous data. It focuses on creating the basis for a biodiversity information system under the digital library perspective, combining new techniques of content-based image retrieval and database query processing mechanisms. This approach solves the problem of system switching, and provides users with a flexible architecture from which to tailor a BIS to their needs. To illustrate the use of this architecture, it has been instantiated to support the creation of a BIS for fish species in a real application. The goal is to help researchers on ichthyology to identify fish specimen by using search retrieval techniques. Experimental results suggest that this new approach improves the effectiveness of the fish identification process, if compared to the tradition key-based method

Bag-of-Features Image Indexing and Classification in Microsoft SQL Server Relational Database

This paper presents a novel relational database architecture aimed to visual objects classification and retrieval. The framework is based on the bag-of-features image representation model combined with the Support Vector Machine classification and is integrated in a Microsoft SQL Server database.Comment: 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF), Gdynia, Poland, 24-26 June 201

Retrieval from an image knowledge base

With advances in computer technology, images and image databases are becoming increasingly important. Retrievals of images in current image database systems have been designed using keyword searches. These carefully designed and handcrafted systems are very efficient given the application domain they are built for. Unfortunately, they are not adaptable to other domains, not expandable for other uses of the existing information and are not very forgiving to their users. The appearance of full-text search provides for a more general search given textual documents. However, pictorial images contain a vast amount of information that is difficult to catalog in a general way. Further this classification needs to be dynamic providing for flexible searching capability. The searching should allow for more than a pre-programmed set of search parameters, as exact searches make the image database quite useless for a search that was not designed into the original database. Further the incorporation of knowledge along with the images is difficult. Development of an image knowledge base along with content-based retrieval techniques is the focus of this thesis. Using an artificial intelligence technique called case-based reasoning, images can be retrieved with a degree of flexibility. Each image would be classified by user entered attributes about the image called descriptors. These descriptors would also have a degree-of-importance parameter. This parameter would indicate the relative importance or certainty of that descriptor. These descriptors are collected as the case for the image and stored in frames Each image can vary as to the amount of attribute information they contain. Retrieval of an image from the knowledge base begins with the entry of new descriptors for the desired image. Along with the descriptors are the degree-of-importance parameter. The degree-of-importance would indicate the requirement for the desired image to match that descriptor. Again, a variable number of descriptors can be entered. After all criteria are entered, the system will search for cases that have any level of matching. The system will use the degree-of-importance both in the knowledge base about the candidate image(s) and the degree-of-importance on the search criteria to order the images. The ordering process will use weighted summations to present a relatively small list of candidate images. To demonstrate and validate the concepts outlined, a prototype of the system has been developed. This prototype includes the primary architectural components of a potentially real product. Architectural areas addressed are: the storage of the knowledge, storage and access to a large number of high-resolution images, means of searching or interrogating the knowledge base, and the actual display of images. The prototype is called the Smart Photo Album It is an electronic filing system for 35mm pictures taken by the average photographer on up to the photo-journalist. It allows for multiple ways of indexing the pictures of any subject matter. Retrieval from the knowledge base provides relative matches to the given search criteria. Although this application is relatively simple, the basis of the system can be easily extended to include a more sophisticated knowledge base and reasoning process as, for example, would be used for a medical diagnostic application in the field of dermatology

Interoperability between Multimedia Collections for Content and Metadata-Based Searching

Artiste is a European project developing a cross-collection search system for art galleries and museums. It combines image content retrieval with text based retrieval and uses RDF mappings in order to integrate diverse databases. The test sites of the Louvre, Victoria and Albert Museum, Uffizi Gallery and National Gallery London provide their own database schema for existing metadata, avoiding the need for migration to a common schema. The system will accept a query based on one museum’s fields and convert them, through an RDF mapping into a form suitable for querying the other collections. The nature of some of the image processing algorithms means that the system can be slow for some computations, so the system is session-based to allow the user to return to the results later. The system has been built within a J2EE/EJB framework, using the Jboss Enterprise Application Server

Vision systems with the human in the loop

The emerging cognitive vision paradigm deals with vision systems that apply machine learning and automatic reasoning in order to learn from what they perceive. Cognitive vision systems can rate the relevance and consistency of newly acquired knowledge, they can adapt to their environment and thus will exhibit high robustness. This contribution presents vision systems that aim at flexibility and robustness. One is tailored for content-based image retrieval, the others are cognitive vision systems that constitute prototypes of visual active memories which evaluate, gather, and integrate contextual knowledge for visual analysis. All three systems are designed to interact with human users. After we will have discussed adaptive content-based image retrieval and object and action recognition in an office environment, the issue of assessing cognitive systems will be raised. Experiences from psychologically evaluated human-machine interactions will be reported and the promising potential of psychologically-based usability experiments will be stressed