CrossMedia: Supporting Collaborative Research of Media Retrieval

AbstractThe goal of our new e-science platform is to support collaborative research communities by providing a simple solution to jointly develop semantic- and media search algorithms on common and challenging datasets processed by novel feature extractors. Querying of nearest neighbor (NN) elements on large data collections is an important task for several information or content retrieval tasks. In the paper a flexible framework for research purposes is introduced for testing features, metrics, distances and indexing structures. The core part of the content based retrieval system is the LHI-tree, a disk-based index scheme for fast retrieval of multimodal features. Additionally, we compare LHI-tree to FLANN, an effective implementation of ANN search and show that LHI-tree gives similar list of retrieved images

Sparse Coding for Event Tracking and Image Retrieval

Comparing regions of images is a fundamental task in both similarity based object tracking as well as retrieval of images from image datasets, where an exemplar image is used as the query. In this thesis, we focus on the task of creating a method of comparison for images produced by NASA’s Solar Dynamic Observatory mission. This mission has been in operation for several years and produces almost 700 Gigabytes of data per day from the Atmospheric Imaging Assembly instrument alone. This has created a massive repository of high-quality solar images to analyze and categorize. To this end, we are concerned with the creation of image region descriptors that are selective enough to differentiate between highly similar images yet compact enough to be compared in an efficient manner, while also being indexable with current indexing technology. We produce such descriptors by pooling sparse coding vectors produced by spanning learned basis dictionaries. Various pooled vectors are used to describe regions of images in event tracking, entire image descriptors for image comparison in content based image retrieval, and as region descriptors to be used in a content based image retrieval system on the SDO AIA image pipeline

Content-based Image Retrieval using Color and Geometry

The increased need of content based image retrieval technique can be found in a number of different domains such as Data Mining, Education, Medical Imaging, Crime Prevention, Weather forecasting, Remote Sensing and Management of Earth Resources. With the development of Multimedia data types and heavy increase in available bandwidth, there’s a huge demand of Image Retrieval system Content based image retrieval system uses color and geometry means to store, retrieve, sort and print any combinations of the images. The retrieval of images is, for the majority of search engines, available for collecting data from the image, this can be an image file name, html tags and surrounding text. This left the actual image more or less ignored. CBIR uses methods that analyze the actual bits and pieces i.e. color, shape, texture and spatial layout. There have been different approaches such as feature extraction, indexing and retrieval process. One approach is to make an attempt to classify the image into a more textual described context. With the image classified, it can be retrieved using more traditional and better retrieval methods. Our system Content Based Image Retrieval which is based on color and geometry, the system exactly does feature extraction in first step by using color, texture and shape (geometry) on images which gives there features which can be used to classify the image into different groups using distance formulas. Also the system gives relevant images as well as irrelevant images. The project thus going to work on relevance feedback of user which helps to improve the overall results