CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

Multimedia information technology and the annotation of video

The state of the art in multimedia information technology has not progressed to the point where a single solution is available to meet all reasonable needs of documentalists and users of video archives. In general, we do not have an optimistic view of the usability of new technology in this domain, but digitization and digital power can be expected to cause a small revolution in the area of video archiving. The volume of data leads to two views of the future: on the pessimistic side, overload of data will cause lack of annotation capacity, and on the optimistic side, there will be enough data from which to learn selected concepts that can be deployed to support automatic annotation. At the threshold of this interesting era, we make an attempt to describe the state of the art in technology. We sample the progress in text, sound, and image processing, as well as in machine learning

Image Indexing and Retrieval

The amount of pictorial data has been growing enormously with the expansion of WWW. From the large number of images, it is very important for users to retrieve required images via an efficient and effective mechanism. To solve the image retrieval problem, many techniques have been devised addressing the requirement of different applications. Problem of the traditional methods of image indexing have led to the rise of interest in techniques for retrieving images on the basis of automatically derived features such as color, texture and shape… a technology generally referred as Content-Based Image Retrieval (CBIR). After decade of intensive research, CBIR technology is now beginning to move out of the laboratory into the marketplace. However, the technology still lacks maturity and is not yet being used in a significant scale

Well-Known brands recognition by automated classifiers using local and global features

From color and type to patterns and illustrations, brands sense to be recognizable and convey their values and personality. Here patterns and color are key elements, as they can play a vital role in brand recognition. The images used for brand classification were handpicked and collectively named as HKDataset. We have explored various feature extractors used for classification and used automated classifiers named Linear SVM to achieve higher accuracy while tuning the model parameters to achieve optimal performance. It has been observed that Support Vector Machines performs better when using GIST descriptors combined with Bag of SIFT features. We hope to apply deep learning and other sophisticated classifiers to much-expanded categories of brands in the future

04021 Abstracts Collection -- Content-Based Retrieval

From 04.01.04 to 09.01.04, the Dagstuhl Seminar 04021 ``Content-Based Retrieval\u27\u27 was held in the International Conference and Research Center (IBFI), Schloss Dagstuhl. During the seminar, several participants presented their current research, and ongoing work and open problems were discussed. Abstracts of the presentations given during the seminar as well as abstracts of seminar results and ideas are put together in this paper. The first section describes the seminar topics and goals in general. Links to extended abstracts or full papers are provided, if available

Data display apparatus and data display method

A data display apparatus and data display method for displaying relationships between sets of data are described. Sets of data and similarity values representing similarities between the sets of data are received, and a display is controlled to display representations for the sets of data separated in accordance with the similarity values and so as to display, in a first style, links between representations which correspond to sets of data having a strong similarity value and, in a second style, links between the representations which correspond to sets of data having a weak similarity value

Bag-of-word based brand recognition using Markov Clustering Algorithm for codebook generation

International audienceIn order to address the issue of counterfeiting online, it is necessary to use automatic tools that analyze the large amount of information available over the Internet. Analysis methods that extract information about the content of the images are very promising for this purpose. In this paper, a method that automatically extract the brand of objects in images is proposed. The method does not explicitly search for text or logos. This information is implicitly included in the Bag-of-Words representation. In the Bag-of-Words paradigm, visual features are clustered to create the visual words. Despite its shortcomings, k-means is the most widely used algorithm. With k-means, the selection of the number of visual words is critical. In this paper, another clustering algorithm is proposed. Markov Cluster Algorithm (MCL) is very fast, does not require an arbitrary selection of the number of classes and does not rely on random initialization. First, we demonstrate in this paper that MCL is competitive to k-means with a number of cluster experimentally selected. Second, we show that it is possible to identify brand from objects in images without previous knowledge about visual identity of these brands

A Study On Information Retrieval Systems

A video is a key component of today's multimedia applications,  including Video Cassette Recording (VCR), Video-on-Demand (VoD), and virtual walkthrough. This happens supplementary with the fast amplification in video skill (Rynson W.H. Lau et al. 2000). Owing to innovation's progress in the  media, computerized TV, and data frameworks, an immense measure of video information is now exhaustively realistic (Walid G. Aref et al. 2003). The startling advancement in computerized video content has made entrée and moves the data in a tremendous video database a muddled and sensible issue (Chih-Wen Su et al. 2005). Therefore, the necessity for creating devices and frameworks that can effectively investigate the most needed video content, has evoked a great deal of interest among analysts. Sports video has been chosen as the prime application in this proposition since it has attracted viewers around the world