Post processing of multimedia information - concepts, problems, and techniques

Currently, most research work on multimedia information processing is focused on multimedia information storage and retrieval, especially indexing and content-based access of multimedia information. We consider multimedia information processing should include one more level-post-processing. Here &quot;post-processing&quot; means further processing of retrieved multimedia information, which includes fusion of multimedia information and reasoning with multimedia information to reach new conclusions. In this paper, the three levels of multimedia information processing storage, retrieval, and post-processing- are discussed. The concepts and problems of multimedia information post-processing are identified. Potential techniques that can be used in post-processing are suggested, By highlighting the problems in multimedia information post-processing, hopefully this paper will stimulate further research on this important but ignored topic.<br /

Fusion of Text and Image in Multimedia Information Retrieval System

Multimedia Information Retrieval is very useful for any application in our daily work. Most of the applications consist of Multimedia data that are images, text, audio and video. Multimedia information retrieval system is used to search an image. There are same meanings for different data which is also known as semantic gap. This problem is solved by fusion of text based image retrieval and content based image retrieval. Weighted Mean, OWA and WOWA are aggregation operators used in this system for the fusion of text and image numeric values. The Scale invariant feature transforms and speeded up robust feature are two algorithms for feature extraction. To increase the speed of system, the speeded up robust feature algorithm is used. Bag of Words and Bag of Visual Word approaches are used in this system for retrieving images. DOI: 10.17762/ijritcc2321-8169.15066

Multisensor Information Fusion by Query Refinement, Recent advances in Visual information systems

Abstract: In recent years the fusion of multimedia information from multiple real-time sources and databases has become increasingly important because of its practical significance in many application areas such as telemedicine, community networks for crime prevention, health care, emergency management, e-learning, digital library, and field computing for scientific exploration. To support the retrieval and fusion of multimedia information from multiple real-time sources and databases, a novel approach for sensor-based query processing is described. Since most sensors can generate large quantities of spatial information within short periods of time, sensor-based query processing requires new techniques for query optimization. The sensor dependency tree is used to facilitate query optimization. Through query refinement one or more sensor may provide feedback information to the other sensors. The approach is also applicable to evolutionary queries that change in time and/or space, depending upon the temporal/spatial coordinates of the query originator. It provides significant improvements in the accuracy and efficiency in multi-sensor information fusion and accomplishes sensor data independence through the construction of an ontological knowledge base. 1. Sensor-based Query Processing for Information Fusion In recent years the fusion of multimedia information from multiple real-time sources and databases has become increasingly important because of its practical significance in many application areas such as telemedicine, community networks for crime prevention, health care, emergency management, elearning

Multi-sensor Information Fusion by Query Refinement

To support the retrieval and fusion of multimedia information from multiple real-time sources and databases, a novel approach for sensor-based query processing is described. The sensor dependency tree is used to facilitate query optimization. Through query refinement one or more sensor may provide feedback information to the other sensors. The approach is also applicable to evolutionary queries that change in time and/or space, depending upon the temporal/spatial coordinates of the query originator

Querying Distributed Multimedia Databases and Data Sources in Information Fusion Applications

Sensor data fusion imposes a number of novel requirements on query languages and query processing techniques. A spatial/temporal query language called SIGMAQL has been proposed to support the retrieval and fusion of multimedia information from multiple sources and databases. In this paper we investigate fusion techniques, multimedia data transformations and SIGMAQL query processing techniques for sensor data fusion. Fusion techniques including fusion by the merge operation, the detection of moving objects, and the incorporation of belief values, have been developed. An experimental prototype has been implemented and tested to demonstrate the feasibility of these techniques

Multimedia web information fusion and analysis

Information on the World Wide Web appears in diverse forms, including text, image audio, and video. Presented with a wide range of information, an information user often takes great effort to correlate and track online information related to specific topics of intersest. Fusion of multimedia information in a unified framework is thus needed for efficiently understanding and further analyzing the semantically related information. This thesis addresses the problem of multimedia web information fusion and analysis by presenting an approach for modeling multimedia in a unified semantic framework, based on which cross-media informaion analysis and mining is realized.DOCTOR OF PHILOSOPHY (SCE

An Architecture for a Personalized Web of Active Documents

This paper describes the design and implementation of an architecture to support discovery, advertizing and fusion of multimedia information on the Internet. The basic tenet of the proposed architecture is a metadata abstraction, referred to as adlet. Based on this abstraction, a document dynamically builds metadata, advertises itself to other active documents on the Internet, and eventually joins groups of documents of the same interest. The proposed architecture supports the creation and composition of adlets, and the negotiation and communications protocols required to manage adlet groups of common interests. The paper describes the implementation of the adlet architecture using Java, CORBA and XML technologies. A prototype is currenlty being developed for a testbed of active documents over wide area networks