CROEQS: Contemporaneous Role Ontology-based Expanded Query Search: implementation and evaluation

Searching annotated items in multimedia databases becomes increasingly important. The traditional approach is to build a search engine based on textual metadata. However, in manually annotated multimedia databases, the conceptual level of what is searched for might differ from the high-levelness of the annotations of the items. To address this problem, we present CROEQS, a semantically enhanced search engine. It allows the user to query the annotated persons not only on their name, but also on their roles at the time the multimedia item was broadcast. We also present the ontology used to expand such queries: it allows us to semantically represent the domain knowledge on people fulfilling a role during a temporal interval in general, and politicians holding a political office specifically. The evaluation results show that query expansion using data retrieved from an ontology considerably filters the result set, although there is a performance penalty

The relationship between IR and multimedia databases

Modern extensible database systems support multimedia data through ADTs. However, because of the problems with multimedia query formulation, this support is not sufficient.\ud \ud Multimedia querying requires an iterative search process involving many different representations of the objects in the database. The support that is needed is very similar to the processes in information retrieval.\ud \ud Based on this observation, we develop the miRRor architecture for multimedia query processing. We design a layered framework based on information retrieval techniques, to provide a usable query interface to the multimedia database.\ud \ud First, we introduce a concept layer to enable reasoning over low-level concepts in the database.\ud \ud Second, we add an evidential reasoning layer as an intermediate between the user and the concept layer.\ud \ud Third, we add the functionality to process the users' relevance feedback.\ud \ud We then adapt the inference network model from text retrieval to an evidential reasoning model for multimedia query processing.\ud \ud We conclude with an outline for implementation of miRRor on top of the Monet extensible database system

Towards the architecture of an instructional multimedia database

The applicability of multimedia databases in education may be extended if they can serve multiple target groups, leading to affordable costs per unit for the user. In this contribution, an approach is described to build generic multimedia databases to serve that purpose. This approach is elaborated within the ODB Project ('Instructional Design of an Optical DataBase'); the term optical refers to the use of optical storage media to hold the audiovisual components. The project aims at developing a database in which a hypermedia encyclopedia is combined with instructional multimedia applications for different target groups at different educational levels. The architecture of the Optical Database will allow for switching between application types while working (for instance from tutorial instruction via the encyclopedia to a simulation and back). For instruction, the content of the database is thereby organized around so-called standard instruction routes: one route per target group. In the project, the teacher is regarded as the manager of instruction.\ud \ud From that perspective, the database is primarily organized as a teaching facility. Central to the research is the condition that the architecture of the Optical Database has to enable teachers to select and tailor instruction routes to their needs in a way that is perceived as logical and easy to use