Shape annotation for intelligent image retrieval

Annotation of shapes is an important process for semantic image retrieval. In this paper, we present a shape annotation framework that enables intelligent image retrieval by exploiting in a unified manner domain knowledge and perceptual description of shapes. A semi-supervised fuzzy clustering process is used to derive domain knowledge in terms of linguistic concepts referring to the semantic categories of shapes. For each category we derive a prototype that is a visual template for the category. A novel visual ontology is proposed to provide a description of prototypes and their salient parts. To describe parts of prototypes the visual ontology includes perceptual attributes that are defined by mimicking the analogy mechanism adopted by humans to describe the appearance of objects. The effectiveness of the developed framework as a facility for intelligent image retrieval is shown through results on a case study in the domain of fish shapes

Distributed crowd-based annotation of soccer games using mobile devices

Soccer is one of the most loved sports in the world. Millions of people either follow the sport or are actually involved in its practice. Soccer also moves huge financial amounts every year and therefore teams always thrive to be better than the competition. New technologies have become a common place both in the preparation of the games and on the analysis of the games after they are concluded. In this paper, the authors will present a developed system, based on the usage of distributed mobile devices, that will enable the annotation of soccer matches, either in real time or after the matched is concluded (through the observation of other media). The capture of relevant events in the game can be used to better analyse the game and the performance of individual players fostering improvements and better decisions in the future. The application is implemented in the Android platform so that it can be easily installed by typical soccer fans empowering them as match annotators. This crowd of annotators, although not experts, can collectively provide a robust and rich annotation for soccer matches.info:eu-repo/semantics/publishedVersio

The e-Sentencias prototype: a procedural ontology for legal multimedia applications in the Spanish Civil Courts

Search, retrieval, and management of multimedia contents are challenging tasks for users and researchers alike. We introduce a software-hardware system for the global management of the multimedia contents produced by Spanish Civil Courts. The ultimate goal is to obtain an automatic classification of images and segments of the audiovisual records that, coupled with textual semantics, allows an efficient navigation and retrieval of judicial documents and additional legal sources. This paper describes our knowledge acquisition process, sets a typology of Spanish Civil hearings as performed in practice, and a preliminary procedural ontology at its actual stage of development (e-Sentencias ontology). A discussion on procedural, contextual and multimedia ontologies is also provided

Analysis and Re-use of Videos in Educational Digital Libraries with Automatic Scene Detection

The advent of modern approaches to education, like Massive Open Online Courses (MOOC), made video the basic media for educating and transmitting knowledge. However, IT tools are still not adequate to allow video content re-use, tagging, annotation and personalization. In this paper we analyze the problem of identifying coherent sequences, called scenes, in order to provide the users with a more manageable editing unit. A simple spectral clustering technique is proposed and compared with state-of-the-art results. We also discuss correct ways to evaluate the performance of automatic scene detection algorithms