3 research outputs found
Surgical video retrieval using deep neural networks
Although the amount of raw surgical videos, namely videos
captured during surgical interventions, is growing fast, automatic retrieval
and search remains a challenge. This is mainly due to the nature
of the content, i.e. visually non-consistent tissue, diversity of internal organs,
abrupt viewpoint changes and illumination variation. We propose
a framework for retrieving surgical videos and a protocol for evaluating
the results. The method is composed of temporal shot segmentation and
representation based on deep features, and the protocol introduces novel
criteria to the field. The experimental results prove the superiority of
the proposed method and highlight the path towards a more effective
protocol for evaluating surgical videos
Improving Semantic Search in Digital Libraries Using Multimedia Analysis
Abstract — Semantic search of cultural content is of major importance in current digital libraries, such as in Europeana. Content metadata constitute the main features of cultural items that are analysed, mapped and used to interpret users ’ queries, so that the most appropriate content is selected and presented to the users. Multimedia, especially visual, analysis, has not been a main component in these developments. This paper presents a new semantic search methodology, including a query answering mechanism which meets the semantics of users ’ queries and enriches the answers by exploiting appropriate visual features, both local and MPEG-7, through an interweaved knowledge and machine learning based approach. An experimental study is presented, using content from the Europeana digital library, and involving both thematic knowledge and extracted visual features from Europeana images, illustrating the improved performance of the proposed semantic search approach. Index Terms — semantic search, content based search, digital libraries, multimedia analysis, europeana I