Video browsing interfaces and applications: a review

We present a comprehensive review of the state of the art in video browsing and retrieval systems, with special emphasis on interfaces and applications. There has been a significant increase in activity (e.g., storage, retrieval, and sharing) employing video data in the past decade, both for personal and professional use. The ever-growing amount of video content available for human consumption and the inherent characteristics of video data—which, if presented in its raw format, is rather unwieldy and costly—have become driving forces for the development of more effective solutions to present video contents and allow rich user interaction. As a result, there are many contemporary research efforts toward developing better video browsing solutions, which we summarize. We review more than 40 different video browsing and retrieval interfaces and classify them into three groups: applications that use video-player-like interaction, video retrieval applications, and browsing solutions based on video surrogates. For each category, we present a summary of existing work, highlight the technical aspects of each solution, and compare them against each other

Can't read my broker face?—Tracing a motif and metaphor of expert knowledge through audiovisual images of the financial crisis

Based on the question of the representability of economy and economics in audiovisual media, developments on the financial markets have often been discussed as a depiction problem. The abstractness and complexity of economic interrelations seem to defy classical modes of storytelling and dramatization. Nevertheless, public opinion about economic changes and dependencies crucially relies on audiovisual media. But how can the public communicate in images, sounds, and words about forces that are out of sight and out of reach, and can supposedly only be adequately grasped by experts? In a case study on audiovisual images of the global financial crisis (2007–), this paper tracks and analyzes a recurring motif: the staging of expert knowledge as close-ups of expressive faces vis-à-vis computer screens in television news, documentaries, as well as feature films. It draws on the use of digital tools for corpus exploration (reverse image search) and the visualization of video annotations. By relating and comparing different staging strategies by which these “broker faces” become embodiments of turbulent market dynamics, the paper proposes to not regard them as repeated instantiations of the same metaphor, but as a developing web of cinematic metaphors. Different perspectives (news of market developments or historical accounts of crisis developments) and affective stances toward the global financial crisis are expressed in these variations of the face-screen constellation. The paper thus presents a selection of different appearances of “broker faces” as a medium for an audiovisual discourse of the global financial crisis. A concluding analysis of a scene from Margin Call focuses on its specific intertwining of expert and screen as an ambivalent movement figuration of staging insight. Between the feeling of discovery (of a potential future threat) and the sense of being haunted (by a menacing force), the film stages the emergence of a “broker face” in an atmospheric tension between suspense and melancholy. We argue that the film thereby reframes the motif and poses questions of agency, temporality, and expert knowledge

The value of information cues for lifelog video navigation

With the advent of lifelogging cameras the amount of personal video material is massively growing to an extent that easily overwhelms the user. To efficiently review lifelog data, we need well designed video navigation tools. In this paper, we analyze which cues are most beneficial for lifelog video navigation. We show that the information kind determines the most appropriate cue in single cue systems, but that multicue approaches are more appreciated. These findings can inspire to design video players with multiple navigation cues, including time, place, persons, and events for easier and more efficient lifelog video retrieval

CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

Multimedia data integration and retrieval in planning support systems

Thesis (M.C.P.)--Massachusetts Institute of Technology, Dept. of Urban Studies and Planning, 1998.Includes bibliographical references (p. 83-86).by Carleton Tsui.M.C.P

Collaborative video searching on a tabletop

Almost all system and application design for multimedia systems is based around a single user working in isolation to perform some task yet much of the work for which we use computers to help us, is based on working collaboratively with colleagues. Groupware systems do support user collaboration but typically this is supported through software and users still physically work independently. Tabletop systems, such as the DiamondTouch from MERL, are interface devices which support direct user collaboration on a tabletop. When a tabletop is used as the interface for a multimedia system, such as a video search system, then this kind of direct collaboration raises many questions for system design. In this paper we present a tabletop system for supporting a pair of users in a video search task and we evaluate the system not only in terms of search performance but also in terms of user–user interaction and how different user personalities within each pair of searchers impacts search performance and user interaction. Incorporating the user into the system evaluation as we have done here reveals several interesting results and has important ramifications for the design of a multimedia search system