Interactive video retrieval evaluation at a distance: comparing sixteen interactive video search systems in a remote setting at the 10th Video Browser Showdown

The Video Browser Showdown addresses difficult video search challenges through an annual interactive evaluation campaign attracting research teams focusing on interactive video retrieval. The campaign aims to provide insights into the performance of participating interactive video retrieval systems, tested by selected search tasks on large video collections. For the first time in its ten year history, the Video Browser Showdown 2021 was organized in a fully remote setting and hosted a record number of sixteen scoring systems. In this paper, we describe the competition setting, tasks and results and give an overview of state-of-the-art methods used by the competing systems. By looking at query result logs provided by ten systems, we analyze differences in retrieval model performances and browsing times before a correct submission. Through advances in data gathering methodology and tools, we provide a comprehensive analysis of ad-hoc video search tasks, discuss results, task design and methodological challenges. We highlight that almost all top performing systems utilize some sort of joint embedding for text-image retrieval and enable specification of temporal context in queries for known-item search. Whereas a combination of these techniques drive the currently top performing systems, we identify several future challenges for interactive video search engines and the Video Browser Showdown competition itself

Gamification : sneaking fitness game mechanics into AAA game

Andreas LeibetsederAlpen-Adria-Universität Klagenfurt, Masterarbeit, 2016(VLID)241241

Interactive Video Retrieval in the Age of Deep Learning - Detailed Evaluation of VBS 2019

Despite the fact that automatic content analysis has made remarkable progress over the last decade - mainly due to significant advances in machine learning - interactive video retrieval is still a very challenging problem, with an increasing relevance in practical applications. The Video Browser Showdown (VBS) is an annual evaluation competition that pushes the limits of interactive video retrieval with state-of-the-art tools, tasks, data, and evaluation metrics. In this paper, we analyse the results and outcome of the 8th iteration of the VBS in detail. We first give an overview of the novel and considerably larger V3C1 dataset and the tasks that were performed during VBS 2019. We then go on to describe the search systems of the six international teams in terms of features and performance. And finally, we perform an in-depth analysis of the per-team success ratio and relate this to the search strategies that were applied, the most popular features, and problems that were experienced. A large part of this analysis was conducted based on logs that were collected during the competition itself. This analysis gives further insights into the typical search behavior and differences between expert and novice users. Our evaluation shows that textual search and content browsing are the most important aspects in terms of logged user interactions. Furthermore, we observe a trend towards deep learning based features, especially in the form of labels generated by artificial neural networks. But nevertheless, for some tasks, very specific content-based search features are still being used. We expect these findings to contribute to future improvements of interactive video search systems

Comparing approaches to interactive lifelog search at the lifelog search challenge (LSC2018)

The Lifelog Search Challenge (LSC) is an international content retrieval competition that evaluates search for personal lifelog data. At the LSC, content-based search is performed over a multi-modal dataset, continuously recorded by a lifelogger over 27 days, consisting of multimedia content, biometric data, human activity data, and information activities data. In this work, we report on the first LSC that took place in Yokohama, Japan in 2018 as a special workshop at ACM International Conference on Multimedia Retrieval 2018 (ICMR 2018). We describe the general idea of this challenge, summarise the participating search systems as well as the evaluation procedure, and analyse the search performance of the teams in various aspects. We try to identify reasons why some systems performed better than others and provide an outlook as well as open issues for upcoming iterations of the challenge

Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018)

The Lifelog Search Challenge (LSC) is an international content retrieval competition that evaluates search for personal lifelog data. At the LSC, content-based search is performed over a multi-modal dataset, continuously recorded by a lifelogger over 27 days, consisting of multimedia content, biometric data, human activity data, and information activities data. In this work, we report on the first LSC that took place in Yokohama, Japan in 2018 as a special workshop at ACM International Conference on Multimedia Retrieval 2018 (ICMR 2018). We describe the general idea of this challenge, summarise the participating search systems as well as the evaluation procedure, and analyse the search performance of the teams in various aspects. We try to identify reasons why some systems performed better than others and provide an outlook as well as open issues for upcoming iterations of the challenge

Your flaws are my pain: Linking empathy to vicarious embarrassment

People vicariously experience embarrassment when observing others' public pratfalls or etiquette violations. In two consecutive studies we investigated the subjective experience and the neural correlates of vicarious embarrassment for others in a broad range of situations. We demonstrated, first, that vicarious embarrassment was experienced regardless of whether the observed protagonist acted accidentally or intentionally and was aware or unaware that he/she was in an embarrassing situation. Second, using functional magnetic resonance imaging (fMRI), we showed that the anterior cingulate cortex and the left anterior insula, two cortical structures typically involved in vicarious feelings of others' pain, are also strongly implicated in experiencing the ‘social pain’ for others' flaws and pratfalls. This holds true even for situations that engage protagonists not aware of their current predicament. Importantly, the activity in the anterior cingulate cortex and the left anterior insula positively correlated with individual differences in trait empathy. The present findings establish the empathic process as a fundamental prerequisite for vicarious embarrassment experiences, thus connecting affect and cognition to interpersonal processes. “When we are living with people who have a delicate sense of propriety, we are in misery on their account when anything unbecoming is committed. So I always feel for and with Charlotte when a person is tipping his chair. She cannot endure it.” [Elective Affinities, J. W. Goethe]