Cross-Lingual Cross-Media Content Linking: Annotations and Joint Representations

Dagstuhl Seminar 15201 was conducted on “Cross-Lingual Cross-Media Content Linking: Annotations and Joint Representations”. Participants from around the world participated in the seminar and presented state-of-the-art and ongoing research related to the seminar topic. An executive summary of the seminar, abstracts of the talks from participants and working group discussions are presented in the forthcoming sections

ELVIS: Entertainment-led video summaries

© ACM, 2010. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Transactions on Multimedia Computing, Communications, and Applications, 6(3): Article no. 17 (2010) http://doi.acm.org/10.1145/1823746.1823751Video summaries present the user with a condensed and succinct representation of the content of a video stream. Usually this is achieved by attaching degrees of importance to low-level image, audio and text features. However, video content elicits strong and measurable physiological responses in the user, which are potentially rich indicators of what video content is memorable to or emotionally engaging for an individual user. This article proposes a technique that exploits such physiological responses to a given video stream by a given user to produce Entertainment-Led VIdeo Summaries (ELVIS). ELVIS is made up of five analysis phases which correspond to the analyses of five physiological response measures: electro-dermal response (EDR), heart rate (HR), blood volume pulse (BVP), respiration rate (RR), and respiration amplitude (RA). Through these analyses, the temporal locations of the most entertaining video subsegments, as they occur within the video stream as a whole, are automatically identified. The effectiveness of the ELVIS technique is verified through a statistical analysis of data collected during a set of user trials. Our results show that ELVIS is more consistent than RANDOM, EDR, HR, BVP, RR and RA selections in identifying the most entertaining video subsegments for content in the comedy, horror/comedy, and horror genres. Subjective user reports also reveal that ELVIS video summaries are comparatively easy to understand, enjoyable, and informative

Multi-task linear discriminant analysis for multi-view action recognition

n/

Heisenberg Spin Chains: Quantum-Classical Crossover and the Haldane Conjecture

A comprehensive investigation has been made of the spectral excitations and static properties of Heisenberg antiferromagnetic chains of spin 1/2, 1, 3/2, and 2, using Lanczös, Bethe Ansatz, and Monte Carlo techniques. An unusual and unanticipated crossover mechanism for spin chains with 1/2≤S≤∞ has been discovered. The validity of the Haldane conjecture concerning the presence of a spectral excitation gap for integer‐spin chains has been investigated by exact finite chains calculations of (a) the primary singlet‐triplet excitation gap, (b) higher excitation gaps, and (c) the Fourier transform of the ground statecorrelation functions. A new Monte Carlo method has extended the spin‐1 gap calculations to N=32

FILTWAM and Voice Emotion Recognition

This paper introduces the voice emotion recognition part of our framework for improving learning through webcams and microphones (FILTWAM). This framework enables multimodal emotion recognition of learners during game-based learning. The main goal of this study is to validate the use of microphone data for a real-time and adequate interpretation of vocal expressions into emotional states were the software is calibrated with end users. FILTWAM already incorporates a valid face emotion recognition module and is extended with a voice emotion recognition module. This extension aims to provide relevant and timely feedback based upon learner's vocal intonations. The feedback is expected to enhance learner’s awareness of his or her own behavior. Six test persons received the same computer-based tasks in which they were requested to mimic specific vocal expressions. Each test person mimicked 82 emotions, which led to a dataset of 492 emotions. All sessions were recorded on video. An overall accuracy of our software based on the requested emotions and the recognized emotions is a pretty good 74.6% for the emotions happy and neutral emotions; but will be improved for the lower values of an extended set of emotions. In contrast with existing software our solution allows to continuously and unobtrusively monitor learners’ intonations and convert these intonations into emotional states. This paves the way for enhancing the quality and efficacy of game-based learning by including the learner's emotional states, and links these to pedagogical scaffolding.The Netherlands Laboratory for Lifelong Learning (NELLL) of the Open University of the Netherlands

Generating transgenic reporter lines for studying nervous system development in the cnidarian nematostella vectensis

Neurons often display complex morphologies with long and fine processes that can be difficult to visualize, in particular in living animals. Transgenic reporter lines in which fluorescent proteins are expressed in defined populations of neurons are important tools that can overcome these difficulties. By using membrane-attached fluorescent proteins, such reporter transgenes can identify the complete outline of subsets of neurons or they can highlight the subcellular localization of fusion proteins, for example at pre- or postsynaptic sites. The relative stability of fluorescent proteins furthermore allows the tracing of the progeny of cells over time and can therefore provide information about potential roles of the gene whose regulatory elements are controlling the expression of the fluorescent protein. Here we describe the generation of transgenic reporter lines in the sea anemone Nematostella vectensis, a cnidarian model organism for studying the evolution of developmental processes. We also provide an overview of existing transgenic Nematostella lines that have been used to study conserved and derived aspects of nervous system development.acceptedVersio

Intrinsically determined cell death of developing cortical interneurons

Cortical inhibitory circuits are formed by GABAergic interneurons, a cell population that originates far from the cerebral cortex in the embryonic ventral forebrain. Given their distant developmental origins, it is intriguing how the number of cortical interneurons is ultimately determined. One possibility, suggested by the neurotrophic hypothesis1-5, is that cortical interneurons are overproduced, and then following their migration into cortex, excess interneurons are eliminated through a competition for extrinsically derived trophic signals. Here we have characterized the developmental cell death of mouse cortical interneurons in vivo, in vitro, and following transplantation. We found that 40% of developing cortical interneurons were eliminated through Bax- (Bcl-2 associated X-) dependent apoptosis during postnatal life. When cultured in vitro or transplanted into the cortex, interneuron precursors died at a cellular age similar to that at which endogenous interneurons died during normal development. Remarkably, over transplant sizes that varied 200-fold, a constant fraction of the transplanted population underwent cell death. The death of transplanted neurons was not affected by the cell-autonomous disruption of TrkB (tropomyosin kinase receptor B), the main neurotrophin receptor expressed by central nervous system (CNS) neurons6-8. Transplantation expanded the cortical interneuron population by up to 35%, but the frequency of inhibitory synaptic events did not scale with the number of transplanted interneurons. Together, our findings indicate that interneuron cell death is intrinsically determined, either cell-autonomously, or through a population-autonomous competition for survival signals derived from other interneurons