The Prose Storyboard Language: A Tool for Annotating and Directing Movies: (Version 2.0, Revised and Illustrated Edition)

International audienceThe prose storyboard language is a formal language for describing movies shot by shot, where each shot is described with a unique sentence. The language uses a simple syntax and limited vocabulary borrowed from working practices in traditional movie-making and is intended to be readable both by machines and humans. The language has been designed over the last ten years to serve as a high-level user interface for intelligent cinematography and editing systems. In this new paper, we present the latest evolution of the language, and the results of an extensive annotation exercise showing the benefits of the language in the task of annotating the sophisticated cinematography and film editing of classic movies

Joint Attention for Automated Video Editing

International audienceJoint attention refers to the shared focal points of attention for occupants in a space. In this work, we introduce a computational definition of joint attention for the automated editing of meetings in multi-camera environments from the AMI corpus. Using extracted head pose and individual headset amplitude as features, we developed three editing methods: (1) a naive audio-based method that selects the camera using only the headset input, (2) a rule-based edit that selects cameras at a fixed pacing using pose data, and (3) an editing algorithm using LSTM (Long-short term memory) learned joint-attention from both pose and audio data, trained on expert edits. The methods are evaluated qualitatively against the human edit, and quantitatively in a user study with 22 participants. Results indicate that LSTM-trained joint attention produces edits that are comparable to the expert edit, offering a wider range of camera views than audio, while being more generalizable as compared to rule-based methods

Techniques de mise en scène pour le jeu vidéo et l'animation

Eurographics State of the Art Report (STAR).International audienceOver the last forty years, researchers in computer graphics have proposed a large variety of theoretical models and computer implementations of a virtual film director, capable of creating movies from minimal input such as a screenplay or storyboard. The underlying film directing techniques are also in high demand to assist and automate the generation of movies in computer games and animation. The goal of this survey is to characterize the spectrum of applications that require film directing, to present a historical and up-to-date summary of research in algorithmic film directing, and to identify promising avenues and hot topics for future research.Depuis quarante ans, les chercheurs en informatique graphique ont proposé une grande variété de modèles théoriques et d'implémentations de réalisateurs virtuels, capables de créer des films automatiquement à partir de scénarios ou de storyboards. Les techniques de mise en scène sous-jacentes peuvent également être très utiles pour assister et automatiser la création de films dans le jeu vidéo et l'animation. Le but de cet état de l'art est de caractériser le spectre des applications qui peuvent bénéficier des techniques de mise en scène, de donner un compte rendu historique de la recherche en mise en scène algorithmique, et d'identifier les tendances et perspectives du domaine

Multimodality for Passive Experience: Effects of Visual, Auditory, Vibration and Draught Stimuli on Sense of Presence

Adequate use of multimodal stimuli plays a crucial role in help forming the sense of presence within a virtual environment. While most of the presence research attempts to engage more sensory modalities to induce a higher sense of presence, this paper investigates the relevance of each sensory modality and different combinations on the subjective sense of presence using a specifically designed scenario of a passive experience. We chose a neutral test scenario of “waiting at a train station while a train is passing by” to avoid the potential influence of story narrative on mental presence and replicated realistic multimodal stimuli that are highly relevant to our test setting. All four stimuli -visual, auditory, vibration, and draught -with 16 possibilities of combinations were systematically evaluated with 24 participants. The evaluation was performed on one crucial aspect of presence –“realness” to reflect user presence in general. The perceived realism value was assessed using a scalometer. The findings of main effects indicate that the auditory stimuli had the most significant contribution in creating the sense of presence. The results of interaction effects suggest the impact of draught stimuli is significant in relation to other stimuli -visual and auditory. Also, the gender effects revealed that the sense of presence reported by female participants is influenced by more factors than merely adding more sensory modalities