Dialectical Polyptych: an interactive movie installation

Most of the known video games developed by important software companies usually establish an approach to the cinematic language in an attempt to create a perfect combination of narrative, visual technique and interaction. Unlike most video games, interactive film narratives normally involve an interruption in time whenever the spectator has to make choices. “Dialectical Polyptych” is an interactive movie included in a project called “Characters looking for a spectactor”, which aims to give the spectator on-the-fly control over film editing, thus exploiting the role of the spectator as an active subject in the presented narrative. This paper presents an installation based on a mobile device, which allows seamless real-time interactivity with the movie. Different finger touches in the screen allow the spectator to alternate between two parallel narratives, both producing a complementary narrative, and change the angle or shot within each narrative.info:eu-repo/semantics/publishedVersio

Symbolic Activities in Virtual Spaces

This paper presents an approach to combine concepts ofsymbolic acting and virtual storytelling with the support ofcooperative processes. We will motivate why symboliclanguages are relevant in the social context of awarenessapplications. We will describe different symbolicpresentations and illustrate their application in three differentprototypes

As cinemáticas e narrativas de jogos digitais: implicações para o design de jogos

Game cinematics integrating filming techniques, cutscenes, and animations are likely to have a pivotal role in the player experience, emotional attachment, and relatedness to the game narrative content. In recent years, the avoidance of cuts to generate a seamless and connected game experience has challenged older patterns on storytelling in games and find new ways of intertwining gameplay with the narrative. However, a one-size-fits-all strategy may not be applied when considering different storytelling purposes, structures, and language used in diversified game genres. The purpose of this research is to examine the contributions of cinematics to affect game story comprehension, especially in young adults. A multi-stage development research method is applied, encompassing the following activities: (1) identification of requirements to develop game cinematics based on the literature review and interviews with 16 scholars and industry professionals in Game UX, and cinematic development; (2) Development of a Game Cinematics experiment for the game Mutation Madness, using first- and third- perspectives; and a (3) Comparative evaluation of game cinematics in terms of experience and narrative comprehension. The cinematics developed are tested with 46 young adults to assess the effect of the Point Of View (POV) camera on visual attention and story comprehension in Mutation Madness, using an eye- tracking experiment. The results suggest that third- perspective in game cinematics constitute omniscient knowledge of the story, evoking the sense of time and focusing on the story agents, while first- perspective visually guides the player to the game events happening in the time of gameplay. This research contributes to the Communication Sciences and Technologies field by presenting a set of best practices developing game cinematics.As cinemáticas de jogos que integram técnicas de filmagem, cutscenes, e animações, tendem a ter um papel central na experiência do jogador, envolvimento emocional, e relação com a narrativa. Nos últimos anos, os padrões mais antigos inerentes ao processo de contar histórias nos jogos têm sido desafiados pela ausência de cortes e interrupções na experiência, de modo a garantir a interconexão e o entrelaçar da jogabilidade com a narrativa. No entanto, a adoção de uma estratégia de dimensão única pode não atender a diferentes propósitos da narrativa, estruturas e linguagem utilizadas em diferentes géneros de jogos. O objetivo desta investigação é compreender o modo como as cinemáticas podem afetar a compreensão de histórias de jogos, especialmente em jovens adultos. O método de investigação de desenvolvimento é aplicado, subdividido nas seguintes etapas: (1) Identificação de requisitos para desenvolver cinemáticas de jogos com base na revisão da literatura e entrevista a 16 académicos e profissionais da indústria em experiência de jogo, e desenvolvimento de cinemáticas; (2) Desenvolvimento de cinemáticas do jogo Mutation Madness, com recurso à primeira e terceira perspetiva; e (3) Avaliação comparativa das cinemáticas de jogo em termos de experiência e compreensão da narrativa. As cinemáticas desenvolvidas são testadas por 46 jovens adultos, recorrendo à metodologia eye-tracking, para avaliar o efeito da perspetiva da câmara [Point Of View (POV)] na atenção visual e na compreensão da narrativa do jogo Mutation Madness. Os resultados sugerem que a cinemática em que é adotada a terceira perspetiva no jogo proposto contribui para um conhecimento omnisciente da história, evocando o sentido do tempo e concentrando-se nos agentes da história, enquanto a primeira perspetiva orienta visualmente o jogador para os eventos do jogo que acontecem no tempo da jogabilidade. Esta investigação contribui para a área das Ciências da Tecnologia da Comunicação ao apresentar um conjunto de melhores práticas para desenvolver as cinemáticas nos jogos.Mestrado em Comunicação Multimédi

Interactive Fiction in Cinematic Virtual Reality: Epistemology, Creation and Evaluation

This dissertation presents the Interactive Fiction in Cinematic Virtual Reality (IFcVR), an interactive digital narrative (IDN) that brings together the cinematic virtual reality (cVR) and the creation of virtual environments through 360\ub0 video within an interactive fiction (IF) structure. This work is structured in three components: an epistemological approach to this kind of narrative and media hybrid; the creation process of IFcVR, from development to postproduction; and user evaluation of IFcVR. In order to set the foundations for the creation of interactive VR fiction films, I dissect the IFcVR by investigating the aesthetics, narratological and interactive notions that converge and diverge in it, proposing a medium-conscious narratology for this kind of artefact. This analysis led to the production of an IFcVR functional prototype: \u201cZENA\u201d, the first interactive VR film shot in Genoa. ZENA\u2019s creation process is reported proposing some guidelines for interactive and immersive film-makers. In order to evaluate the effectiveness of the IFcVR as an entertaining narrative form and a vehicle for diverse types of messages, this study also proposes a methodology to measure User Experience (UX) on IFcVR. The full evaluation protocol gathers both qualitative and quantitative data through ad hoc instruments. The proposed protocol is illustrated through its pilot application on ZENA. Findings show interactors' positive acceptance of IFcVR as an entertaining experience

A Lightweight Intelligent Virtual Cinematography System for Machinima Production

Machinima is a low-cost alternative to full production filmmaking. However, creating quality cinematic visualizations with existing machinima techniques still requires a high degree of talent and effort. We introduce a lightweight artificial intelligence system, Cambot, that can be used to assist in machinima production. Cambot takes a script as input and produces a cinematic visualization. Unlike other virtual cinematography systems, Cambot favors an offline algorithm coupled with an extensible library of specific modular and reusable facets of cinematic knowledge. One of the advantages of this approach to virtual cinematography is a tight coordination between the positions and movements of the camera and the actors

Film policy and the emergence of the cross-cultural: exploring crossover cinema in Flanders (Belgium)

With several films taking on a cross-cultural character, a certain ‘crossover trend’ may be observed within the recent upswing of Flemish cinema (a subdivision of Belgian cinema). This trend is characterized by two major strands: first, migrant and diasporic filmmakers finally seem to be emerging, and second, several filmmakers tend to cross the globe to make their films, hereby minimizing links with Flemish indigenous culture. While paying special attention to the crucial role of film policy in this context, this contribution further investigates the crossover trend by focusing on Turquaze (2010, Kadir Balci) and Altiplano (2009, Peter Brosens & Jessica Woodworth)

Nonlinear narratives: crossing borders between contemporary film, art and digital media practice

This is a report on a practice-based research project called ‘Journeys in Travel’, which investigates contemporary modes of nonlinear narratives in film, art and digital media practice. It is a single case study, which suggests as its main contribution to set new ground in the development of nonlinear narratives that the structural form of cinematic essay is a suitable adoption for nonlinear database film, which is referred to as ‘database essay’. The video installation ‘Journeys in Travel’ is based on an algorithmic computer-controlled system and tells a story of travel. The Open Source Software ‘PD’ (Pure Data), a real-time music and multimedia environment mainly used to create live-algorithmic musical improvisation and (interactive) music composition, controls here an infinite audiovisual narrative. It is a temporary, open-ended arrangement, which sets in motion a seemingly endless chain of references to related topics: Foreign places, tourism, ethnography, globalisation, a hyperconnected world, movement, pace, rhythm and the relationship of film (structure), narrative and travel. ‘Journeys in Travel’ is designed as a creative investigation into multiple modes of contemporary digital narrative constructions. The database of video and sound elements can act as a source for varying experimental approaches where the 'data' or 'units' of the story are arranged and assembled according to different computer algorithms

'Breaking the glass': preserving social history in virtual environments

New media technologies play an important role in the evolution of our society. Traditional museums and heritage sites have evolved from the ‘cabinets of curiosity’ that focused mainly on the authority of the voice organising content, to the places that offer interactivity as a means to experience historical and cultural events of the past. They attempt to break down the division between visitors and historical artefacts, employing modern technologies that allow the audience to perceive a range of perspectives of the historical event. In this paper, we discuss virtual reconstruction and interactive storytelling techniques as a research methodology and educational and presentation practices for cultural heritage sites. We present the Narrating the Past project as a case study, in order to illustrate recent changes in the preservation of social history and guided tourist trails that aim to make the visitor’s experience more than just an architectural walk through

Exploring passive user interaction for adaptive narratives

Previous Interactive Storytelling systems have been designed to allow active user intervention in an unfolding story, using established multi-modal interactive techniques to influence narrative development. In this paper we instead explore the use of a form of passive interaction where users' affective responses, measured by physiological proxies, drive a process of narrative adaptation. We introduce a system that implements a passive interaction loop as part of narrative generation, monitoring users' physiological responses to an on-going narrative visualization and using these to adapt the subsequent development of character relationships, narrative focus and pacing. Idiomatic cinematographic techniques applied to the visualization utilize existing theories of establishing characteristic emotional tone and viewer expectations to foster additional user response. Experimental results support the applicability of filmic emotional theories in a non-film visual realization, demonstrating significant appropriate user physiological response to narrative events and "emotional cues". The subsequent narrative adaptation provides a variation of viewing experience with no loss of narrative comprehension