Dialectical Polyptych: an interactive movie installation

Most of the known video games developed by important software companies usually establish an approach to the cinematic language in an attempt to create a perfect combination of narrative, visual technique and interaction. Unlike most video games, interactive film narratives normally involve an interruption in time whenever the spectator has to make choices. “Dialectical Polyptych” is an interactive movie included in a project called “Characters looking for a spectactor”, which aims to give the spectator on-the-fly control over film editing, thus exploiting the role of the spectator as an active subject in the presented narrative. This paper presents an installation based on a mobile device, which allows seamless real-time interactivity with the movie. Different finger touches in the screen allow the spectator to alternate between two parallel narratives, both producing a complementary narrative, and change the angle or shot within each narrative.info:eu-repo/semantics/publishedVersio

A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces

Interactive new media art and games belong to distinctive fields, but nevertheless share common grounds, tools, methodologies, challenges, and goals, such as the use of applications and devices for engaging multiple participants and players, and more recently electroencephalography (EEG)-based brain-computer interfaces (BCIs). At the same time, an increasing number of new neuroscientific studies explore the phenomenon of brain-to-brain coupling, the dynamics and processes of the interaction and synchronisation between multiple subjects and their brain activity. In this context, we discuss interactive works of new media art, computer and serious games that involve the interaction of the brain-activity, and hypothetically brain-to-brain coupling, between multiple performer/s, spectator/s, or participants/players. We also present Enheduanna – A Manifesto of Falling (2015), a new live brain-computer cinema performance, with the use of an experimental passive multi-brain BCI system under development. The aim is to explore brain-to-brain coupling between performer/s and spectator/s as means of controlling the audio-visual creative outputs

Videogames as digital audiovisual performance

Video games are an ideal medium for creating a live-cinema experience because of their potential for cinematic narrative and open structure. "Performing digital media' as opposed to 'performing with digital media' or using digital media in performance, means to play the media like a musical instrument as much as possible. This is to be able to control and finely nuance the audiovisual and kinetic data stream through live manipulation and interaction on stage. This is, in a sense, to grant the performance an immediacy that belies remediation. This paper looks at recent instances in which the media itself is being performed and a similar audiovisual contract to that of cinema is being entered to by an audience. Thus, the performance or live event itself becomes a product of media technologies yet is indistinctly unified with them

'Breaking the glass': preserving social history in virtual environments

New media technologies play an important role in the evolution of our society. Traditional museums and heritage sites have evolved from the ‘cabinets of curiosity’ that focused mainly on the authority of the voice organising content, to the places that offer interactivity as a means to experience historical and cultural events of the past. They attempt to break down the division between visitors and historical artefacts, employing modern technologies that allow the audience to perceive a range of perspectives of the historical event. In this paper, we discuss virtual reconstruction and interactive storytelling techniques as a research methodology and educational and presentation practices for cultural heritage sites. We present the Narrating the Past project as a case study, in order to illustrate recent changes in the preservation of social history and guided tourist trails that aim to make the visitor’s experience more than just an architectural walk through

The design-by-adaptation approach to universal access: learning from videogame technology

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-byadaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation

‘In the game’? Embodied subjectivity in gaming environments

Human-computer interactions are increasingly using more (or all) of the body as a control device. We identify a convergence between everyday bodily actions and activity within digital environments, and a trend towards incorporating natural or mimetic form of movement into gaming devices. We go on to reflect on the nature of player ‘embodiment’ in digital gaming environments by applying insights from the phenomenology of Maurice Merleau-Ponty. Three conditions for digital embodiment are proposed, with implications for Calleja’s (2011) Player Involvement Model (PIM) of gaming discussed

The Experience Machine: Existential reflections on Virtual Worlds

Problems and questions originally raised by Robert Nozick in his famous thought experiment ‘The Experience Machine’ are frequently invoked in the current discourse concerning virtual worlds. Having conceptualized his Gedankenexperiment in the early seventies, Nozick could not fully anticipate the numerous and profound ways in which the diffusion of computer simulations and video games came to affect the Western world. This article does not articulate whether or not the virtual worlds of video games, digital simulations, and virtual technologies currently actualize (or will actualize) Nozick’s thought experiment. Instead, it proposes a philosophical reflection that focuses on human experiences in the upcoming age of their ‘technical reproducibility’. In pursuing that objective, this article integrates and supplements some of the interrogatives proposed in Robert Nozick’s thought experiment. More specifically, through the lenses of existentialism and philosophy of technology, this article tackles the technical and cultural heritage of virtual reality, and unpacks its potential to function as a tool for self-discovery and self-construction. Ultimately, it provides an interpretation of virtual technologies as novel existential domains. Virtual worlds will not be understood as the contexts where human beings can find completion and satisfaction, but rather as instruments that enable us to embrace ourselves and negotiate with various aspects of our (individual as well as collective) existence in previously-unexperienced guises