Brainwaves and Sound Synchronization in a Dance Performance

In a previous work (Lucchiari and Folgieri, 2015) we considered communication among young people. New digital-natives do not communicate in a traditional way, but they choose different means and ways. It is not a surprising conclusion that a large part of digital-natives considers obsolete both Web sites\u2019 structure and Internet navigation modes, learning instruments and paradigms and communication tools, choosing, instead, fast and immediate media like mobile phone communication, social networking and so on (Croitoru et al. 2011). Notwithstanding we could think they lack of communication skills, actually, they communicate with each other much more than ever done, using not only the verbal language, but also images, videos, sounds, and especially emotions. We named this phenomenon telepatheia or, better, sympateia, meaning that they seem to keep in contact independently by the mean. Of course, on our intention, this does not mean that we are observing a new organic evolution, but surely a kind of evolution can be traced: an era in which human and machines are evolving, influencing one each other, determining a specific kind of communication strongly influenced and related to technology. In this paper, starting from our previous studies and from our concept of \u201csympateia\u201d, we performed a new experiment related to brain rhythms synchronization. Through our experiment, described in the following chapter, We want to explore the communication mechanisms of telepathy (in the ancient Greek assumption of \u201ctelepatia\u201d\uf020that is [tele]=\u201ddistance\u201d and [pateia]=\u201demotion, feeling\u201d). This does not mean that we are trying to make humans telepathic, but we aim to deeply understand communication mechanisms among humans through human-computer interaction BCI devices. This means to change the point of view of brain and Information Technology researches, stressing the point of view of self-understanding of the own brain

A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces

Interactive new media art and games belong to distinctive fields, but nevertheless share common grounds, tools, methodologies, challenges, and goals, such as the use of applications and devices for engaging multiple participants and players, and more recently electroencephalography (EEG)-based brain-computer interfaces (BCIs). At the same time, an increasing number of new neuroscientific studies explore the phenomenon of brain-to-brain coupling, the dynamics and processes of the interaction and synchronisation between multiple subjects and their brain activity. In this context, we discuss interactive works of new media art, computer and serious games that involve the interaction of the brain-activity, and hypothetically brain-to-brain coupling, between multiple performer/s, spectator/s, or participants/players. We also present Enheduanna – A Manifesto of Falling (2015), a new live brain-computer cinema performance, with the use of an experimental passive multi-brain BCI system under development. The aim is to explore brain-to-brain coupling between performer/s and spectator/s as means of controlling the audio-visual creative outputs

The Effects of Monaural Beat Technology on Learners' Experiences of Music Performance Anxiety (MPA)

Music performance anxiety (MPA) is related to the experience of persisting, distressful, apprehensions about and/or actual impairment of performance skills in a public context, to a degree unwarranted given the individual’s musical aptitude, training and level of preparation (Salmon 1990). This research project set out to investigate learners’ subjective experiences of the effects of monaural beat (MB) vibrational frequencies on their experiences of MPA. The research project was a qualitative study based on a phenomenological research paradigm, which fundamentally aims to explore an experience in its own terms (Smith et al. 2009). The research participants consisted of four subject music pupils at St Andrew’s College and The Diocesan School for Girls and were interviewed through in-depth, semi-structured interviews over two practical examinations. The results suggested that various factors contribute to the experience of music performance anxiety, such as the performers’ perceptions of audience reactions, as well as the context of the performance. Self-esteem and the performer’s fragile sense of self-worth and self-confidence also play an important role in influencing their music performance anxiety. However, listening to monaural beats during a performance has the ability to lower levels of music performance anxiety by eliciting the following effects: an improved sense of confidence within the listeners; a sense of calm; the monaural beats working on a passive awareness level that allows the beat to operate at a sub-conscious level; the ability to focus better on the task at hand as well as benefit the listener in non-musical contexts such as studying; general concentration or ordinary tasks such as gardening or going for a run. The research suggests that listening to monaural beats during a musical performance can benefit the performer by lowering levels of MPA. As a result, the performer will experience an improved sense of confidence, calmness and the ability to focus better on the task at hand. Monaural beats have also shown to be a useful method of dealing with MPA instead of resorting to pharmaceutical drugs or other methods of coping such as playing games for distraction.Thesis (MMus) -- Faculty of Humanities, Music and Musicology, 202

On Mapping EEG Information into Music

With the rise of ever-more affordable EEG equipment available to musicians, artists and researchers, designing and building a Brain-Computer Music Interface (BCMI) system has recently become a realistic achievement. This chapter discusses previous research in the fields of mapping, sonification and musification in the context of designing a BCMI system and will be of particular interest to those who seek to develop their own. Design of a BCMI requires unique consider-ations due to the characteristics of the EEG as a human interface device (HID). This chapter analyses traditional strategies for mapping control from brain waves alongside previous research in bio-feedback musical systems. Advances in music technology have helped provide more complex approaches with regards to how music can be affected and controlled by brainwaves. This, paralleled with devel-opments in our understanding of brainwave activity has helped push brain-computer music interfacing into innovative realms of real-time musical perfor-mance, composition and applications for music therapy

Enheduanna – A Manifesto of Falling: first demonstration of a live brain-computer cinema performance with multi-brain BCI interaction for one performer and two audience members

The new commercial-grade Electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) have led to a phenomenal development of applications across health, entertainment and the arts, while an increasing interest in multi-brain interaction has emerged. In the arts, there is already a number of works that involve the interaction of more than one participants with the use of EEG-based BCIs. However, the field of live brain-computer cinema and mixed-media performances is rather new, compared to installations and music performances that involve multi-brain BCIs. In this context, we present the particular challenges involved. We discuss Enheduanna – A Manifesto of Falling, the first demonstration of a live brain-computer cinema performance that enables the real-time brain-activity interaction of one performer and two audience members; and we take a cognitive perspective on the implementation of a new passive multi-brain EEG-based BCI system to realise our creative concept. This article also presents the preliminary results and future work

BRAIN-COMPUTER MUSIC INTERFACING: DESIGNING PRACTICAL SYSTEMS FOR CREATIVE APPLICATIONS

Brain-computer music interfacing (BCMI) presents a novel approach to music making, as it requires only the brainwaves of a user to control musical parameters. This presents immediate benefits for users with motor disabilities that may otherwise prevent them from engaging in traditional musical activities such as composition, performance or collaboration with other musicians. BCMI systems with active control, where a user can make cognitive choices that are detected within brain signals, provide a platform for developing new approaches towards accomplishing these activities. BCMI systems that use passive control present an interesting alternate to active control, where control over music is accomplished by harnessing brainwave patterns that are associated with subconscious mental states. Recent developments in brainwave measuring technologies, in particular electroencephalography (EEG), have made brainwave interaction with computer systems more affordable and accessible and the time is ripe for research into the potential such technologies can offer for creative applications for users of all abilities. This thesis presents an account of BCMI development that investigates methods of active, passive and hybrid (multiple control methods) control that include control over electronic music, acoustic instrumental music, multi-brain systems and combining methods of brainwave control. In practice there are many obstacles associated with detecting useful brainwave signals, in particular when scaling systems otherwise designed for medical studies for use outside of laboratory settings. Two key areas are addressed throughout this thesis. Firstly, improving the accuracy of meaningful brain signal detection in BCMI, and secondly, exploring the creativity available in user control through ways in which brainwaves can be mapped to musical features. Six BCMIs are presented in this thesis, each with the objective of exploring a unique aspect of user control. Four of these systems are designed for live BCMI concert performance, one evaluates a proof-of-concept through end-user testing and one is designed as a musical composition tool. The thesis begins by exploring the field of brainwave detection and control and identifies the steady-state visually evoked potential (SSVEP) method of eliciting brainwave control as a suitable technique for use in BCMI. In an attempt to improve signal accuracy of the SSVEP technique a new modular hardware unit is presented that provides accurate SSVEP stimuli, suitable for live music performance. Experimental data confirms the performance of the unit in tests across three different EEG hardware platforms. Results across 11 users indicate that a mean accuracy of 96% and an average response time of 3.88 seconds are attainable with the system. These results contribute to the development of the BCMI for Activating Memory, a multi-user system. Once a stable SSVEP platform is developed, control is extended through the integration of two more brainwave control techniques: affective (emotional) state detection and motor imagery response. In order to ascertain the suitability of the former an experiment confirms the accuracy of EEG when measuring affective states in response to music in a pilot study. This thesis demonstrates how a range of brainwave detection methods can be used for creative control in musical applications. Video and audio excerpts of BCMI pieces are also included in the Appendices

Resonance as a design strategy for AI and social robots

Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human–robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of “sympathetic resonance” as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human–robot interactions