Mapping Dynamic Relations in Sound and Space Perception

The research investigates the dynamic relations between sound, space and the audience perception as related to an artist’s intention. What is the relation between sound and space in the sonic arts, and to what kind of merger does it lead? What relationship exists between the intention of the composer and the perception of the audience regarding architectural and environmental spaces? Is there a common thread of perception of architectural and environmental spaces among participants? Is embodiment a key for the perception of the dynamic relations of sound and space? The framework for the investigation is based on a map of three defined spaces (Real, Virtual, and Hyperbiological) included in a portfolio of six works (three electroacoustic compositions, two sound installations, and one performance), which lead to the analysis of the perception of space, namely, the perception of architectural and environmental spaces as required by the portfolio. The original knowledge resides in the exploration of a potential common representation (space and sound perception being, of course, a personal representation) of internal perceptual spaces and mental imageries generated by the works. The act of listening plays a major role in the development of the portfolio presented and includes Pauline Oliveros’ concept of deep listening (Oliveros 2005). Sound and space are intimately related in the portfolio. One particular element emerging from this relationship is the plastic quality of sound, meaning that sound is considered and observed as a material that is shaped by space. From this perspective the research investigates the ‘sculptural’ and morphological quality of the relationship between sound and space. The results include the specific language and signature of the artworks that delineate the intersection of music and fine arts. The portfolio pays a large tribute to several iconic artists present in the outposts of sound blurred by space. Composers and artists are therefore presented in the theoretical section in order to highlight how their pioneering works have influenced and informed the present research portfolio. The analysis of the perception of the artworks relates to a methodology based on an empirical survey inspired by phenomenology

Feedback and motor skill acquisition using a haptic dental simulator

Aim: To investigate the effect of qualitatively different types of pedagogical feedback (FB) on the training, transfer and retention of basic manual dexterity dental skills using a virtual reality (VR) haptic dental simulator. Methods: Sixty-three participants (M = 22.7 years; SD = 3.4 years), with no previous dental training, were randomly allocated to one of three groups (n = 21 each). Group 1 received device-only feedback during the training phase, that is the visual display of the simulator (DFB); Group 2 received verbal feedback from a qualified dental instructor (IFB); and Group 3 received a combination of instructor and device feedback (IDFB). Participants completed four tasks during which feedback was given according to group allocation as well as two skills transfer tests. Skill retention was examined immediately after training, at 1 week and at 1 month post-test. Results: Statistically significant differences were found between the groups in overall performance (P < 0.001) and error (P = 0.006). Post hoc comparisons revealed the IDFB group produced substantially better performance and fewer errors in comparison with DFB and IFB training. This difference translated to improved performance in skill retention and generalisation of knowledge to novel tasks. Conclusion: These data indicate that the acquisition and retention of basic dental motor skills in novice trainees is best optimised through a combination of instructor and visual display (VR)-driven feedback. The results have implications for the utility and implementation of VR haptic technology in dental education

Plastic modes of listening: affordance in constructed sound environments

This thesis is concerned with how the ecological approach to perception with the inclusion of listening modes, informs the creation of sound art installation, or more specifically as referred to in this thesis as constructed sound environments. The basis for the thesis has been a practiced based research where the aim and purpose of the written part of this PhD project has been to critically investigate the area of sound art, in order to map various approaches towards participating in and listening to a constructed sound environment. The main areas has been the notion of affordance as coined by James J. Gibson (1986), listening modes as coined by Pierre Schaeffer (1966) and further developed by Michel Chion (1994), aural architects as coined by Blesser and Salter (2007) and the holistic approach towards understanding sound art developed by Brandon LaBelle (2006). The findings within the written part of the thesis, based on a qualitative analysis, have informed the practice that has resulted in artefacts in the form of seven constructed sound environments that also functions as case studies for further analysis. The aim of the practice has been to exemplify the methodology, strategy and progress behind the organisation and construction of sound environments The research concerns points towards the acknowledgment of affordance as the crucial factor in understanding a constructed sound environment. The affordance approach govern the idea that perceiving a sound environment is a top-down process where the autonomic quality of a constructed sound environment is based upon the perception of structures of the sound material and its relationship with speaker placement and surrounding space. This enables a researcher to side step the conflicting poles of musical/abstract and non-musical/realistic classification of sound elements and regard these poles as included, not separated elements in the analysis of a constructed sound environment

Viatopias: Exploring the experience of urban travel space

The title of this research is constructed from: `via' - route and töp(os) -a place. Viatopias are urban spaces of continual travel or flux that incorporate multiple forms of perception and inscriptions of meaning. My aim has been to define and describe the increasingly important fluid perceptual spaces that have developed between static nineteenth century destinations. Viatopias such as passageways, underground tunnels, train tracks, and the North Circular escape a sense of destination, operating as ever-changing experiences or events. The practice has sought to produce digital representations of these urban travel spaces that exist in constant flux, to communicate the experience of Viatopias. The research explores themes such as: The North Circular as a Deleuzian Route exploring driving as performance; Plica, Replica, Explica an unfolding of experience through digital media; The Making of Baroque Videos, using Baroque architectures of viewing; Mobilizing Perception treating human vision as an artifact; Mirrors For Un-Recognition disassembling nineteenth century controlled vision; Sound as an Urban Compass considering urban audio experience; Narrative Practice in New Media Space analysing contemporary approaches in digital media; and Convergent Languages, Digital Poiesis investigating the dislocation of representation in different digital languages. These conceptual frameworks developed in symbiosis with the practice. The visual practice presents a collection of digital videos that extend and complicate these concepts through experimental visual and audio techniques such as layering, repetition, anamorphic distortion, and mirroring to produce visual immersion and the fracturing of space. The concluding digital works incorporate video with audio and text resulting in integrated visual statements that attempt to stretch the viewer's perception, in the process offering a glimpse of a new experience within urban space

Spatial representation and visual impairement - Developmental trends and new technological tools for assessment and rehabilitation

It is well known that perception is mediated by the five sensory modalities (sight, hearing, touch, smell and taste), which allows us to explore the world and build a coherent spatio-temporal representation of the surrounding environment. Typically, our brain collects and integrates coherent information from all the senses to build a reliable spatial representation of the world. In this sense, perception emerges from the individual activity of distinct sensory modalities, operating as separate modules, but rather from multisensory integration processes. The interaction occurs whenever inputs from the senses are coherent in time and space (Eimer, 2004). Therefore, spatial perception emerges from the contribution of unisensory and multisensory information, with a predominant role of visual information for space processing during the first years of life. Despite a growing body of research indicates that visual experience is essential to develop spatial abilities, to date very little is known about the mechanisms underpinning spatial development when the visual input is impoverished (low vision) or missing (blindness). The thesis's main aim is to increase knowledge about the impact of visual deprivation on spatial development and consolidation and to evaluate the effects of novel technological systems to quantitatively improve perceptual and cognitive spatial abilities in case of visual impairments. Chapter 1 summarizes the main research findings related to the role of vision and multisensory experience on spatial development. Overall, such findings indicate that visual experience facilitates the acquisition of allocentric spatial capabilities, namely perceiving space according to a perspective different from our body. Therefore, it might be stated that the sense of sight allows a more comprehensive representation of spatial information since it is based on environmental landmarks that are independent of body perspective. Chapter 2 presents original studies carried out by me as a Ph.D. student to investigate the developmental mechanisms underpinning spatial development and compare the spatial performance of individuals with affected and typical visual experience, respectively visually impaired and sighted. Overall, these studies suggest that vision facilitates the spatial representation of the environment by conveying the most reliable spatial reference, i.e., allocentric coordinates. However, when visual feedback is permanently or temporarily absent, as in the case of congenital blindness or blindfolded individuals, respectively, compensatory mechanisms might support the refinement of haptic and auditory spatial coding abilities. The studies presented in this chapter will validate novel experimental paradigms to assess the role of haptic and auditory experience on spatial representation based on external (i.e., allocentric) frames of reference. Chapter 3 describes the validation process of new technological systems based on unisensory and multisensory stimulation, designed to rehabilitate spatial capabilities in case of visual impairment. Overall, the technological validation of new devices will provide the opportunity to develop an interactive platform to rehabilitate spatial impairments following visual deprivation. Finally, Chapter 4 summarizes the findings reported in the previous Chapters, focusing the attention on the consequences of visual impairment on the developmental of unisensory and multisensory spatial experience in visually impaired children and adults compared to sighted peers. It also wants to highlight the potential role of novel experimental tools to validate the use to assess spatial competencies in response to unisensory and multisensory events and train residual sensory modalities under a multisensory rehabilitation

Action Observation With Dual Task for Improving Cognitive Abilities in Parkinson's Disease: A Pilot Study

Action observation therapy (AOT) has been recently proposed as a new rehabilitation approach for treatment of motor deficits in Parkinson's disease. To date, this approach has never been used to deal with cognitive deficits (e.g., deficits in working memory, attention), which are impairments that are increasingly recognized in Parkinsonian patients. Typically, patients affected by these dysfunctions have difficulty filtering out irrelevant information and tend to lose track of the task goal. In this paper, we propose that AOT may also be used to improve cognitive abilities of Parkinsonian patients if it is used within a dual task framework. We articulate our hypothesis by pivoting on recent findings and on preliminary results that were obtained through a pilot study that was designed to test the efficacy of a long-term rehabilitation program that, for the first time, uses AOT within a dual task framework for treating cognitive deficits in patients with Parkinson's disease. Ten Parkinson's disease patients underwent a 45-min treatment that consisted in watching a video of an actor performing a daily-life activity and then executing it while performing distractive tasks (AOT with dual task). The treatment was repeated three times per week for a total of 4 weeks. Patients' cognitive/motor features were evaluated through standard tests four times: 1 month before treatment, the first and the last day of treatment and 1 month after treatment. The results show that this approach may provide relevant improvements in cognitive aspects related to working memory (verbal and visuospatial memory) and attention. We discuss these results by pivoting on literature on action observation and recent literature demonstrating that the dual task method can be used to stimulate cognition and concentration. In particular, we propose that using AOT together with a dual task may train the brain systems supporting executive functions through two mechanisms: (i) stimulation of goal setting within the mirror neuron system through action observation and (ii) working memory and persistent goal maintenance through dual task stimuli

Action observation with dual task for improving cognitive abilities in Parkinson’s disease. a pilot study

Action observation therapy (AOT) has been recently proposed as a new rehabilitation approach for treatment of motor deficits in Parkinson's disease. To date, this approach has never been used to deal with cognitive deficits (e.g., deficits in working memory, attention), which are impairments that are increasingly recognized in Parkinsonian patients. Typically, patients affected by these dysfunctions have difficulty filtering out irrelevant information and tend to lose track of the task goal. In this paper, we propose that AOT may also be used to improve cognitive abilities of Parkinsonian patients if it is used within a dual task framework. We articulate our hypothesis by pivoting on recent findings and on preliminary results that were obtained through a pilot study that was designed to test the efficacy of a long-term rehabilitation program that, for the first time, uses AOT within a dual task framework for treating cognitive deficits in patients with Parkinson's disease. Ten Parkinson's disease patients underwent a 45-min treatment that consisted in watching a video of an actor performing a daily-life activity and then executing it while performing distractive tasks (AOT with dual task). The treatment was repeated three times per week for a total of 4 weeks. Patients' cognitive/motor features were evaluated through standard tests four times: 1 month before treatment, the first and the last day of treatment and 1 month after treatment. The results show that this approach may provide relevant improvements in cognitive aspects related to working memory (verbal and visuospatial memory) and attention. We discuss these results by pivoting on literature on action observation and recent literature demonstrating that the dual task method can be used to stimulate cognition and concentration. In particular, we propose that using AOT together with a dual task may train the brain systems supporting executive functions through two mechanisms: (i) stimulation of goal setting within the mirror neuron system through action observation and (ii) working memory and persistent goal maintenance through dual task stimuli

Neuronal Chains for Actions in the Parietal Lobe: A Computational Model

The inferior part of the parietal lobe (IPL) is known to play a very important role in sensorimotor integration. Neurons in this region code goal-related motor acts performed with the mouth, with the hand and with the arm. It has been demonstrated that most IPL motor neurons coding a specific motor act (e.g., grasping) show markedly different activation patterns according to the final goal of the action sequence in which the act is embedded (grasping for eating or grasping for placing). Some of these neurons (parietal mirror neurons) show a similar selectivity also during the observation of the same action sequences when executed by others. Thus, it appears that the neuronal response occurring during the execution and the observation of a specific grasping act codes not only the executed motor act, but also the agent's final goal (intention)