The Effects of Musical Expertise on Sensory Processing

The goal of this thesis was to assess sensorimotor musical experience and its impact on the way that individuals perceive and interact with real-world musical stimuli. Experiment #1 investigated multisensory integration in 14 musicians and 10 non-musicians using a two alternative forced-choice (2AFC) discrimination task, and was designed to examine whether musical expertise augmented multisensory enhancement. Musical experience did not alter the outcomes of multisensory integration, but there may be asymmetries between musicians and non-musicians in their use of auditory cues. Experiment #2 was a neuroimaging case study investigating the influence of musical familiarity on the kinesthetic motor imagery of dance accompanied by music in expert dancers. Familiarity resulted in increased hemodynamic responses in the supplementary motor area (SMA) and decreased responses in Heschls gyrus (HG). These findings provide new evidence regarding the influence of musical expertise on sensory processing using real-world complex stimuli. This thesis suggests that expert practice shapes the way experts perceive and interact with their environments, and emphasizes the need for, and challenges of using naturalistic stimuli

Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human–Computer Interaction

In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understanding around the role of communication between sensory modalities during development. In the current review, we outline four principles that will aid technological development based on theoretical models of multisensory development and embodiment to foster in-depth, perceptual, and conceptual learning of mathematics. We also discuss how a multidisciplinary approach offers a unique contribution to development of new practical solutions for learning in school. Scientists, engineers, and pedagogical experts offer their interdisciplinary points of view on this topic. At the end of the review, we present our results, showing that one can use multiple sensory inputs and sensorimotor associations in multisensory technology to improve the discrimination of angles, but also possibly for educational purposes. Finally, we present an application, the ‘RobotAngle’ developed for primary (i.e., elementary) school children, which uses sounds and body movements to learn about angles

Aerospace Medicine and Biology: A continuing bibliography with indexes (supplement 133)

This special bibliography lists 276 reports, articles, and other documents introduced into the NASA Scientific and Technical Information System in September 1974

Ethnography and experimental non-fiction storytelling: relating the experiences of Maltese Fishermen

In this practice-based exploration I look at the dynamics of long-term ethnographic research to address the tensions between lived experience and conventional narrative constructs of Mediterranean identities. This research also fills a void in the anthropology of fishermen in Malta which as an area of academic investigation has remained understudied. Speculating on relational meaning making processes and multidimensional and experimental qualities inherent to ethnographic research, I produced non-linear multimodal documentary works as environments with the capacity to engender tangible, immersive and tacit knowledge about situated identities. Using my seven-year engagement with a family of fishermen from Marsaxlokk, a small fishing port in the south eastern part of Malta, I reflect on how situated learning experiences can inform experimental non-fiction audio-visual storytelling. In my research I draw on theories of affect and notions of the archivalto reflect on the ways Mediterranean identities are constructed. Examining the ecology of relations that binds together the people and the environment that they inhabit I engage with current discourses on multisensory ethnography, documentary making and narrative power to explore my practice (including two photographic essays, a sound installation, two gallery video projections and a web-based documentary prototype) as a process of creative mediation between the fishermen’s world and the public. Using select examples from my fieldwork recordings I show how embodied audio-visual practices enable nonfiction storytellers to re-propose the conditions of the ethnographic encounter. I look at how, responding to the very particular environmental and socio-cultural conditions of my field of study, I took my practice beyond the canons of traditional documentary photography towards an expanded multimedia form of storytelling. More specifically, I refer to my experiences with people working on and around the Joan of Arc(the family boat), as well as my apprenticeship as a deckhand/fisherman, to examine notions of emplaced learning, collaborative meaning making processes and affective strategies for the development of creative sensory-rich immersive storytelling strategies that provide amore nuanced understanding of Mediterranean identities

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

The nature of accessibility studies

Accessibility has come to play a pivotal role on the world's stage, gradually pervading different aspects of our lives as well as a vast range of fields, giving rise to a plethora of fruitful new ideas, methods and models, and becoming an ever more key issue within a process that is reshaping the very fabric of society. The ubiquitous effects of accessibility have led to the emergence of a new research field, namely accessibility studies (AS). This paper presents both the path that has led towards the emergence of AS as well as the distinctive features of this new field. AS is defined as the field concerned with the investigation of accessibility processes and phenomena, and the design, implementation and evaluation of accessibility-based and accessibility-oriented methodologies. The analysis is carried out mainly, though not exclusively, in reference to media accessibility (MA), as it is one of the most mature areas in which the process of the formation of AS has been taking place. It concludes by arguing that AS is a timely field that addresses the most pressing issues our society is facing nowadays and appealing to MA to embrace its identity as an area of AS

Audiovisual correspondences in Sergei Eisenstein’s Alexander Nevsky: a case study in viewer attention

Cognitive film theory is an approach to analyzing film that bridges the traditionally segregated disciplines of film theory, philosophy and the psychological and neurosciences. Considerable work has already been presented from the perspective of film theory that utilizes existing empirical evidence of psychological phenomenon to inform our understanding of film viewers and the form of film itself. But can empirical psychology also provide ways to directly test the insights generated by the theoretical study of film? In this chapter I will present a case study in which eye-tracking is used to validate Russian film director Sergei Eisenstein’s intuitions about viewer attention during a sequence from Alexander Nevsky (1938