Musical Haptics

Haptic Musical Instruments; Haptic Psychophysics; Interface Design and Evaluation; User Experience; Musical Performanc

Body mereology

The body is made up of parts. This basic assumption is central in most neuroscientific studies of bodily sensation, body representation and motor action. Yet, the assumption has rarely been considered explicitly. We may indeed ask how the body is internally segmented and how body parts can be defined. That is, how can we sketch the mereology of the body? Here we distinguish between a somatosensory mereology and a motor mereology

Musical Haptics

Haptic Musical Instruments; Haptic Psychophysics; Interface Design and Evaluation; User Experience; Musical Performanc

Hearing Waves: A Philosophy of Sound and Auditory Perception

This dissertation aims to revive wave theory in the philosophy of sound. Wave theory identifies sounds with compression waves. Despite its wide acceptance in the scientific community as the default position, many philosophers have rejected wave theory and opted for different versions of distal theory instead. According to this current majority view, a sound has its stationary location at its source. I argue against this and other alternative philosophical theories of sound and develop wave theory into a more defensible form. Philosophers of sound tend to emphasise how sounds are experienced to be in their arguments. Most often, it is assumed that that which appears to be a distally located bearer of auditory properties in an auditory experience is a sound. Chapter 1 argues that if this distal entity is the sound source instead, many of the existing theories of sound will be severely affected. Chapter 2 discusses auditory perception and criticises the common assumption that we hear non-sound entities in virtue of hearing sounds. I show that this assumption begs the question against certain theories of sound and that the contrary view that sound sources can be directly heard is more plausible. If sound sources can be directly heard, then features commonly attributed to sounds based on auditory experiences might rather be features of sound sources. I examine eight of such features in Chapter 3. Only four of them survive. Chapters 4 and 5 review the existing theories of sound. After a taxonomy of existing theories of sound, each theory is criticised one-by-one. Some of them are problematic precisely because they rely on the implausible assumption that that which appears to be distally located in an auditory experience is a sound rather than a sound source. Lastly, Chapter 6 focuses on wave theory. It begins with two positive arguments for wave theory in general, followed by my replies to two common objections in the literature. I then move on to develop my version of wave theory. There are two core aspects of my view. The first one is a metaphysics of compression waves; the second is an account of what it is to hear compression waves. After comparing my view with a similar theory, I demonstrate the explanatory power of my view in two steps. First, the eight commonly accepted features of sounds examined in Chapter 3 are revisited. It turns out that my view can accommodate all of them. Second, explanations for four special sound-related phenomena are offered at the end of the chapter. I conclude in the last chapter with the suggestion that, as a philosopher, the best way to defend wave theory is to offer a better understanding of auditory perception which explains how compression waves are experienced

dis/cord

dis/cord is an experiment in reading sound. Embarking from Karen Barad’s early work on agential realism, it diffracts quantum physics through sound art, finding the sympathetic resonances that allow them to speak together. dis/cord believes in the materialism of sound, and strives not to understand it, but to become entangled with it. It asserts that impartial observation is impossible and understands immersion as a participatory and collaborative act. Sound art pieces provide the backdrop for a series of reflections on space, time, and matter. They trace the “marks on bodies” that sound leaves behind in its ephemeral vibration, finding new forms of sensation and interpretation through the pain and hearing loss that a life devoted to sound can cause. Drifting between sound studies, artistic research, musicology, and craftsmanship, dis/cord uses agential realism as a platform to approach thinking with, through, and about sound. Following Barad’s commitment to diffraction as a form of critique, it superposes a variety of sounds and ideas in the hope that their consonances and dissonances can provoke new ways of engaging with sound as a cultural and material agent. It is neither an appeal to scientist positivism nor a mystical immersion in listening. Rather, it builds from the intertwined physical and metaphysical curiosities that characterize Barad’s work, proposing a corporeal engagement with the disjointed temporal and spacial (dis)continuities that sonic materialism helps to build, understand, and create

The Chemical Senses

Long-standing neglect of the chemical senses in the philosophy of perception is due, mostly, to their being regarded as ‘lower’ senses. Smell, taste, and chemically irritated touch are thought to produce mere bodily sensations. However, empirically informed theories of perception can show how these senses lead to perception of objective properties, and why they cannot be treated as special cases of perception modelled on vision. The senses of taste, touch, and smell also combine to create unified perceptions of flavour. The nature of these multimodal experiences and the character of our awareness of them puts pressure on the traditional idea that each episode of perception goes one or other of the five senses. Thus, the chemical senses, far from being peripheral to the concerns of the philosophy of perception, may hold important clues to the multisensory nature of perception in general

New and improved demonstrations, each illustrating a single scientific paper

Thesis (Ed.M.)--Boston Universit

Crossmodal audio and tactile interaction with mobile touchscreens

Touchscreen mobile devices often use cut-down versions of desktop user interfaces placing high demands on the visual sense that may prove awkward in mobile settings. The research in this thesis addresses the problems encountered by situationally impaired mobile users by using crossmodal interaction to exploit the abundant similarities between the audio and tactile modalities. By making information available to both senses, users can receive the information in the most suitable way, without having to abandon their primary task to look at the device. This thesis begins with a literature review of related work followed by a definition of crossmodal icons. Two icons may be considered to be crossmodal if and only if they provide a common representation of data, which is accessible interchangeably via different modalities. Two experiments investigated possible parameters for use in crossmodal icons with results showing that rhythm, texture and spatial location are effective. A third experiment focused on learning multi-dimensional crossmodal icons and the extent to which this learning transfers between modalities. The results showed identification rates of 92% for three-dimensional audio crossmodal icons when trained in the tactile equivalents, and identification rates of 89% for tactile crossmodal icons when trained in the audio equivalent. Crossmodal icons were then incorporated into a mobile touchscreen QWERTY keyboard. Experiments showed that keyboards with audio or tactile feedback produce fewer errors and greater speeds of text entry compared to standard touchscreen keyboards. The next study examined how environmental variables affect user performance with the same keyboard. The data showed that each modality performs differently with varying levels of background noise or vibration and the exact levels at which these performance decreases occur were established. The final study involved a longitudinal evaluation of a touchscreen application, CrossTrainer, focusing on longitudinal effects on performance with audio and tactile feedback, the impact of context on performance and personal modality preference. The results show that crossmodal audio and tactile icons are a valid method of presenting information to situationally impaired mobile touchscreen users with recognitions rates of 100% over time. This thesis concludes with a set of guidelines on the design and application of crossmodal audio and tactile feedback to enable application and interface designers to employ such feedback in all systems