Multisensory integration in complex rhythmic motor tasks

This publication-based thesis aimed to shed further light on the contributions of visual and auditory information to the execution of complex rhythmic motor tasks. To this end, a series of three empirical studies was designed. The first two studies were conducted in the experimental setting of long jumping – a task that does not only require high precision but also high velocity to leap as far as possible. Within the first study, we aimed to examine visual regulation during the long jump run-up using portable eye-tracking technology. Previous research on the topic of visual regulation in long jumping has identified a universal instance in participants’ gait behavior which introduces a rapid decrease in step variability. Since then, this parameter was considered synonymous with the (gait-based) onset of visual regulation. However, an investigation of actual visual behavior by means of direct measures was still pending to date. Hence, the first study was designed to identify a potential equivalent to the gait-based parameter within participants’ gaze behavior. Results revealed that the moment of the longest gaze on the take-off board coincided with the occurrence of the well-established gait parameter. Given that i) the gait-based visual regulation parameter has been associated with a reduction in footfall variability and ii) current research advocates the idea that fixations of longer duration facilitate motor actions, one might speculate that the longest gaze on the take-off board might as well serve the reduction of movement variability. While the parameter of visual regulation could be characterized in more detail within the first empirical investigation, the impact of other modalities has been neglected so far. However, current research is promoting the idea that, apart from visual information, auditory information might as well be crucial for the execution of motor tasks. ..

Between two worlds : approaching Balkan oral music tradition through the use of technology as a compositional and performing medium

This text explores the problems of interpreting musical identity, meaning, and sociocultural value of a compositional work influenced by two traditions with different values: the modernist tradition based on Western European classical heritage, and the oral tradition of the Balkans. It also follows the process of transformation and recreation of the author's musical language: from classical, notation-oriented to a more intuitive, improvisational and live-performance based. Through detailing some of the experiences of the author as a composer and a performer, it also discusses some observations on the ways in which this discrepancy between two traditions and practices has affected and still influences those creative practices in Serbia and the former Yugoslavia that relate to traditional music and its derivations. By identifying musical performance within certain socio-cultural contexts this dichotomy can be highlighted. As a result, a substantial part of this text focuses on investigating the capacity of a technologically assisted composition and performance practice to overcome this issue. Technology is here perceived not only as an instrument for recording, improvising, composing and performing but also as a medium which communicates musical value. In this study, the oral tradition from the Balkans was approached not only as a purely acoustic phenomenon, but it also included a raised awareness of the nature of the continuous fusion of various cultures in the region, as well as existing cultural and religious antagonisms. This study investigates the problems of constructing musical identity as well as the meaning of an author’s creative practice in relation to the socio-cultural environment of its origin, whilst observing its reception by audiences outside the Balkan region. Socio-cultural environments are established through exploring the writings of the authors that depict the Balkans historical, cultural and musical spheres in relation to other cultural practices and influences

Expressive digital musical instruments for children

Thesis (S.M.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 1999.Includes bibliographical references (p. 87-92).This thesis proposes to use technology to introduce children to musical expressivity and creativity. It describes a set of digital musical instruments that were developed in an effort to provide children with new tools for interaction, exploration and enjoyment of music. The thesis unfolds a multidisciplinary theoretical background, which reviews a number of philosophical, psychological, musical, and technological theories. The theoretical background focuses on enlightening a number of personal musical experiences and leads towards the formulation of three musical concepts that inform the design of the digital musical instruments. The musical concepts are: High and Low-level Musical Control, Immersive and Constructive Musical Experiences and Interdependent Group Playing. The thesis presents the embodiment of these concepts in digital musical instruments while emphasizing the importance of novel technology as a provider of creative and expressive musical experiences for children.by Gil Weinberg.S.M

Music and movement: the case for a kinaesthetic stategy in promoting musical memory.

This research study focuses on the role of\ud kinaesthesis and motor response in promoting musical\ud memory. The main questions addressed are:\ud What is the nature of musical memory?\ud How is it promoted?\ud Is a kinaesthetic or muscular\ud strategy a particularly effective\ud means of promoting musical memory?\ud The investigation which follows is mainly conceptual,\ud yet reinforced by some empirical work. It falls into\ud three parts:\ud 1) Cognitive processes;\ud 2) The potential role of kinaesthesis\ud and movement as imagery\ud strategies;\ud 3) Empirical investigation.\ud In part one a framework for the investigation is\ud established. The study of general aspects of memory\ud is linked to research in music cognition and memory.\ud A chapter on representation and imagery is concerned\ud with those techniques and strategies by which musical\ud memory is developed.\ud Part two examines the nature of kinaesthesis and its\ud role in cognitive processes and musical cognition.\ud Rhythmic experience is considered in relation to\ud kinaesthesis and its overt manifestation in physical\ud movement.The major contribution of Emile Jaques-\ud Dalcroze is presented, as a study of kinaesthetic\ud strategy in practice. The close correspondence\ud between music and expressive movement is examined,\ud before a chapter in which a conceptual framework is\ud proposed.\ud The third and final part presents the empirical work\ud undertaken in testing the kinaesthetic principle:\ud 'The stronger the muscular\ud sensations, the clearer and more\ud precise the images' (Jaques-Dalcroze)\ud A replication experiment is described which forms the\ud basis for an experiment on kinaesthetic strategy, the\ud success of which lends support to the theoretical\ud evidence presented. Conclusions are drawn and Dalcroze\ud practice reviewed in the light of these findings and\ud the preceding theoretical work

The Role of Prosodic Stress and Speech Perturbation on the Temporal Synchronization of Speech and Deictic Gestures

Gestures and speech converge during spoken language production. Although the temporal relationship of gestures and speech is thought to depend upon factors such as prosodic stress and word onset, the effects of controlled alterations in the speech signal upon the degree of synchrony between manual gestures and speech is uncertain. Thus, the precise nature of the interactive mechanism of speech-gesture production, or lack thereof, is not agreed upon or even frequently postulated. In Experiment 1, syllable position and contrastive stress were manipulated during sentence production to investigate the synchronization of speech and pointing gestures. An additional aim of Experiment 2 was to investigate the temporal relationship of speech and pointing gestures when speech is perturbed with delayed auditory feedback (DAF). Comparisons between the time of gesture apex and vowel midpoint (GA-VM) for each of the conditions were made for both Experiment 1 and Experiment 2. Additional comparisons of the interval between gesture launch midpoint to vowel midpoint (GLM-VM), total gesture time, gesture launch time, and gesture return time were made for Experiment 2. The results for the first experiment indicated that gestures were more synchronized with first position syllables and neutral syllables as measured GA-VM intervals. The first position syllable effect was also found in the second experiment. However, the results from Experiment 2 supported an effect of contrastive pitch effect. GLM-VM was shorter for first position targets and accented syllables. In addition, gesture launch times and total gesture times were longer for contrastive pitch accented syllables, especially when in the second position of words. Contrary to the predictions, significantly longer GA-VM and GLM-VM intervals were observed when individuals responded under provided delayed auditory feedback (DAF). Vowel and sentence durations increased both with (DAF) and when a contrastive accented syllable was produced. Vowels were longest for accented, second position syllables. These findings provide evidence that the timing of gesture is adjusted based upon manipulations of the speech stream. A potential mechanism of entrainment of the speech and gesture system is offered as an explanation for the observed effects

EMG-driven control in lower limb prostheses: a topic-based systematic review

Background The inability of users to directly and intuitively control their state-of-the-art commercial prosthesis contributes to a low device acceptance rate. Since Electromyography (EMG)-based control has the potential to address those inabilities, research has flourished on investigating its incorporation in microprocessor-controlled lower limb prostheses (MLLPs). However, despite the proposed benefits of doing so, there is no clear explanation regarding the absence of a commercial product, in contrast to their upper limb counterparts. Objective and methodologies This manuscript aims to provide a comparative overview of EMG-driven control methods for MLLPs, to identify their prospects and limitations, and to formulate suggestions on future research and development. This is done by systematically reviewing academical studies on EMG MLLPs. In particular, this review is structured by considering four major topics: (1) type of neuro-control, which discusses methods that allow the nervous system to control prosthetic devices through the muscles; (2) type of EMG-driven controllers, which defines the different classes of EMG controllers proposed in the literature; (3) type of neural input and processing, which describes how EMG-driven controllers are implemented; (4) type of performance assessment, which reports the performance of the current state of the art controllers. Results and conclusions The obtained results show that the lack of quantitative and standardized measures hinders the possibility to analytically compare the performances of different EMG-driven controllers. In relation to this issue, the real efficacy of EMG-driven controllers for MLLPs have yet to be validated. Nevertheless, in anticipation of the development of a standardized approach for validating EMG MLLPs, the literature suggests that combining multiple neuro-controller types has the potential to develop a more seamless and reliable EMG-driven control. This solution has the promise to retain the high performance of the currently employed non-EMG-driven controllers for rhythmic activities such as walking, whilst improving the performance of volitional activities such as task switching or non-repetitive movements. Although EMG-driven controllers suffer from many drawbacks, such as high sensitivity to noise, recent progress in invasive neural interfaces for prosthetic control (bionics) will allow to build a more reliable connection between the user and the MLLPs. Therefore, advancements in powered MLLPs with integrated EMG-driven control have the potential to strongly reduce the effects of psychosomatic conditions and musculoskeletal degenerative pathologies that are currently affecting lower limb amputees