Multiple Media Interfaces for Music Therapy

This article describes interfaces (and the supporting technological infrastructure) to create audiovisual instruments for use in music therapy. In considering how the multidimensional nature of sound requires multidimensional input control, we propose a model to help designers manage the complex mapping between input devices and multiple media software. We also itemize a research agenda

The sound motion controller: a distributed system for interactive music performance

We developed an interactive system for music performance, able to control sound parameters in a responsive way with respect to the user’s movements. This system is conceived as a mobile application, provided with beat tracking and an expressive parameter modulation, interacting with motion sensors and effector units, which are connected to a music output, such as synthesizers or sound effects. We describe the various types of usage of our system and our achievements, aimed to increase the expression of music performance and provide an aid to music interaction. The results obtained outline a first level of integration and foresee future cognitive and technological research related to it

EMBRACE@Nancay: An Ultra Wide Field of View Prototype for the SKA

A revolution in radio receiving technology is underway with the development of densely packed phased arrays for radio astronomy. This technology can provide an exceptionally large field of view, while at the same time sampling the sky with high angular resolution. Such an instrument, with a field of view of over 100 square degrees, is ideal for performing fast, all-sky, surveys, such as the "intensity mapping" experiment to measure the signature of Baryonic Acoustic Oscillations in the HI mass distribution at cosmological redshifts. The SKA, built with this technology, will be able to do a billion galaxy survey. I will present a very brief introduction to radio interferometry, as well as an overview of the Square Kilometre Array project. This will be followed by a description of the EMBRACE prototype and a discussion of results and future plans.Comment: to appear in proceedings of the INFIERI Summer School INtelligent Signal Processing for FrontIEr Research and Industry, Paris 201

Dynamical Interactions with Electronic Instruments

This paper examines electronic instruments that incorporate dynamical systems, where the behaviour of the instrument depends not only upon the immediate input to the instrument, but also on the past input. Five instruments are presented as case studies: Michel Waisvisz’ Crackle-box, Dylan Menzies’ Spiro, no-input mixing desk, the author’s Feedback Joypad, and microphone-loudspeaker feedback. Links are suggested between the sonic affordances of each instrument and the dynamical mechanisms embedded in them. These affordances are contrasted with those of non-dynamical instruments such as the Theremin and sample-based instruments. This is discussed in the context of contemporary, material-oriented approaches to composition and particularly to free improvisation where elements such as unpredictability and instability are often of interest, and the process of exploration and discovery is an important part of the practice

An introduction to interactive sonification

The research field of sonification, a subset of the topic of auditory display, has developed rapidly in recent decades. It brings together interests from the areas of data mining, exploratory data analysis, human–computer interfaces, and computer music. Sonification presents information by using sound (particularly nonspeech), so that the user of an auditory display obtains a deeper understanding of the data or processes under investigation by listening

Spaceborne sensors (1983-2000 AD): A forecast of technology

A technical review and forecast of space technology as it applies to spaceborne sensors for future NASA missions is presented. A format for categorization of sensor systems covering the entire electromagnetic spectrum, including particles and fields is developed. Major generic sensor systems are related to their subsystems, components, and to basic research and development. General supporting technologies such as cryogenics, optical design, and data processing electronics are addressed where appropriate. The dependence of many classes of instruments on common components, basic R&D and support technologies is also illustrated. A forecast of important system designs and instrument and component performance parameters is provided for the 1983-2000 AD time frame. Some insight into the scientific and applications capabilities and goals of the sensor systems is also given

Comparison of input devices in an ISEE direct timbre manipulation task

The representation and manipulation of sound within multimedia systems is an important and currently under-researched area. The paper gives an overview of the authors' work on the direct manipulation of audio information, and describes a solution based upon the navigation of four-dimensional scaled timbre spaces. Three hardware input devices were experimentally evaluated for use in a timbre space navigation task: the Apple Standard Mouse, Gravis Advanced Mousestick II joystick (absolute and relative) and the Nintendo Power Glove. Results show that the usability of these devices significantly affected the efficacy of the system, and that conventional low-cost, low-dimensional devices provided better performance than the low-cost, multidimensional dataglove

A novel continuous pitch electronic wind instrument controller

We present a design for an electronic continuous pitch wind controller for musical performance. It uses a combination of linear position, magnetic reed, and air pressure sensors to generate three fully continuous control dimensions. Each control dimension is encoded and transmitted using the industry standard MIDI protocol to allow the instrument to interface with a large variety of synthesizers to control different parameters of the synthesis algorithm in real time, allowing for a high degree of expressiveness not possible with existing electronic wind instrument controllers. The first part of the thesis will provide a justification for the design of a novel instrument, and present some of the theory behind pitch representation, encoding, and transmission with respect to digital systems. The remainder of the thesis will present the particular design and explain the workings of its various subsystems

An Integrated System at the Bleien Observatory for Mapping the Galaxy

We describe the design and performance of the hardware system at the Bleien Observatory. The system is designed to deliver a map of the Galaxy for studying the foreground contamination of low-redshift (z=0.13--0.43) H$_{\rm I}$ intensity mapping experiments as well as other astronomical Galactic studies. This hardware system is composed of a 7m parabolic dish, a dual-polarization corrugated horn feed, a pseudo correlation receiver, a Fast Fourier Transform spectrometer, and an integrated control system that controls and monitors the progress of the data collection. The main innovative designs in the hardware are (1) the pseudo correlation receiver and the cold reference source within (2) the high dynamic range, high frequency resolution spectrometer and (3) the phase-switch implementation of the system. This is the first time these technologies are used together for a L-band radio telescope to achieve an electronically stable system, which is an essential first step for wide-field cosmological measurements. This work demonstrates the prospects and challenges for future H$_{\rm I}$ intensity mapping experiments.Comment: 11 pages, 12 figures, 1 table, Submitted to MNRA

Of epistemic tools: musical instruments as cognitive extensions

This paper explores the differences in the design and performance of acoustic and new digital musical instruments, arguing that with the latter there is an increased encapsulation of musical theory. The point of departure is the phenomenology of musical instruments, which leads to the exploration of designed artefacts as extensions of human cognition – as scaffolding onto which we delegate parts of our cognitive processes. The paper succinctly emphasises the pronounced epistemic dimension of digital instruments when compared to acoustic instruments. Through the analysis of material epistemologies it is possible to describe the digital instrument as an epistemic tool: a designed tool with such a high degree of symbolic pertinence that it becomes a system of knowledge and thinking in its own terms. In conclusion, the paper rounds up the phenomenological and epistemological arguments, and points at issues in the design of digital musical instruments that are germane due to their strong aesthetic implications for musical culture