Mapping Through Listening

Gesture-to-sound mapping is generally defined as the association between gestural and sound parameters. This article describes an approach that brings forward the perception-action loop as a fundamental design principle for gesture–sound mapping in digital music instrument. Our approach considers the processes of listening as the foundation – and the first step – in the design of action-sound relationships. In this design process, the relationship between action and sound is derived from actions that can be perceived in the sound. Building on previous works on listening modes and gestural descriptions we proposed to distinguish between three mapping strategies: instantaneous, temporal, and metaphoric. Our approach makes use of machine learning techniques for building prototypes, from digital music instruments to interactive installations. Four different examples of scenarios and prototypes are described and discussed

A Statistical Approach to Analyzing Sound Tracings

This paper presents an experiment on sound tracing, meaning an experiment on how people relate motion to sound. 38 participants were presented with 18 short sounds, and instructed to move their hands in the air while acting as though the sound was created by their hand motion. The hand motion of the participants was recorded, and has been analyzed using statistical tests, comparing results between different sounds, between different subjects, and between different sound classes. We have identified several relationships between sound and motion which are present in the majority of the subjects. A clear distinction was found in onset acceleration for motion to sounds with an impulsive dynamic envelope compared to non-impulsive sounds. Furthermore, vertical movement has been shown to be related to sound frequency, both in terms of spectral centroid and pitch. Moreover, a significantly higher amount of overall acceleration was observed for non-pitched sounds as compared to pitched sounds. The original publication is available at www.springerlink.com. Lecture Notes in Computer Science, 2012, Volume 7172/2012, 120-145

DNA Compaction by the Nuclear Factor-Y

The nuclear factor-Y (NF-Y), a trimeric, CCAAT-binding transcriptional activator with histone-like subunits, was until recently considered a prototypical promoter transcription factor. However, recent in vivo chromatin immunoprecipitation assays associated with microarray methodologies (chromatin immunoprecipitation on chip experiments) have indicated that a large portion of target sites (40%–50%) are located outside of core promoters. We applied the tethered particle motion technique to the major histocompatibility complex class II enhancer-promoter region to characterize i), the progressive compaction of DNA due to increasing concentrations of NF-Y, ii), the role of specific subunits and domains of NF-Y in the process, and iii), the interplay between NF-Y and the regulatory factor-X, which cooperatively binds to the X-box adjacent to the CCAAT box. Our study shows that NF-Y has histone-like activity, since it binds DNA nonspecifically with high affinity to compact it. This activity, which depends on the presence of all trimer subunits and of their glutamine-rich domains, seems to be attenuated by the transcriptional cofactor regulatory factor-X. Most importantly NF-Y-induced DNA compaction may facilitate promoter-enhancer interactions, which are known to be critical for expression regulation