Algorithms for an Automatic Transcription of Live Music Performances into Symbolic Format

This paper addresses the problem of the real-time automatic transcription of a live music performance into a symbolic format. The source data are given by any music instrument or other device able to communicate through a performance protocol. During a performance, music events are parsed and their parameters are evaluated thanks to rhythm and pitch detection algorithms. The final step is the creation of a well-formed XML document, validated against the new international standard known as IEEE 1599. This work will shortly describe both the software environment and the XML format, but the main analysis will involve the real-time recognition of music events. Finally, a case study will be presented: PureMX, a set of Pure Data externals, able to perform the automatic transcription of MIDI events

Linking Sheet Music and Audio - Challenges and New Approaches

Score and audio files are the two most important ways to represent, convey, record, store, and experience music. While score describes a piece of music on an abstract level using symbols such as notes, keys, and measures, audio files allow for reproducing a specific acoustic realization of the piece. Each of these representations reflects different facets of music yielding insights into aspects ranging from structural elements (e.g., motives, themes, musical form) to specific performance aspects (e.g., artistic shaping, sound). Therefore, the simultaneous access to score and audio representations is of great importance. In this paper, we address the problem of automatically generating musically relevant linking structures between the various data sources that are available for a given piece of music. In particular, we discuss the task of sheet music-audio synchronization with the aim to link regions in images of scanned scores to musically corresponding sections in an audio recording of the same piece. Such linking structures form the basis for novel interfaces that allow users to access and explore multimodal sources of music within a single framework. As our main contributions, we give an overview of the state-of-the-art for this kind of synchronization task, we present some novel approaches, and indicate future research directions. In particular, we address problems that arise in the presence of structural differences and discuss challenges when applying optical music recognition to complex orchestral scores. Finally, potential applications of the synchronization results are presented

An XML-based Format for Advanced Music Fruition

(Abstract to follow

Electrical Stimulation Modulates High γ Activity and Human Memory Performance.

Direct electrical stimulation of the brain has emerged as a powerful treatment for multiple neurological diseases, and as a potential technique to enhance human cognition. Despite its application in a range of brain disorders, it remains unclear how stimulation of discrete brain areas affects memory performance and the underlying electrophysiological activities. Here, we investigated the effect of direct electrical stimulation in four brain regions known to support declarative memory: hippocampus (HP), parahippocampal region (PH) neocortex, prefrontal cortex (PF), and lateral temporal cortex (TC). Intracranial EEG recordings with stimulation were collected from 22 patients during performance of verbal memory tasks. We found that high γ (62-118 Hz) activity induced by word presentation was modulated by electrical stimulation. This modulatory effect was greatest for trials with poor memory encoding. The high γ modulation correlated with the behavioral effect of stimulation in a given brain region: it was negative, i.e., the induced high γ activity was decreased, in the regions where stimulation decreased memory performance, and positive in the lateral TC where memory enhancement was observed. Our results suggest that the effect of electrical stimulation on high γ activity induced by word presentation may be a useful biomarker for mapping memory networks and guiding therapeutic brain stimulation