Sound and the City: Multi-Layer Representation and Navigation of Audio Scenarios

IEEE 1599-2008 is an XML-based standard originally intended for the multi-layer representation of music information. Nevertheless, it is versatile enough to describe also information different from traditional scores written according to the Common Western Notation (CWN) rules. This paper will discuss the application of IEEE 1599-2008 to the audio description of paths and scenarios from the urban life or other landscapes. The standard we adopt allows the multilayer integration of textual, symbolical, structural, graphical, audio and video contents within a unique synchronized environment. Besides, for each kind of media, a number of digital objects is supported. As a consequence, thanks to the features of the format the produced description will be more than a mere audio track, a slideshow made of sonified static images or a movie. Finally, an ad hoc evolution of a standard viewer for IEEE 1599 documents will be presented, in order to enjoy the results of our efforts

A Web-Oriented Multi-layer Model to Interact with Theatrical Performances

This paper presents an innovative approach to online fruition of theater performances. Web applications like traditional viewers are already available for the wide audience of Internet users. Our proposal aims at adding both interactivity and multi-layer fruition, and a way to manipulate and create new media. The premise to reach these goals is digitizing a number of heterogeneous materials in order to describe a single performance comprehensively, e.g. different video and audio-takes from different perspectives, and a number of related materials such as scripts, fashion plates, playbills, etc. The format we adopt to encode such information is based on the XML international standard known as IEEE 1599. Finally, an advanced Web player supporting search and play functions for synchronized materials must be designed. This work describes the whole process, from the acquisition of materials directly on the stage to their publishing on a Web portal

Managing Multiple Media Streams in HTML5: The IEEE 1599-2008 Case Study

This paper deals with the problem of managing multiple multimedia streams in a Web environment. Multimedia types to support are pure audio, video with no sound, and audio/video. Data streams refer to the same event or performance, consequently they both have and should maintain mutual synchronization. Besides, a Web player should be able to play different multimedia streams simultaneously, as well as to switch from one to another in real time. The clarifying example of a music piece encoded in IEEE 1599 format will be presented as a case study

On the Adoption of Standard Encoding Formats to Ensure Interoperability of Music Digital Archives: The IEEE 1599 Format

With this paper, we want to stimulate the discussion about technologies for inter-operation between various music datasets and collections. Among the many standards for music representation, IEEE 1599 is the only one which was born with the exact purpose of representing the heterogeneous structures of music documents, granting full synchronization of all the different aspects of music (audio recordings, sheet music images, symbolic representations, musicological analysis, etc). We propose the adoption of IEEE 1599 as an interoperability framework between different collections for advanced music experience, musicological applications, and Music Information Retrieval (MIR). In the years to come, the format will undergo a review process aimed at providing an updated/improved version. It is now the perfect time, for all the stakeholders, to come together and discuss how the format can evolve to better support their requirements, enhancing its descriptive strength and available tools. Moreover, this standard can be profitably applied to any field that requires multi-layer and synchronized descriptions

Music-Related Media-Contents Synchronization over theWeb: the IEEE 1599 Initiative

IEEE 1599 is an international standard originally conceived for music, which aims at providing a comprehensive description of the media contents related to a music piece within a multi-layer and synchronized environment. A number of o_- line and stand-alone software prototypes has been realized after its standardization, occurred in 2008. Recently, thanks to some technological advances (e.g. the release of HTML5), the engine of the IEEE 1599 parser has been ported on the Web. Some non-trivial problems have been solved, e.g. the management of multiple simultaneous media streams in a client-server architecture. After providing an overview of the IEEE 1599 standard, this article presents a survey of the recent initiatives regarding audio-driven synchronization over the Web

PureMX: Automatic transcription of MIDI live music performances into XML format

This paper addresses the problem of the real-time automatic transcription of a live music performance into a symbolic format based on XML. The source data are given by any music instrument or other device able to communicate with Pure Data by MIDI. Pure Data is a free, multi-platform, real-time programming environment for graphical, audio, and video processing. During a performance, music events are parsed and their parameters are evaluated thanks to rhythm and pitch detection algorithms. The final step is the creation of a well-formed XML document, validated against the new international standard known as IEEE 1599. This work will shortly describe both the software environment and the XML format, but the main analysis will involve the realtime recognition of music events. Finally, a case study will be presented: PureMX, an application able to perform such an automatic transcription

Algorithms for an Automatic Transcription of Live Music Performances into Symbolic Format

This paper addresses the problem of the real-time automatic transcription of a live music performance into a symbolic format. The source data are given by any music instrument or other device able to communicate through a performance protocol. During a performance, music events are parsed and their parameters are evaluated thanks to rhythm and pitch detection algorithms. The final step is the creation of a well-formed XML document, validated against the new international standard known as IEEE 1599. This work will shortly describe both the software environment and the XML format, but the main analysis will involve the real-time recognition of music events. Finally, a case study will be presented: PureMX, a set of Pure Data externals, able to perform the automatic transcription of MIDI events

Multilayer Music Representation and Processing: Key Advances and Emerging Trends

This work represents the introduction to the proceedings of the 1st International Workshop on Multilayer Music Representation and Processing (MMRP19) authored by the Program Co-Chairs. The idea is to explain the rationale behind such a scientific initiative, describe the methodological approach used in paper selection, and provide a short overview of the workshop's accepted works, trying to highlight the thread that runs through different contributions and approaches

An XML-based Format for Advanced Music Fruition

(Abstract to follow

Development of serious games for music education

Serious games have proved to be an effective educational tool in many fields. The first goal of this paper is to illustrate some possible applications to music and their advantages. Moreover, music can be characterized by heterogeneous multimedia contents. Among the different facets music information is made of it is worth citing music symbols, their graphical representations as scores, their audio renderings as tracks, etc. The international standard known as IEEE 1599 is an XML multilayer format for heterogeneous music contents, and describes such different aspects in an integrated and synchronized context. Making relationships among music contents explicit provides a potentially rich educational environment. Consequently, this paper discusses the concept of multilayer learning object, introduces the IEEE 1599 standard, and finally shows some applications and case studies