Content Based Retrieval and Navigation of Music

Contents 1 Introduction ................................................... 3 2 Literature Review .............................................. 4 2.1 Navigation ............................................... 4 2.2 Navigation of audio ........................................ 4 2.3 Contentrepresentations ..................................... 5 2.3.1 The musical score ................................... 6 2.3.2 Performance data .................................... 6 2.3.3 Musical pitch contours ................................ 6 2.3.4 Alternative representations ............................ 7 2.3.5 The Fourier transform ................................ 7 2.4 Content based retrieval ..................................... 8 2.4.1 Retrieval of digital audio samples ....................... 8 2.4.2 Query by humming .................................. 8 2.4.3 Lemstrm and Laine ................................. 9 2.4.4 Image matching techni

The Development Of A Sound Viewer For An Open Hypermedia System

While rich support for a wide variety of media such as text, video and image is common among contemporary hypermedia systems, so too is the inadequate support for audio. The primary reason that audio has not attracted as much attention as other media can be attributed to its obvious lack of visual identity. The main focus of this work was to identify a generic and meaningful visual representation of audio within a hypermedia context, and significantly promote hypermedia support for audio through the provision of a sound viewer. This paper describes the inherent difficulties in providing a consistent interface to audio, and discusses in some depth the issues raised during the development process. The sound viewer is then introduced and the associated concepts described. The creation and traversal of links to and from audio are facilitated by the sound viewer across formats including WAV (proprietary digital sound file format from Microsoft), CD (Compact Disc) Audio and MIDI (Musical Instrument Digital Interface). The resultant viewer provides a unified and extensible framework for interacting with audio from within an open hypermedia environment. The open hypermedia system Microcosm was used as the development platform for this work. Microcosm can be augmented to supply a hypermedia link service to additional media with minimal overhead