Using the beat histogram for speech rhythm description and language identification

In this paper we present a novel approach for the description of speech rhythm and the extraction of rhythm-related features for automatic language identification (LID). Previous methods have extracted speech rhythm through the calculation of features based on salient elements of speech such as consonants, vowels and syllables. We present how an automatic rhythm extraction method borrowed from music information retrieval, the beat histogram, can be adapted for the analysis of speech rhythm by defining the most relevant novelty functions in the speech signal and extracting features describing their periodicities. We have evaluated those features in a rhythm-based LID task for two multilingual speech corpora using support vector machines, including feature selection methods to identify the most informative descriptors. Results suggest that the method is successful in describing speech rhythm and provides LID classification accuracy comparable to or better than that of other approaches, without the need for a preceding segmentation or annotation of the speech signal. Concerning rhythm typology, the rhythm class hypothesis in its original form seems to be only partly confirmed by our results

Talk on Musical Interpretation — Visual Tools for Perceived Dynamics and Points of Gravity

Typical for Western classical music is the process of interpreting and conveying a written score into sounding music. However, sometimes the communication of musical issues between musicians may be experienced as aggravating. In educational contexts in a broad sense, it might be advantageous if this communication could be facilitated, for example, by using visual illustrations as a complement to the verbal language. The final aim of the present PhD project is to introduce a further investigation of the relationship between what musicians do when performing classical compositions and how the music will be experienced by listeners familiar with this kind of music. As an indispensable preparative step for this purpose, based on established conventions of melody phrasing, two special visual tools were developed: the Melody Phrasing Curve and a system for notating metrical points of gravity. In two empirical studies, the relevancy of these visual tools, intended to simplify the communication of matters linked to musical interpretation, was tested. This purpose includes the exploration of musical thoughts coming up when the tools are employed by professional musicians as instruments for illustrating their musical experiences. The Melody Phrasing Curve is a continuous line that is drawn by free hand into a special device indicating approximately the experienced dynamical fluctuations within the melody part of a composition. In the two phases of Study A, this phrasing curve was tested from the perspective of music professors listening to classical piano excerpts recorded on audio tape. The results indicate that the visual tool mentioned might be used as an instrument for illustrating the experienced changing dynamics of the melody part, primarily in piano music of a clear homophonic character. In the consecutive Study B, the other visual tool, the system for notating metrical points of gravity, was introduced. This tool was used by four professional musicians, together with the Melody Phrasing Curve, as an aid when preparing performances of three classical piano excerpts, as well as for the purpose of visually illustrating musical aspects of their recorded performances. The study included in-depth-interviews revealing some of the participants’ musical ideas. The results revealed that the participants respected the traditions of classical music, but they were also interested in further exploring the expressive potential of the music, in order to find new interpretative solutions. Moreover, the results indicate that the visual tools employed might be used in educational contexts as triggers for activating musicians’ self-reflection and for developing a bigger awareness when interpreting classical music. Aside from the participants’ diverging drawing styles, the results further support the functionality of the Melody Phrasing Curve as a visual tool for mirroring the experienced dynamical progression of the melody part. Finally, the phrasing curve may be used for the purpose of planning musical interpretations, as well as for illustrating a given performance

Speech rhythm: the language-specific integration of pitch and duration

Experimental phonetic research on speech rhythm seems to have reached an impasse. Recently, this research field has tended to investigate produced (rather than perceived) rhythm, focussing on timing, i.e. duration as an acoustic cue, and has not considered that rhythm perception might be influenced by native language. Yet evidence from other areas of phonetics, and other disciplines, suggests that an investigation of rhythm is needed which (i) focuses on listeners’ perception, (ii) acknowledges the role of several acoustic cues, and (iii) explores whether the relative significance of these cues differs between languages. This thesis, the originality of which derives from its adoption of these three perspectives combined, indicates new directions for progress. A series of perceptual experiments investigated the interaction of duration and f0 as perceptual cues to prosody in languages with different prosodic structures – Swiss German, Swiss French, and French (i.e. from France). The first experiment demonstrated that a dynamic f0 increases perceived syllable duration in contextually isolated pairs of monosyllables, for all three language groups. The second experiment found that dynamic f0 and increased duration interact as cues to rhythmic groups in series of monosyllabic digits and letters; the two cues were significantly more effective than one when heard simultaneously, but significantly less effective than one when heard in conflicting positions around the rhythmic-group boundary location, and native language influenced whether f0 or duration was the more effective cue. These two experiments laid the basis for the third, which directly addressed rhythm. Listeners were asked to judge the rhythmicality of sentences with systematic duration and f0 manipulations; the results provide evidence that duration and f0 are interdependent cues in rhythm perception, and that the weighting of each cue varies in different languages. A fourth experiment applied the perceptual results to production data, to develop a rhythm metric which captures the multi-dimensional and language-specific nature of perceived rhythm in speech production. These findings have the important implication that if future phonetic research on rhythm follows these new perspectives, it may circumvent the impasse and advance our knowledge and model of speech rhythm.This work was funded by an AHRC doctoral award to the author

Russian Formalism

Russian Formalism, one of the twentieth century's most important movements in literary criticism, has received far less attention than most of its rivals. Examining Formalism in light of more recent developments in literary theory, Peter Steiner here offers the most comprehensive critique of Formalism to date. Steiner studies the work of the Formalists in terms of the major tropes that characterized their thought. He first considers those theorists who viewed a literary work as a mechanism, an organism, or a system. He then turns to those who sought to reduce literature to its most basic element.<p

Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues

This volume brings together the advanced research results obtained by the European COST Action 2102: “Cross Modal Analysis of Verbal and Nonverbal Communication.” The research published in this book was discussed at the Third EUCOGII-COST 2102 International Training School entitled “Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces: Theoretical and Practical Issues,” held in Caserta, Italy, during March 15–19, 2010. The school was jointly sponsored by: a) COST (European Cooperation in Science and Technology, www.cost.eu) in the domain of Information and Communication Technologies (ICT) for disseminating the advances of the research activities developed within the COST Action 2102 (cost2102.cs.stir.ac.uk) b) EUCogII: 2nd European Network for the Advancement of Artificial Cognitive Systems, Interaction and Robotics (http://www.eucognition.org/)

PSYCHOLOGICAL ASPECTS OF DEVELOPMENT OF COORDINATION BETWEEN 6-8 YEARS OLD CHILDREN’S MUSICAL HEARING AND VOCAL APPARATUS

In the present article, the psychological aspects of the development and process of coordination between 6-8 years old children’s musical hearing and vocal apparatus are considered, among which an important role is played by such cognitive processes as music perception, representation of musical hearing, musical thinking, musical memory and self-control. This research aims at studying the psychological aspects of the process of coordination of musical hearing and vocal apparatus between 6-8 years old children