The Bielefeld Speech and Gesture Alignment Corpus (SaGA)

Lücking A, Bergmann K, Hahn F, Kopp S, Rieser H. The Bielefeld Speech and Gesture Alignment Corpus (SaGA). In: Kipp M, Martin J-P, Paggio P, Heylen D, eds. LREC 2010 Workshop: Multimodal Corpora–Advances in Capturing, Coding and Analyzing Multimodality. 2010: 92-98.People communicate multimodally. Most prominently, they co-produce speech and gesture. How do they do that? Studying the interplay of both modalities has to be informed by empirically observed communication behavior. We present a corpus built of speech and gesture data gained in a controlled study. We describe 1) the setting underlying the data; 2) annotation of the data; 3) reliability evalution methods and results; and 4) applications of the corpus in the research domain of speech and gesture alignment

Experiences in Collection and Analysis of Multimodal Data using MINT.tools

Kousidis S, Schlangen D. Experiences in Collection and Analysis of Multimodal Data using MINT.tools. In: Edlund J, Heylen D, Paggio P, eds. Proceedings of the International Workshop Series on Multimodal Corpora, Tools and Resources. 2013