A Noulas

E El Khoury

G Stamou

H Baltzakis

MM Elmansori

O Zoidi

Ioannis Kapsouras

Anastasios Tefas

Nikos Nikolaidis

Ioannis Pitas

Crossref

Multimodal Speaker Diarization Utilizing Face Clustering Information

Multimodal clustering/diarization tries to answer the question ”who spoke when” by using audio and visual information. Diarization consists of two steps, at first segmentation of the audio information and detection of the speech segments and then clustering of the speech segments to group the speakers. This task has been mainly studied on audiovisual data from meetings, news broadcasts or talk shows. In this paper, we use visual information to aid speaker clustering. We tested the proposed method in three full length movies, i.e. a scenario muchmore difficult than the ones used so far, where there is no certainty that speech segments and video appearances of actors will always overlap. The results proved that the visual information can improve the speaker clustering accuracy and hence the diarization process

Kapsouoras, Ioannis

Tefas, Anastasios

Nikolaidis, Nikos

Pitas, Ioannis

Explore Bristol Research

https://research-information.bris.ac.uk/files/75922807/Ioannis_Pitas_Multimodal_speaker_diarization_utilizing_face_clustering_information_2015.pdf

Multimodal Speaker Diarization Utilizing Face Clustering Information

Abstract

Similar works

Full text

Available Versions

Crossref

Explore Bristol Research