INSPIRE: Evaluation of a Smart-Home System for Infotainment Management and Device Control

This paper gives an overview of the assessment and evaluation methods which have been used to determine the quality of the INSPIRE smart home system. The system allows different home appliances to be controlled via speech, and consists of speech and speaker recognition, speech understanding, dialogue management, and speech output components. The performance of these components is first assessed individually, and then the entire system is evaluated in an interaction experiment with test users. Initial results of the assessment and evaluation are given, in particular with respect to the transmission channel impact on speech and speaker recognition, and the assessment of speech output for different system metaphors.Comment: 4 page

The Wizard of Oz meets multimodal GUI interfaces: new challenges

As part of our work in the Interactive Multimodal Information Management (IM2) project [6], we developed a multimodal dialogue-driven interface for browsing and searching recorded and annotated meeting data in a multimedia database. The challenge lay in creating an interface that was easy to use and which smoothly blended direct manipulation and natural language interaction (both voice and keyboard based)

INSPIRE: Evaluation of a Smart-Home System for Infotainment Management and Device Control

This paper gives an overview of the assessment and evaluation methods which have been used to determine the quality of the INSPIRE smart home system. The system allows different home appliances to be controlled via speech, and consists of speech and speaker recognition, speech understanding, dialogue management, and speech output components. The performance of these components is first assessed individually, and then the entire system is evaluated in an interaction experiment with test users. Initial results of the assessment and evaluation are given, in particular with respect to the transmission channel impact on speech and speaker recognition, and the assessment of speech output for different system metaphors. 1