Multimodal person recognition for human-vehicle interaction

Next-generation vehicles will undoubtedly feature biometric person recognition as part of an effort to improve the driving experience. Today's technology prevents such systems from operating satisfactorily under adverse conditions. A proposed framework for achieving person recognition successfully combines different biometric modalities, borne out in two case studies

Multisensory legal machines and legal act production

This paper expands on the concept of legal machine which was presented first at IRIS 2011 in Salzburg. The research subjects are (1) the creation of institutional facts by machines, and (2) multimodal communication of legal content to humans. Simple examples are traffic lights and vending machines. Complicated examples are computer-based information systems in organisations, form proceedings workflows, and machines which replace officials in organisations. The actions performed by machines have legal importance and draw legal consequences. Machines similarly as humans can be imposed status-functions of legal actors. The analogy of machines with humans is in the focus of this paper. Legal content can be communicated by machines and can be perceived by all of our senses. The content can be expressed in multimodal languages: textual, visual, acoustic, gestures, aircraft manoeuvres, etc. The concept of encapsulatation of human into machine is proposed. Herein humanintended actions are communicated through the machine’s output channel. Encapsulations can be compared with deities and mythical creatures that can send gods’ messages to people through the human mouth. This paper also aims to identify law production patterns by machines

Multimodal and ubiquitous computing systems: supporting independent-living older users

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident’s home with sensors – these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications

A system design for human factors studies of speech-enabled Web browsing

This paper describes the design of a system which will subsequently be used as the basis of a range of empirical studies aimed at discovering how best to harness speech recognition capabilities in multimodal multimedia computing. Initial work focuses on speech-enabled browsing of the World Wide Web, which was never designed for such use. System design is complete, and is being evaluated via usability testing