From Metamodeling to Automatic Generation of Multimodal Interfaces for Ambient Computing

International audiencehis paper presents our approach to design multichannel and multimodal applications as part of ambient intelligence. Computers are increasingly present in our environments, whether at work (computers, photocopiers), at home (video player, hi-fi, microwave), in our cars, etc. They are more adaptable and context-sensitive (e.g., the car radio that lowers the volume when the mobile phone rings). Unfortunately, while they should provide smart services by combining their skills, they are not yet designed to communicate together. Our results, mainly based on the use of a software bus and a workflow, show that different devices (such as Wiimote, multi-touch screen, telephone, etc.) can be coordinated in order to activate real things (such as lamp, fan, robot, webcam, etc.). A smart digital home case study illustrates how using our approach to design with ease some parts of the ambient system and to redesign them during runtime

Model-Driven Development of Interactive Multimedia Applications

The development of highly interactive multimedia applications is still a challenging and complex task. In addition to the application logic, multimedia applications typically provide a sophisticated user interface with integrated media objects. As a consequence, the development process involves different experts for software design, user interface design, and media design. There is still a lack of concepts for a systematic development which integrates these aspects. This thesis provides a model-driven development approach addressing this problem. Therefore it introduces the Multimedia Modeling Language (MML), a visual modeling language supporting a design phase in multimedia application development. The language is oriented on well-established software engineering concepts, like UML 2, and integrates concepts from the areas of multimedia development and model-based user interface development. MML allows the generation of code skeletons from the models. Thereby, the core idea is to generate code skeletons which can be directly processed in multimedia authoring tools. In this way, the strengths of both are combined: Authoring tools are used to perform the creative development tasks while models are used to design the overall application structure and to enable a well-coordinated development process. This is demonstrated using the professional authoring tool Adobe Flash. MML is supported by modeling and code generation tools which have been used to validate the approach over several years in various student projects and teaching courses. Additional prototypes have been developed to demonstrate, e.g., the ability to generate code for different target platforms. Finally, it is discussed how models can contribute in general to a better integration of well-structured software development and creative visual design

Task Models and Diagrams for User Interface Design: 6th International Workshop, TAMODIA 2007, Toulouse, France, November 7-9, 2007Proceedings

International audienceTask analysis and modelling have existed for many years, initially for training purposes but latterly for providing a principled approach to improving the usability of existing and proposed interactive systems. There have been many successes along with critical appraisal of the utility of task analysis. The community remains strong, active and enthusiastic. Over the years we have developed a plethora of theoretical approaches, models and techniques. These differ in terms of what is modelled, the nature of the representations and notations used, their scalability, the ease with which they can be applied with good effect, and the ease with which they can direct the design of systems to support task execution. Task models and associated diagrams that represent task knowledge and behavior are in demand now as much as they ever were. Good design is fundamental, appreciated by users, sells and improves the quality of our daily lives, and good system design means supporting users and their interaction with technology. Technology is changing – we now have mobile and pervasive systems – and yet we still need to analyze the goals and tasks undertaken using these systems. The nature of the tasks might be different (shorter in duration, overlapping, needing to be performed more quickly, be routed in communication and entertainment), but it is still important to understand, model and support user goals