Sensing and mapping for interactive performance

This paper describes a trans-domain mapping (TDM) framework for translating meaningful activities from one creative domain onto another. The multi-disciplinary framework is designed to facilitate an intuitive and non-intrusive interactive multimedia performance interface that offers the users or performers real-time control of multimedia events using their physical movements. It is intended to be a highly dynamic real-time performance tool, sensing and tracking activities and changes, in order to provide interactive multimedia performances. From a straightforward definition of the TDM framework, this paper reports several implementations and multi-disciplinary collaborative projects using the proposed framework, including a motion and colour-sensitive system, a sensor-based system for triggering musical events, and a distributed multimedia server for audio mapping of a real-time face tracker, and discusses different aspects of mapping strategies in their context. Plausible future directions, developments and exploration with the proposed framework, including stage augmenta tion, virtual and augmented reality, which involve sensing and mapping of physical and non-physical changes onto multimedia control events, are discussed

Human operator performance of remotely controlled tasks: Teleoperator research conducted at NASA's George C. Marshal Space Flight Center

The capabilities within the teleoperator laboratories to perform remote and teleoperated investigations for a wide variety of applications are described. Three major teleoperator issues are addressed: the human operator, the remote control and effecting subsystems, and the human/machine system performance results for specific teleoperated tasks

The feet in human--computer interaction: a survey of foot-based interaction

Foot-operated computer interfaces have been studied since the inception of human--computer interaction. Thanks to the miniaturisation and decreasing cost of sensing technology, there is an increasing interest exploring this alternative input modality, but no comprehensive overview of its research landscape. In this survey, we review the literature on interfaces operated by the lower limbs. We investigate the characteristics of users and how they affect the design of such interfaces. Next, we describe and analyse foot-based research prototypes and commercial systems in how they capture input and provide feedback. We then analyse the interactions between users and systems from the perspective of the actions performed in these interactions. Finally, we discuss our findings and use them to identify open questions and directions for future research

Use of an energy harvesting smart floor for indoor localization of people

The development of \u201cintelligent\u201d floors is a growing interest, but often the ensuing solutions involve high production costs as well as complicated installation and management. Aim of this paper is to propose a novel smart floor that makes use of an energy harvesting system in order to allow people localization and to track their movements in an indoor environment. The contribution starts from reviewing the state of the art of smart floor solutions, which are categorized according to the different applications they are addressed to. The system developed in this research is based on capacitive sensors that are mounted on a polymeric support and embedded between a bulk wooden base and floating parquet flooring. The paper outlines the detailed architecture of the proposed apparatus and reports the results of the preliminary test phase. The proposed solution is part of HDOMO, an Ambient Assisted Living (AAL) project aiming at the development of smart solutions for active aging

Interactive Experiences in Public Spaces: A Novel Floor Display System Based on Luminous Modular Units

We describe the design of an interactive concrete floor display for public spaces and discuss its implementation and areas of application. The primary purpose of our system is to provide new forms of collaborative interaction in long-term installations in both indoor and outdoor spaces. Our design is an expandable system of interconnected tiles, which control an array of RGB Light-Emitting Diodes (LEDs) based on user input. The LEDs are built into the tiles and arranged in a manner that simulates pixels on a computer screen, providing a natural visualization mechanism. Each tile acts as an independent node in a network, where motion sensors trigger specific actions and provide interactivity to the surface. A series of applications are illustrated, including promotional advertising and interactive games. The system was installed and evaluated on a university campus for four weeks where hundreds of visitors successfully interacted with the floor

Moveable worlds/digital scenographies

This is the author's accepted manuscript. The final published article is available from the link below. Copyright @ Intellect Ltd 2010.The mixed reality choreographic installation UKIYO explored in this article reflects an interest in scenographic practices that connect physical space to virtual worlds and explore how performers can move between material and immaterial spaces. The spatial design for UKIYO is inspired by Japanese hanamichi and western fashion runways, emphasizing the research production company's commitment to various creative crossovers between movement languages, innovative wearable design for interactive performance, acoustic and electronic sound processing and digital image objects that have a plastic as well as an immaterial/virtual dimension. The work integrates various forms of making art in order to visualize things that are not in themselves visual, or which connect visual and kinaesthetic/tactile/auditory experiences. The ‘Moveable Worlds’ in this essay are also reflections of the narrative spaces, subtexts and auditory relationships in the mutating matrix of an installation-space inviting the audience to move around and follow its sensorial experiences, drawn near to the bodies of the dancers.Brunel University, the British Council, and the Japan Foundation

Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable