Supporting Device Discovery and Spontaneous Interaction with Spatial References

The RELATE interaction model is designed to support spontaneous interaction of mobile users with devices and services in their environment. The model is based on spatial references that capture the spatial relationship of a user’s device with other co-located devices. Spatial references are obtained by relative position sensing and integrated in the mobile user interface to spatially visualize the arrangement of discovered devices, and to provide direct access for interaction across devices. In this paper we discuss two prototype systems demonstrating the utility of the model in collaborative and mobile settings, and present a study on usability of spatial list and map representations for device selection

Know Thy Toucher

Most of current academic and commercial surface computing systems are capable of multitouch detection and hence allow simultaneous input from multiple users. Although there are so far only few applications in this area which rely on identifying the user, we believe that the association of touches to users will become an essential feature of surface computing as applications mature, new application areas emerge, and the enabling technology is readily available. As the capacitive technology used in present user identification enabled tabletops is limited with respect to the supported number of users and screen size, we outline a user identification enabled tabletop concept based on computer vision and biometric hand shape information, and introduce the prototype system we built to further investigate this concept. In a preliminary consideration, we derive concepts for identifying users by examining what new possibilities are enabled and by introducing different scopes of identification

Evaluating the development of wearable devices, personal data assistants and the use of other mobile devices in further and higher education institutions

This report presents technical evaluation and case studies of the use of wearable and mobile computing mobile devices in further and higher education. The first section provides technical evaluation of the current state of the art in wearable and mobile technologies and reviews several innovative wearable products that have been developed in recent years. The second section examines three scenarios for further and higher education where wearable and mobile devices are currently being used. The three scenarios include: (i) the delivery of lectures over mobile devices, (ii) the augmentation of the physical campus with a virtual and mobile component, and (iii) the use of PDAs and mobile devices in field studies. The first scenario explores the use of web lectures including an evaluation of IBM's Web Lecture Services and 3Com's learning assistant. The second scenario explores models for a campus without walls evaluating the Handsprings to Learning projects at East Carolina University and ActiveCampus at the University of California San Diego . The third scenario explores the use of wearable and mobile devices for field trips examining San Francisco Exploratorium's tool for capturing museum visits and the Cybertracker field computer. The third section of the report explores the uses and purposes for wearable and mobile devices in tertiary education, identifying key trends and issues to be considered when piloting the use of these devices in educational contexts

A User-Focused Reference Model for Wireless Systems Beyond 3G

This whitepaper describes a proposal from Working Group 1, the Human Perspective of the Wireless World, for a user-focused reference model for systems beyond 3G. The general structure of the proposed model involves two "planes": the Value Plane and the Capability Plane. The characteristics of these planes are discussed in detail and an example application of the model to a specific scenario for the wireless world is provided

SenseBelt:a belt-worn sensor to support cross-device interaction

Mobile interaction is shifting from a single device to simultaneous interaction with ensembles of devices such as phones, tablets, or watches. Spatially-aware cross-device interaction between mobile devices typically requires a fixed tracking infrastructure, which lim- its mobility. In this paper, we present SenseBelt – a sensing belt that enhances existing mobile interactions and enables low-cost, ad hoc sensing of cross-device gestures and interactions. SenseBelt enables proxemic interactions between people and their personal devices. SenseBelt also supports cross-device interaction be- tween personal devices and stationary devices, such as public displays. We discuss the design and implementation of SenseBelt together with possible applications. With an initial evaluation, we provide insights into the benefits and drawbacks of a belt-worn mediating sensor to support cross-device interactions

The Case for Public Interventions during a Pandemic

Funding Information: This work has been supported by Marie Skłodowska Curie Actions ITN AffecTech (ERC H2020 Project 1059 ID: 722022). Publisher Copyright: © 2022 by the authors.Within the field of movement sensing and sound interaction research, multi-user systems have gradually gained interest as a means to facilitate an expressive non-verbal dialogue. When tied with studies grounded in psychology and choreographic theory, we consider the qualities of interaction that foster an elevated sense of social connectedness, non-contingent to occupying one’s personal space. Upon reflection of the newly adopted social distancing concept, we orchestrate a technological intervention, starting with interpersonal distance and sound at the core of interaction. Materialised as a set of sensory face-masks, a novel wearable system was developed and tested in the context of a live public performance from which we obtain the user’s individual perspectives and correlate this with patterns identified in the recorded data. We identify and discuss traits of the user’s behaviour that were accredited to the system’s influence and construct four fundamental design considerations for physically distanced sound interaction. The study concludes with essential technical reflections, accompanied by an adaptation for a pervasive sensory intervention that is finally deployed in an open public space.publishersversionpublishe

AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware Armatures

AirConstellations supports a unique semi-fixed style of cross-device interactions via multiple self-spatially-aware armatures to which users can easily attach (or detach) tablets and other devices. In particular, AirConstellations affords highly flexible and dynamic device formations where the users can bring multiple devices together in-air - with 2-5 armatures poseable in 7DoF within the same workspace - to suit the demands of their current task, social situation, app scenario, or mobility needs. This affords an interaction metaphor where relative orientation, proximity, attaching (or detaching) devices, and continuous movement into and out of ad-hoc ensembles can drive context-sensitive interactions. Yet all devices remain self-stable in useful configurations even when released in mid-air. We explore flexible physical arrangement, feedforward of transition options, and layering of devices in-air across a variety of multi-device app scenarios. These include video conferencing with flexible arrangement of the person-space of multiple remote participants around a shared task-space, layered and tiled device formations with overview+detail and shared-to-personal transitions, and flexible composition of UI panels and tool palettes across devices for productivity applications. A preliminary interview study highlights user reactions to AirConstellations, such as for minimally disruptive device formations, easier physical transitions, and balancing "seeing and being seen"in remote work

Towards Interaction Design for Mobile Devices in Collocated Mixed-Focus Collaboration

In collocated collaboration, applied methods and technologies to support the collaboration process mainly comprise either analog paper and pen methods, large display applications or the usage of several laptops. Whereas paper and pen are easy to use, they impair the digital documentation and further editing. Large displays are expensive, stationary, and depend on speci_c environments. Furthermore, laptops build physical barriers between people, which impedes face-to-face communication. This leads to the fact that direct digitization is still not often performed in collocated collaborative scenarios, although it would be useful for further processing or permanent storing of created content.To address advantages of analog media, especially small size and high ubiquity, and eliminate the disadvantages, namely the lack of direct digitization, we aim at applying mobile devices to collocated collaboration. To contribute to the development of future collaboration tools, we derive and propose concrete design goals for applying mobile devices in collocated mixed-focus collaboration