Multi-cursor multi-user mobile interaction with a large shared display

When using a mobile device to control a cursor on a large shared display, the interaction must be carefully planned to match the environment and purpose of the systems use. We describe a ‘democratic jukebox’ system that revealed five recommendations that should be considered when designing this type of interaction relating to providing feedback to the user; how to represent users in a multi-cursor based system; where people tend to look and their expectation of how to move their cursor; the orientation of screens and the social context; and, the use of simulated users to give the real users a sense that they are engaging with a greater audience

What goes where?: designing interactive large public display applications for mobile device interaction

In this paper we describe our current research in the field of interactive large public displays with mobile device interaction. The core of our research is based on a user interface concept that takes advantage of input and output capabilities of interactive large public displays and mobile devices. We call this concept the "dual display" concept, which allows us to execute multimedia user interfaces across both large and small display types. By shifting parts of a user interface down to a personal mobile device we argue that we can solve a number of problems originating from limitations in large display real estate. As a result of our research we have defined a number of design strategies focusing on the concepts of interactive dual displays. We also report on applying these design strategies to our development of large display applications, which we deployed and tested in lab environments as well as in public settings

Increasing Passersby Engagement with Public Large Interactive Surfaces

Despite the proliferation of Public Large Interactive Surfaces (PLISs), and their potential to provide a more engaging and interactive user experience, these surfaces often go unnoticed by passersby, or not immediately comprehensible in terms of usage. Current research in addressing this problem involves modeling the user-surface interaction through observational studies, and deriving recommendations for interface design to facilitate the interaction. This approach is often context-specific, requires elaborate setup, and lacks experimental control. To mitigate this problem, an interaction model, named DISCOVER, was developed by drawing ideas from classic usability research and focusing on the discoverability aspect of the interaction. This approach allows the model to serve as a lens for understanding and synthesizing existing work on PLISs, and to be used as an evaluation framework to assess effectiveness of potential designs. To accompany this evaluation capability, a laboratory-based evaluation methodology was developed to allow researchers to quickly implement and evaluate potential designs, particularly for the early stages of interaction that precede the more commonly studied explicit and direct interaction (e.g., touches, mid-air gestures). Using the model and the evaluation methodology, a proximity-based interaction mechanism using animated content and shadow visualizations was designed and evaluated as an effective technique in drawing attention from unknowing study participants. A follow-up, more conventional in-the-wild study also verified this finding, and further demonstrated the usefulness of shadow visualizations in drawing attention from passersby, retaining them, and enticing playful interaction. The goal of this thesis is to better equip researchers and practitioners of PLISs with tools that allow them to evaluate and improve existing interfaces, and to provide them with insights into designing future ones employing better and more engaging technologies