Light on horizontal interactive surfaces: Input space for tabletop computing

In the last 25 years we have witnessed the rise and growth of interactive tabletop research, both in academic and in industrial settings. The rising demand for the digital support of human activities motivated the need to bring computational power to table surfaces. In this article, we review the state of the art of tabletop computing, highlighting core aspects that frame the input space of interactive tabletops: (a) developments in hardware technologies that have caused the proliferation of interactive horizontal surfaces and (b) issues related to new classes of interaction modalities (multitouch, tangible, and touchless). A classification is presented that aims to give a detailed view of the current development of this research area and define opportunities and challenges for novel touch- and gesture-based interactions between the human and the surrounding computational environment. © 2014 ACM.This work has been funded by Integra (Amper Sistemas and CDTI, Spanish Ministry of Science and Innovation) and TIPEx (TIN2010-19859-C03-01) projects and Programa de Becas y Ayudas para la Realización de Estudios Oficiales de Máster y Doctorado en la Universidad Carlos III de Madrid, 2010

AN EXPLORATORY STUDY IN DISPLAYING INTERACTIVE CAR CATALOGUE SYSTEM ON MULTI TOUCH TABLETOP

This report covers on the implementation of tabletop tablet to display interactive catalogue system in the car industry. This project is a prove of concept indicating that the multi touch techniques are really useful in car industry as the user can direct manipulate sense of touch on viewing the car catalogue. This is proved when car purchasing activity or car road show take place. It focuses on the background on the catalogue whereby less interactive and low in usability discussed. The prime objective of this project is to investigate whether by having tabletop tablet will add and induce usability via user collaboration enabling more than one user to perform moving, resizing, zooming and rotating the car catalogue projected on the tabletop. On the literature section, it had been mention details of the architectural, design and application component. It also findings and readings on the multi gestural techniques, natural user interfaces (NUI) and the multi touch development platform. On the methodology part touches on the timeline and period how the project being carried out. Attached together the Gantt chart and flow chart on the event flow and task schedule. Discussion and result section talks about the development of the project and outcome of it. Description and explanation was included on how the multi-touch application being developed integrated with the entire component. Discussion regarding the system advantages, recommendation for future opportunity and weakness included in second last section. The recommendation described and explained taking into account of the system weakness and further improvement on the further coming years. Last section is the conclusion, discussing on the hope and key aspect achieved throughout the software development and progress

GART: The Gesture and Activity Recognition Toolkit

Presented at the 12th International Conference on Human-Computer Interaction, Beijing, China, July 2007.The original publication is available at www.springerlink.comThe Gesture and Activity Recognition Toolit (GART) is a user interface toolkit designed to enable the development of gesture-based applications. GART provides an abstraction to machine learning algorithms suitable for modeling and recognizing different types of gestures. The toolkit also provides support for the data collection and the training process. In this paper, we present GART and its machine learning abstractions. Furthermore, we detail the components of the toolkit and present two example gesture recognition applications

Cross-Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments

We present a set of interaction techniques for a hybrid user interface that integrates existing 2D and 3D visualization and interaction devices. Our approach is built around one- and two-handed gestures that support the seamless transition of data between co-located 2D and 3D contexts. Our testbed environment combines a 2D multi-user, multi-touch, projection surface with 3D head-tracked, see-through, head-worn displays and 3D tracked gloves to form a multi-display augmented reality. We also address some of the ways in which we can interact with private data in a collaborative, heterogeneous workspace

3DTouch: A wearable 3D input device with an optical sensor and a 9-DOF inertial measurement unit

We present 3DTouch, a novel 3D wearable input device worn on the fingertip for 3D manipulation tasks. 3DTouch is designed to fill the missing gap of a 3D input device that is self-contained, mobile, and universally working across various 3D platforms. This paper presents a low-cost solution to designing and implementing such a device. Our approach relies on relative positioning technique using an optical laser sensor and a 9-DOF inertial measurement unit. 3DTouch is self-contained, and designed to universally work on various 3D platforms. The device employs touch input for the benefits of passive haptic feedback, and movement stability. On the other hand, with touch interaction, 3DTouch is conceptually less fatiguing to use over many hours than 3D spatial input devices. We propose a set of 3D interaction techniques including selection, translation, and rotation using 3DTouch. An evaluation also demonstrates the device's tracking accuracy of 1.10 mm and 2.33 degrees for subtle touch interaction in 3D space. Modular solutions like 3DTouch opens up a whole new design space for interaction techniques to further develop on.Comment: 8 pages, 7 figure

AN EXPLORATORY STUDY IN INTERACTIVE CAR CATALOGUE SYSTEM ON TABLETOP DISPLAY SYSTEM

This report covers on the implementation of tabletop tablet to display interactive catalogue system in the car industry. This project is a prove of concept indicating that the multi touch techniques are really useful in car industry as the user can direct manipulate sense of touch on viewing the car catalogue. This is proved when car purchasing activity or car road show take place. It focuses on the background on the catalogue whereby less interactive and low in usability discussed. The prime objective of this project is to investigate whether by having tabletop tablet will add and induce usability via user collaboration enabling more than one user to perform moving, resizing, zooming and rotating the car catalogue projected on the tabletop. On the literature section, it had been mention details of the architectural, design and application component. It also findings and readings on the multi gestural techniques, natural user interfaces (NUI) and the multi touch development platform. On the methodology part touches on the timeline and period how the project being carried out. Attached together the Gantt chart and flow chart on the event flow and task schedule. Discussion and result section talks about the development of the project and outcome of it. Description and explanation was included on how the multi-touch application being developed integrated with the entire component. Discussion regarding the system advantages, recommendation for future opportunity and weakness included in second last section. The recommendation described and explained taking into account of the system weakness and further improvement on the further coming years. Last section is the conclusion, discussing on the hope and key aspect achieved throughout the software development and progress

Gsi demo: Multiuser gesture/speech interaction over digital tables by wrapping single user applications

Most commercial software applications are designed for a single user using a keyboard/mouse over an upright monitor. Our interest is exploiting these systems so they work over a digital table. Mirroring what people do when working over traditional tables, we want to allow multiple people to interact naturally with the tabletop application and with each other via rich speech and hand gesture and speech interaction on a digital table for geospatial applications- Google Earth, Warcraft III and The Sims. In this paper, we describe our underlying architecture: GSI Demo. First, GSI Demo creates a run-time wrapper around existing single user applications: it accepts and translates speech and gestures from multiple people into a single stream of keyboard and mouse inputs recognized by the application. Second, it lets people use multimodal demonstration- instead of programming- to quickly map their own speech and gestures to these keyboard/mouse inputs. For example, continuous gestures are trained by saying ¨Computer, when I do (one finger gesture), you do (mouse drag) ¨. Similarly, discrete speech commands can be trained by saying ¨Computer, when I say (layer bars), you do (keyboard and mouse macro) ¨. The end result is that end users can rapidly transform single user commercial applications into a multi-user, multimodal digital tabletop system

How do interactive tabletop systems influence collaboration?

This paper examines some aspects of the usefulness of interactive tabletop systems, if and how these impact collaboration. We chose creative problem solving such as brainstorming as an application framework to test several collaborative media: the use of pen-and-paper tools, the ‘‘around-the-table’’ form factor, the digital tabletop interface, the attractiveness of interaction styles. Eighty subjects in total (20 groups of four members) participated in the experiments. The evaluation criteria were task performance, collaboration patterns (especially equity of contributions), and users’ subjective experience. The ‘‘aroundthe-table’’ form factor, which is hypothesized to promote social comparison, increased performance and improved collaboration through an increase of equity. Moreover, the attractiveness of the tabletop device improved subjective experience and increased motivation to engage in the task. However, designing attractiveness seems a highly challenging issue, since overly attractive interfaces may distract users from the task

Multi-touch For General-purpose Computing An Examination Of Text Entry

In recent years, multi-touch has been heralded as a revolution in humancomputer interaction. Multi-touch provides features such as gestural interaction, tangible interfaces, pen-based computing, and interface customization – features embraced by an increasingly tech-savvy public. However, multi-touch platforms have not been adopted as everyday computer interaction devices; that is, multi-touch has not been applied to general-purpose computing. The questions this thesis seeks to address are: Will the general public adopt these systems as their chief interaction paradigm? Can multi-touch provide such a compelling platform that it displaces the desktop mouse and keyboard? Is multi-touch truly the next revolution in human-computer interaction? As a first step toward answering these questions, we observe that generalpurpose computing relies on text input, and ask: Can multi-touch, without a text entry peripheral, provide a platform for efficient text entry? And, by extension, is such a platform viable for general-purpose computing? We investigate these questions through four user studies that collected objective and subjective data for text entry and word processing tasks. The first of these studies establishes a benchmark for text entry performance on a multi-touch platform, across a variety of input modes. The second study attempts to improve this performance by iv examining an alternate input technique. The third and fourth studies include mousestyle interaction for formatting rich-text on a multi-touch platform, in the context of a word processing task. These studies establish a foundation for future efforts in general-purpose computing on a multi-touch platform. Furthermore, this work details deficiencies in tactile feedback with modern multi-touch platforms, and describes an exploration of audible feedback. Finally, the thesis conveys a vision for a general-purpose multi-touch platform, its design and rationale