Issues and techniques for collaborative music making on multi-touch surfaces

A range of systems exist for collaborative music making on multi-touch surfaces. Some of them have been highly successful, but currently there is no systematic way of designing them, to maximise collaboration for a particular user group. We are particularly interested in systems that will engage novices and experts. We designed a simple application in an initial attempt to clearly analyse some of the issues. Our application allows groups of users to express themselves in collaborative music making using pre-composed materials. User studies were video recorded and analysed using two techniques derived from Grounded Theory and Content Analysis. A questionnaire was also conducted and evaluated. Findings suggest that the application affords engaging interaction. Enhancements for collaborative music making on multi-touch surfaces are discussed. Finally, future work on the prototype is proposed to maximise engagement

Light on horizontal interactive surfaces: Input space for tabletop computing

In the last 25 years we have witnessed the rise and growth of interactive tabletop research, both in academic and in industrial settings. The rising demand for the digital support of human activities motivated the need to bring computational power to table surfaces. In this article, we review the state of the art of tabletop computing, highlighting core aspects that frame the input space of interactive tabletops: (a) developments in hardware technologies that have caused the proliferation of interactive horizontal surfaces and (b) issues related to new classes of interaction modalities (multitouch, tangible, and touchless). A classification is presented that aims to give a detailed view of the current development of this research area and define opportunities and challenges for novel touch- and gesture-based interactions between the human and the surrounding computational environment. © 2014 ACM.This work has been funded by Integra (Amper Sistemas and CDTI, Spanish Ministry of Science and Innovation) and TIPEx (TIN2010-19859-C03-01) projects and Programa de Becas y Ayudas para la Realización de Estudios Oficiales de Máster y Doctorado en la Universidad Carlos III de Madrid, 2010

Virtual Valcamonica: collaborative exploration of prehistoric petroglyphs and their surrounding environment in multi-user virtual reality

In this paper, we present a novel, multi-user, virtual reality environment for the interactive, collaborative 3D analysis of large 3D scans and the technical advancements that were necessary to build it: a multi-view rendering system for large 3D point clouds, a suitable display infrastructure and a suite of collaborative 3D interaction techniques. The cultural heritage site of Valcamonica in Italy with its large collection of prehistoric rock-art served as an exemplary use case for evaluation. The results show that our output-sensitive level-of-detail rendering system is capable of visualizing a 3D dataset with an aggregate size of more than 14 billion points at interactive frame rates. The system design in this exemplar application results from close exchange with a small group of potential users: archaeologists with expertise in rock-art and allows them to explore the prehistoric art and its spatial context with highly realistic appearance. A set of dedicated interaction techniques was developed to facilitate collaborative visual analysis. A multi-display workspace supports the immediate comparison of geographically distributed artifacts. An expert review of the final demonstrator confirmed the potential for added value in rock-art research and the usability of our collaborative interaction techniques

Investigating the Impact of Co-located and Distributed Collaboration Using Multi-touch Tables

With the intention to study the role of new interfaces in multi-user applications, multi-touch tabletops are investigated to examine if they effectively aid their users in working together synchronously. Multi-player games are selected as a case of collaborative work. Early studies of distributed multi-touch tabletops did not cover the HCI related aspects associated with multi-player games, especially in distributed configuration. The performance, collaboration, and usability aspects of HCI are studied in this research. A simple multi-player maze game has been designed and implemented over two connected and physically separated multi-touch tabletops. The aim of this work is to investigate the effects of distribution on players performance, collaboration, and usability of multi-player games over multi-touch tabletops, compared to playing in a co-located condition. Groups of participants have been randomly selected and assigned to play the game in pairs under two conditions: co-located where two players are playing the game on the same table, and distributed where they are playing the game but on separate tables. The collected data is statistically analysed to test for differences between the two conditions, as well as the differences of the strength of the correlation between the underlying factors. The results indicate that, in general, the differences are not significant for such type of applications if a simple and efficient communication mechanism is provided for the players in the distributed condition. Players expressed almost the same level of usability engagement and enjoyment for the two conditions. This may have a strong impact on the HCI aspects when designing such type of applications on the future

Designing for Shareable Interfaces in the Wild

Despite excitement about the potential of interactive tabletops to support collaborative work, there have been few empirical demonstrations of their effectiveness (Marshall et al., 2011). In particular, while lab-based studies have explored the effects of individual design features, there has been a dearth of studies evaluating the success of systems in the wild. For this technology to be of value, designers and systems builders require a better understanding of how to develop and evaluate tabletop applications to be deployed in real world settings. This dissertation reports on two systems designed through a process that incorporated ethnography-style observations, iterative design and in the wild evaluation. The first study focused on collaborative learning in a medical setting. To address the fact that visitors to a hospital emergency ward were leaving with an incomplete understanding of their diagnosis and treatment, a system was prototyped in a working Emergency Room (ER) with doctors and patients. The system was found to be helpful but adoption issues hampered its impact. The second study focused on a planning application for visitors to a tourist information centre. Issues and opportunities for a successful, contextually-fitted system were addressed and it was found to be effective in supporting group planning activities by novice users, in particular, facilitating users’ first experiences, providing effective signage and offering assistance to guide the user through the application. This dissertation contributes to understanding of multi-user systems through literature review of tabletop systems, collaborative tasks, design frameworks and evaluation of prototypes. Some support was found for the claim that tabletops are a useful technology for collaboration, and several issues were discussed. Contributions to understanding in this field are delivered through design guidelines, heuristics, frameworks, and recommendations, in addition to the two case studies to help guide future tabletop system creators

Waves: A Collaborative Navigation Technique for Large Interactive Surfaces

Digital tables offer the possibility of performing collaborative tasks where two or more people can share artifacts in the same virtual space. However, most interactive methods of navigating through virtual space most commonly have the effect of changing the entire digital display simultaneously. In this thesis, I performed an exploratory study providing evidence for differences between two popular collaborative navigation techniques used in video games, split screens and single shared screen, in situational awareness, interference between collaborators, and difficulties with automatic view adjustment. Drawing inspiration from guidelines formulated from the results of the exploratory study, as well as previous work in interactive tabletops, collaboration, and navigation in information visualization, I designed and implemented Waves, a collaborative navigation technique for the tabletop. Waves simultaneously supports multiple personal workspaces, provides group workspace awareness, and mediates interference between workspaces

Designing multi-touch tabletop interaction techniques to support co-located Group Information Management

Co-located group information management (GIM) is a form of groupware with the aim of enabling users to collaboratively find, store, maintain, organise and share personal and/or group information in support of a group activity. Existing systems aimed at partially supporting GIM activities have been implemented on single user devices. These systems make use of asynchronous communication that may hinder collaboration by misinterpretation, information leaks, etc. Few systems exist, with limited functionality, that support co-located GIM. Multi-touch tabletop interaction has given rise to a new approach for supporting Computer Supported Cooperative Work (CSCW). Multi-touch tabletops allow multiple users to naturally interact with a computer device using a shared display and gesture interaction. The tabletop environment also enables users to sit in a natural environment and synchronously communicate without bulky desktops or laptops. Multi-touch tabletops provide the hardware necessary to support co-located GIM. Existing multi-touch interaction techniques were analysed and proved insufficient to support the advanced functional requirements of GIM. The goal of this research was therefore to support co-located GIM by designing new multi-touch tabletop interaction techniques. An architecture was proposed to support co-located GIM with new multi-touch interaction techniques. A software prototype was developed based on the proposed architecture to facilitate the main activities of GIM and to collaboratively compile documents. The prototype was named CollaGIM (Colla – collaborative, GIM – group information management). CollaGIM supports the main activities of GIM using natural gesture interaction on a multi-touch tabletop. An evaluation of the software was conducted by means of a user study where 15 teams of two people participated. High task success rates and user satisfaction results were achieved, which showed that CollaGIM was capable of supporting co-located GIM using the new multi-touch tabletop interaction techniques. CollaGIM also positively supported collaboration between users

Exploring The Impact Of Configuration And Mode Of Input On Group Dynamics In Computing

Objectives: Large displays and new technologies for interacting with computers offer a rich area for the development of new tools to facilitate collaborative concept mapping activities. In this thesis, WiiConcept is described as a tool designed to allow the use of multiple WiiRemotes for the collaborative creation of concept maps, with and without gestures. Subsequent investigation of participants' use of the system considers the effect of single and multiple input streams when using the software with and without gestures and the impact upon group concept mapping process outcomes and interactions when using a large display. Methods: Data is presented from an exploratory study of twenty two students who have used the tool. Half of the pairs used two WiiRemotes, while the remainder used one WiiRemote. All pairs created one map without gestures and one map with gestures. Data about their maps, interactions and responses to the tool were collected. Results: Analysis of coded transcripts indicates that one-controller afforded higher levels of interaction, with the use of gestures also increasing the number of interactions seen. Additionally, the result indicated that there were significantly more interactions of the 'shows solidarity', 'gives orientation', and 'gives opinion' categories (defined by the Bales' interaction processes assessment), when using one-controller as opposed to two. Furthermore, there were more interactions for the 'shows solidarity', 'tension release', 'gives orientation' and 'shows tension' categories when using gestures as opposed to the non-use of gestures. Additionally, there were no significant differences in the perceived dominance of individuals, as measured on the social dominance scales, for the amount of interaction displayed, however, there was a significant main effect of group conversational control score on the 'gives orientation' construct, with a higher number of interactions for low, mixed and high scores of this type when dyads had one-controller as opposed to two-controllers. There was also a significant interaction effect of group conversational control score on the 'shows solidarity' construct with a higher number of interactions for all scores of this type when dyads had one-controller as opposed to two-controllers. The results also indicate that for the WiiConcept there was no difference between number of controllers in the detail in the maps, and that all users found the tool to be useful for the collaborative creation of concept maps. At the same time, engaging in disagreement was related to the amount of nodes created with disagreement leading to more nodes being created. Conclusions: Use of one-controller afforded higher levels of interaction, with gestures also increasing the number of interactions seen. If a particular type of interaction is associated with more nodes, there might also be some argument for only using one-controller with gestures enabled to promote cognitive conflict within groups. All participants responded that the tool was relatively easy to use and engaging, which suggests that this tool could be integrated into collaborative concept mapping activities, allowing for greater collaborative knowledge building and sharing of knowledge, due to the increased levels of interaction for one-controller. As research has shown concept mapping can be useful for promoting the understanding of complex ideas, therefore the adoption of the WiiConcept tool as part of a small group learning activity may lead to deeper levels of understanding. Additionally, the use of gestures suggests that this mode of input does not affect the amount of words, nodes, and edges created in a concept map. Further research, over a longer period of time, may see improvement with this form of interaction, with increased mastery of gestural movement leading to greater detail of conceptual mapping

From Centralized interactive tabletops to Distributed surfaces: the Tangiget concept

International audienceAfter having outlined the uses of new technologies such as smartphones, touch-screen tablets, and laptops, this article presents the TangiSense interactive tabletop, equipped with RFID technology tagged on tangible objects, as a new paradigm of interaction for ambient intelligence. Within its framework, this article aims to distribute surfaces (tables) interacting mainly with tangible objects. Leads for interactive surface distribution such as interactive tables are given. The article proposes to describe some tangible objects, which are the interaction supports; these are called Tangigets. They are defined according to an augmented Presentation-Abstraction-Control structure to take the tangibility element into account. Six categories of Tangigets are also proposed, which are tangible objects, and the supports of distributed collaboration. To validate the Tangiget concept and its use on the TangiSense tabletop, illustrations in centralized and distributed configurations are proposed. A first evaluation is also presented. To conclude, the article presents the directions under consideration for our future research

Bridging Private and Shared Interaction Surfaces in Collocated Groupware

Multi-display environments (such as the pairing of a digital tabletop computer with a set of handheld tablet computers) can support collocated interaction in groups by providing individuals with private workspaces that can be used alongside shared interaction surfaces. However, such a configuration necessitates the inclusion of intuitive and seamless interactions to move digital objects between displays. While existing research has suggested numerous methods to bridge devices in this manner, these methods often require highly specialized equipment and are seldom examined using real-world tasks. This thesis investigates the use of two cross-device object transfer methods as adapted for use with commonly-available hardware and applied for use in a realistic task, a familiar tabletop card game. A digital tabletop and tablet implementation of the tabletop card game Dominion is developed to support each of the two cross-device object transfer methods (as well as two different turn-taking methods to support user identification). An observational user study is then performed to examine the effect of the transfer methods on groups’ behaviour, examining player preferences and the strategies which players applied to pursue their varied goals within the game. The study reveals that players’ choices and use of the methods is shaped greatly by the way in which each player personally defines the Dominion task, not simply by the objectives outlined in its rulebook. Design considerations for the design of cross-device object transfer methods and lessons-learned for system and experimental design as applied to the gaming domain are also offered