When the fingers do the talking: A study of group participation for different kinds of shareable surfaces

and other research outputs When the fingers do the talking: A study of group par-ticipation for different kinds of shareable surface

How do interactive tabletop systems influence collaboration?

This paper examines some aspects of the usefulness of interactive tabletop systems, if and how these impact collaboration. We chose creative problem solving such as brainstorming as an application framework to test several collaborative media: the use of pen-and-paper tools, the ‘‘around-the-table’’ form factor, the digital tabletop interface, the attractiveness of interaction styles. Eighty subjects in total (20 groups of four members) participated in the experiments. The evaluation criteria were task performance, collaboration patterns (especially equity of contributions), and users’ subjective experience. The ‘‘aroundthe-table’’ form factor, which is hypothesized to promote social comparison, increased performance and improved collaboration through an increase of equity. Moreover, the attractiveness of the tabletop device improved subjective experience and increased motivation to engage in the task. However, designing attractiveness seems a highly challenging issue, since overly attractive interfaces may distract users from the task

Designing interaction in digital tabletop games to support collaborative learning in children

Copyright © 2014 Inderscience Enterprises Ltd. According to Dillenbourg et al. (1996), collaborative learning occurs when two or more people try to learn something together. This process consists of four successive stages, one of which concerns collaborative interactions. In this paper we present two studies that implemented two different ways of increasing the number of collaborative interactions. To increase the number of collaborative interactions in a game, the first study focused on degrees of collaboration (Kahn and Mentzer, 1996) and the second study focused on cooperative gestures (Morris et al., 2006a), which were used in the third degree of the first study. In order to facilitate collaborative interactions and its properties (Dillenbourg, 1991), we decided to design two digital tabletop games with tangible interaction that both require collaboration to win. The evaluations in both studies, by means of the Wizard of Oz method, showed a significant increase in collaborative interactions. We also found that verbal and gestural interactions are a better measure criterion for tabletop games than how much people look at each other

RoboTable: An Infrastructure for Intuitive Interaction with Mobile Robots in a Mixed-Reality Environment

This paper presents the design, development, and testing of a tabletop interface called RoboTable, which is an infrastructure supporting intuitive interaction with both mobile robots and virtual components in a mixed-reality environment. With a flexible software toolkit and specifically developed robots, the platform enables various modes of interaction with mobile robots. Using this platform, prototype applications are developed for two different application domains: RoboPong investigates the efficiency of the RoboTable system in game applications, and ExploreRobot explores the possibility of using robots and intuitive interaction to enhance learning

Collocated Collaboration Analytics: Principles and Dilemmas for Mining Multimodal Interaction Data

© 2019, Copyright © 2017 Taylor & Francis Group, LLC. Learning to collaborate effectively requires practice, awareness of group dynamics, and reflection; often it benefits from coaching by an expert facilitator. However, in physical spaces it is not always easy to provide teams with evidence to support collaboration. Emerging technology provides a promising opportunity to make collocated collaboration visible by harnessing data about interactions and then mining and visualizing it. These collocated collaboration analytics can help researchers, designers, and users to understand the complexity of collaboration and to find ways they can support collaboration. This article introduces and motivates a set of principles for mining collocated collaboration data and draws attention to trade-offs that may need to be negotiated en route. We integrate Data Science principles and techniques with the advances in interactive surface devices and sensing technologies. We draw on a 7-year research program that has involved the analysis of six group situations in collocated settings with more than 500 users and a variety of surface technologies, tasks, grouping structures, and domains. The contribution of the article includes the key insights and themes that we have identified and summarized in a set of principles and dilemmas that can inform design of future collocated collaboration analytics innovations

Interaction on the tabletop: Bringing the physical to the digital

Abstract Current tabletop applications, which go beyond mouse-like input, mostly use gestures and/or tangible objects. Gestures are mostly recognized by matching input to a given set of predefined (scripted) gestures, and tangible input is implemented by recognizing shapes or markers. While this allows exactly the interactions foreseen by the programmer, it can be observed in the real world, that physical artefacts are used much more flexibly and often in unforeseen ways. We describe two of our explorations into tabletop interaction styles, discuss their respective strengths and shortcomings, and then derive a new model for tabletop interaction based on a physics simulation and rich multi touch input. Interaction with this model achieves a very high fidelity to the physical world and allows appropriation of the interface, i.e., the development of individual and unforeseen interactions with the system. We have evaluated our model in different variations and believe that it holds a strong promise for future, highly flexible tabletop interfaces

Musical composing on pitch time table based tangible tabletop interface

Master'sMASTER OF ENGINEERIN

Group reaching over digital tabletops with digital arm embodiments

In almost all collaborative tabletop tasks, groups require coordinated access to the shared objects on the table’s surface. The physical social norms of close-proximity interactions built up over years of interacting around other physical bodies cause people to avoid interfering with other people (e.g., avoiding grabbing the same object simultaneously). However, some digital tabletop situations require the use of indirect input (e.g., when using mice, and when supporting remote users). With indirect input, people are no longer physically embodied during their reaching gestures, so most systems provide digital embodiments – visual representations of each person – to provide feedback to both the person who is reaching and to the other group members. Tabletop arm embodiments have been shown to better support group interactions than simple visual designs, providing awareness of actions to the group. However, researchers and digital tabletop designers know little of how the design of digital arm embodiments affects the fundamental group tabletop interaction of reaching for objects. Therefore, in this thesis, we evaluate how people coordinate their interactions over digital tabletops when using different types of embodiments. Specifically, in a series of studies, we investigate how the visual design (what they look like) and interaction design (how they work) of digital arm embodiments affects a group’s coordinative behaviours in an open- ended parallel tabletop task. We evaluated visual factors of size, transparency, and realism (through pictures and videos of physical arms), as well as interaction factors of input and augmentations (feedback of interactions), in both a co-located and distributed environment. We found that the visual design had little effect on a group’s ability to coordinate access to shared tabletop items, that embodiment augmentations are useful to support group coordinative actions, and that there are large differences when the person is not physically co-present. Our results demonstrate an initial exploration into the design of digital arm embodiments, providing design guidelines for future researchers and designers to use when designing the next generation of shared digital spaces

Child–Robot Interaction in Education

Advances in the field of robotics in recent years have enabled the deployment of robots in a multitude of settings, and it is predicted that this will continue to increase, leading to a profound impact on society in the future. This thesis takes its starting point in educational robots; specifically the kind of robots that are designed to interact socially with children. Such robots are often modeled on humans, and made to express and/or perceive emotions, for the purpose of creating some social or emotional attachment in children. This thesis presents a research effort in which an empathic robotic tutor was developed and studied in a school setting, focusing on children’s interactions with the robot over time and across different educational scenarios. With support from the Responsible Research and Innovation Framework, this thesis furthermore sheds light on ethical dilemmas and the social desirability of implementing robots in future classrooms, seen from the eyes of teachers and students. The thesis concludes that children willingly follow instructions from a robotic tutor, and they may also develop a sense of connection with robots, treating them as social actors. However, children’s interactions with robots often break down in unconstrained classroom settings when expectations go unmet, making the potential gain of robots in education questionable. From an ethical perspective, there are many open questions regarding stakeholders’ concerns on matters of privacy, roles andresponsibility, as well as unintended consequences. These issues need to be dealt with when attempting to implement autonomous robots in education on a larger scale

Designing for Shareable Interfaces in the Wild

Despite excitement about the potential of interactive tabletops to support collaborative work, there have been few empirical demonstrations of their effectiveness (Marshall et al., 2011). In particular, while lab-based studies have explored the effects of individual design features, there has been a dearth of studies evaluating the success of systems in the wild. For this technology to be of value, designers and systems builders require a better understanding of how to develop and evaluate tabletop applications to be deployed in real world settings. This dissertation reports on two systems designed through a process that incorporated ethnography-style observations, iterative design and in the wild evaluation. The first study focused on collaborative learning in a medical setting. To address the fact that visitors to a hospital emergency ward were leaving with an incomplete understanding of their diagnosis and treatment, a system was prototyped in a working Emergency Room (ER) with doctors and patients. The system was found to be helpful but adoption issues hampered its impact. The second study focused on a planning application for visitors to a tourist information centre. Issues and opportunities for a successful, contextually-fitted system were addressed and it was found to be effective in supporting group planning activities by novice users, in particular, facilitating users’ first experiences, providing effective signage and offering assistance to guide the user through the application. This dissertation contributes to understanding of multi-user systems through literature review of tabletop systems, collaborative tasks, design frameworks and evaluation of prototypes. Some support was found for the claim that tabletops are a useful technology for collaboration, and several issues were discussed. Contributions to understanding in this field are delivered through design guidelines, heuristics, frameworks, and recommendations, in addition to the two case studies to help guide future tabletop system creators