Human bodies as interaction materials for somatic, social, and multisensory Virtual Reality experiences

Recently, the field of Human-Computer Interaction has begun to embrace the crucial role of our bodies across our cognitive and social processes. The movement of embodied interaction has been followed by a somatic and material turn that strives to design technology for richer multi-sensory somatic experiences. Despite the booming developments in tangible and wearable technologies, there is strikingly limited research exploring the potential of our own physical and virtual bodies to become the material for the design of interaction, in the same ways that tangible materials are. In this position paper, we propose a series of approaches for designing technology for social interaction, that integrate human bodies as interaction materials to elicit a multisensory embodied experience. We illustrate this approach with examples of several virtual reality experiences that we have designed for supporting social connection

Bringing forth mathematical concepts: signifying sensorimotor enactment in fields of promoted action

Inspired by Enactivist philosophy yet in dialog with it, we ask what theory of embodied cognition might best serve in articulating implications of Enactivism for mathematics education. We offer a blend of Dynamical Systems Theory and Sociocultural Theory as an analytic lens on micro-processes of action-to-concept evolution. We also illustrate the methodological utility of design-research as an approach to such theory development. Building on constructs from ecological psychology, cultural anthropology, studies of motor-skill acquisition, and somatic awareness practices, we develop the notion of an “instrumented field of promoted action”. Children operating in this field first develop environmentally coupled motor-action coordinations. Next, we introduce into the field new artifacts. The children adopt the artifacts as frames of action and reference, yet in so doing they shift into disciplinary semiotic systems. We exemplify our thesis with two selected excerpts from our videography of Grade 4–6 volunteers participating in task-based clinical interviews centered on the Mathematical Imagery Trainer for Proportion. In particular, we present and analyze cases of either smooth or abrupt transformation in learners’ operatory schemes. We situate our design framework vis-à-vis seminal contributions to mathematics education research

Choreographic and Somatic Approaches for the Development of Expressive Robotic Systems

As robotic systems are moved out of factory work cells into human-facing environments questions of choreography become central to their design, placement, and application. With a human viewer or counterpart present, a system will automatically be interpreted within context, style of movement, and form factor by human beings as animate elements of their environment. The interpretation by this human counterpart is critical to the success of the system's integration: knobs on the system need to make sense to a human counterpart; an artificial agent should have a way of notifying a human counterpart of a change in system state, possibly through motion profiles; and the motion of a human counterpart may have important contextual clues for task completion. Thus, professional choreographers, dance practitioners, and movement analysts are critical to research in robotics. They have design methods for movement that align with human audience perception, can identify simplified features of movement for human-robot interaction goals, and have detailed knowledge of the capacity of human movement. This article provides approaches employed by one research lab, specific impacts on technical and artistic projects within, and principles that may guide future such work. The background section reports on choreography, somatic perspectives, improvisation, the Laban/Bartenieff Movement System, and robotics. From this context methods including embodied exercises, writing prompts, and community building activities have been developed to facilitate interdisciplinary research. The results of this work is presented as an overview of a smattering of projects in areas like high-level motion planning, software development for rapid prototyping of movement, artistic output, and user studies that help understand how people interpret movement. Finally, guiding principles for other groups to adopt are posited.Comment: Under review at MDPI Arts Special Issue "The Machine as Artist (for the 21st Century)" http://www.mdpi.com/journal/arts/special_issues/Machine_Artis

BeWith: A Between-Within Method to Discover Relationships between Cancer Modules via Integrated Analysis of Mutual Exclusivity, Co-occurrence and Functional Interactions

The analysis of the mutational landscape of cancer, including mutual exclusivity and co-occurrence of mutations, has been instrumental in studying the disease. We hypothesized that exploring the interplay between co-occurrence, mutual exclusivity, and functional interactions between genes will further improve our understanding of the disease and help to uncover new relations between cancer driving genes and pathways. To this end, we designed a general framework, BeWith, for identifying modules with different combinations of mutation and interaction patterns. We focused on three different settings of the BeWith schema: (i) BeME-WithFun in which the relations between modules are enriched with mutual exclusivity while genes within each module are functionally related; (ii) BeME-WithCo which combines mutual exclusivity between modules with co-occurrence within modules; and (iii) BeCo-WithMEFun which ensures co-occurrence between modules while the within module relations combine mutual exclusivity and functional interactions. We formulated the BeWith framework using Integer Linear Programming (ILP), enabling us to find optimally scoring sets of modules. Our results demonstrate the utility of BeWith in providing novel information about mutational patterns, driver genes, and pathways. In particular, BeME-WithFun helped identify functionally coherent modules that might be relevant for cancer progression. In addition to finding previously well-known drivers, the identified modules pointed to the importance of the interaction between NCOR and NCOA3 in breast cancer. Additionally, an application of the BeME-WithCo setting revealed that gene groups differ with respect to their vulnerability to different mutagenic processes, and helped us to uncover pairs of genes with potentially synergetic effects, including a potential synergy between mutations in TP53 and metastasis related DCC gene

Embodiment and embodied design

Picture this. A preverbal infant straddles the center of a seesaw. She gently tilts her weight back and forth from one side to the other, sensing as each side tips downward and then back up again. This child cannot articulate her observations in simple words, let alone in scientific jargon. Can she learn anything from this experience? If so, what is she learning, and what role might such learning play in her future interactions in the world? Of course, this is a nonverbal bodily experience, and any learning that occurs must be bodily, physical learning. But does this nonverbal bodily experience have anything to do with the sort of learning that takes place in schools - learning verbal and abstract concepts? In this chapter, we argue that the body has everything to do with learning, even learning of abstract concepts. Take mathematics, for example. Mathematical practice is thought to be about producing and manipulating arbitrary symbolic inscriptions that bear abstract, universal truisms untainted by human corporeality. Mathematics is thought to epitomize our species’ collective historical achievement of transcending and, perhaps, escaping the mundane, material condition of having a body governed by haphazard terrestrial circumstance. Surely mathematics is disembodied

The relationship between different email management strategies and the perceived control of time

Time management research, and the psychological construct of perceived control of time, are drawn on to investigate populist claims of the virtues of regularly filing and organising ones electronic mail. Using a process model of time management, it would seem that filing of email may increase ones time control perceptions and thus their job satisfaction and wellbeing. One hundred and sixty five participants were involved in a questionnaire-based field study. Analyses of variance revealed that for some e-mail users, not having a filing system may result in a high perceived control of time. Furthermore, challenging assumptions regarding optimal e-mail organisation, those that tried to frequently file their incoming messages, but did so somewhat unsuccessfully, had significantly less perceived control of time. These results highlight individual differences in control of time perceptions, and recommendations are made regarding organisational e-mail behaviour and training

Emotional Biosensing: Exploring Critical Alternatives

Emotional biosensing is rising in daily life: Data and categories claim to know how people feel and suggest what they should do about it, while CSCW explores new biosensing possibilities. Prevalent approaches to emotional biosensing are too limited, focusing on the individual, optimization, and normative categorization. Conceptual shifts can help explore alternatives: toward materiality, from representation toward performativity, inter-action to intra-action, shifting biopolitics, and shifting affect/desire. We contribute (1) synthesizing wide-ranging conceptual lenses, providing analysis connecting them to emotional biosensing design, (2) analyzing selected design exemplars to apply these lenses to design research, and (3) offering our own recommendations for designers and design researchers. In particular we suggest humility in knowledge claims with emotional biosensing, prioritizing care and affirmation over self- improvement, and exploring alternative desires. We call for critically questioning and generatively re- imagining the role of data in configuring sensing, feeling, ‘the good life,’ and everyday experience