Sync or sink? Interpersonal synchrony impacts self-esteem

Peer reviewedPublisher PD

Virtual Partner Interaction (VPI): Exploring Novel Behaviors via Coordination Dynamics

Inspired by the dynamic clamp of cellular neuroscience, this paper introduces VPI—Virtual Partner Interaction—a coupled dynamical system for studying real time interaction between a human and a machine. In this proof of concept study, human subjects coordinate hand movements with a virtual partner, an avatar of a hand whose movements are driven by a computerized version of the Haken-Kelso-Bunz (HKB) equations that have been shown to govern basic forms of human coordination. As a surrogate system for human social coordination, VPI allows one to examine regions of the parameter space not typically explored during live interactions. A number of novel behaviors never previously observed are uncovered and accounted for. Having its basis in an empirically derived theory of human coordination, VPI offers a principled approach to human-machine interaction and opens up new ways to understand how humans interact with human-like machines including identification of underlying neural mechanisms

Multistability and metastability: understanding dynamic coordination in the brain

Multistable coordination dynamics exists at many levels, from multifunctional neural circuits in vertebrates and invertebrates to large-scale neural circuitry in humans. Moreover, multistability spans (at least) the domains of action and perception, and has been found to place constraints upon, even dictating the nature of, intentional change and the skill-learning process. This paper reviews some of the key evidence for multistability in the aforementioned areas, and illustrates how it has been measured, modelled and theoretically understood. It then suggests how multistability—when combined with essential aspects of coordination dynamics such as instability, transitions and (especially) metastability—provides a platform for understanding coupling and the creative dynamics of complex goal-directed systems, including the brain and the brain–behaviour relation

Interactive inference: a multi-agent model of cooperative joint actions

We advance a novel computational model of multi-agent, cooperative joint actions that is grounded in the cognitive framework of active inference. The model assumes that to solve a joint task, such as pressing together a red or blue button, two (or more) agents engage in a process of interactive inference. Each agent maintains probabilistic beliefs about the goal of the joint task (e.g., should we press the red or blue button?) and updates them by observing the other agent's movements, while in turn selecting movements that make his own intentions legible and easy to infer by the other agent (i.e., sensorimotor communication). Over time, the interactive inference aligns both the beliefs and the behavioral strategies of the agents, hence ensuring the success of the joint action. We exemplify the functioning of the model in two simulations. The first simulation illustrates a ''leaderless'' joint action. It shows that when two agents lack a strong preference about their joint task goal, they jointly infer it by observing each other's movements. In turn, this helps the interactive alignment of their beliefs and behavioral strategies. The second simulation illustrates a "leader-follower" joint action. It shows that when one agent ("leader") knows the true joint goal, it uses sensorimotor communication to help the other agent ("follower") infer it, even if doing this requires selecting a more costly individual plan. These simulations illustrate that interactive inference supports successful multi-agent joint actions and reproduces key cognitive and behavioral dynamics of "leaderless" and "leader-follower" joint actions observed in human-human experiments. In sum, interactive inference provides a cognitively inspired, formal framework to realize cooperative joint actions and consensus in multi-agent systems.Comment: 32 pages, 16 figure

The complexity paradigm for studying human communication: a summary and integration of two fields

There are more things in heaven and earth, Horatio, than are dreamt of in your philosophy. Hamlet (Act 1, Scene 5). This popular quote from Hamlet might be recast for the field of communication as “There are more things in science than are dreamt of in our philosophies”. This article will review several new and strange ideas from complexity science about how the natural world is organized and how we can go about researching it. These strange ideas, (e.g., deterministic, but unpredictable systems) resonate with many communication phenomena that our field has traditionally had difficulty studying. By reviewing these areas, we hope to add a new, compelling and useful way to think about science that goes beyond the current dominant philosophy of science employed in communication. Though the concepts reviewed here are difficult and often appear at odds with the dominant paradigm; they are not. Instead, this approach will facilitate research on problems of communication process and interaction that the dominant paradigm has struggled to study. Specifically, this article explores the question of process research in communication by reviewing three major paradigms of science and then delving more deeply into the most recent: complexity science. The article provides a broad overview of many of the major ideas in complexity science and how these ideas can be used to study many of the most difficult questions in communication science. It concludes with suggestions going forward for incorporating complexity science into communication

The Cultural Science of Consumption: Brains, Networks, and Identities

The paper proposes a general theory of consumer behaviour in ‘social network markets’ – where individual choices are determined by the choices of others – by conceptualising such markets as examples of distributed cognition; itself part of an ‘externalist’ perspective on human identity. The paper goes on to consider the issues raised by this move, by working through the implications of a distinction between the ‘object self’ (or evaluating agency) and the ‘acting self’ (or implementing agency), a distinction that is required to account for apparent failures of choice within an individual. It transpires that ‘dysfunctional’ choices (choices that apparently harm the self) may be evidence of the evolutionary advantage of ‘dual selves,’ allowing for creativity to cope with novelty through open-ended learning. The paper uses this ‘dual selves’ approach to rethink semiotics and the emergence of meaning, building up an argument about the importance of copying, narrative and language in constituting identity though distributed cognition. Finally, the paper proposes that cultural science can reintegrate the study of meaning and cognition in order to analyse consumer behaviour and choice

Visual cues in musical synchronisation

Although music performance is generally thought of as an auditory activity in the Western tradition, the presence of continuous visual information in live music contributes to the cohesiveness of music ensembles, which presents an interesting psychological phenomenon in which audio and visual cues are presumably integrated. In order to investigate how auditory and visual sensory information are combined in the basic process of synchronising movements with music, this thesis focuses on both musicians and nonmusicians as they respond to two sources of visual information common to ensembles: the conductor, and the ancillary movements (movements that do not directly create sound; e.g. body sway or head nods) of co-performers. These visual cues were hypothesized to improve the timing of intentional synchronous action (matching a musical pulse), as well as increasing the synchrony of emergent ancillary movements between participant and stimulus. The visual cues were tested in controlled renderings of ensemble music arrangements, and were derived from real, biological motion. All three experiments employed the same basic synchronisation task: participants drummed along to the pulse of tempo-changing music while observing various visual cues. For each experiment, participants’ drum timing and upper-body movements were recorded as they completed the synchronisation task. The analyses used to quantify drum timing and ancillary movements came from theoretical approaches to movement timing and entrainment: information processing and dynamical systems. Overall, this thesis shows that basic musical timing is a common ability that is facilitated by visual cues in certain contexts, and that emergent ancillary movements and intentional synchronous movements in combination may best explain musical timing and synchronisation