A perception-action strategy for hummingbirds

Many human and animal tasks are thought to be controlled with the tau informational variable. It is widely accepted that controlling the rate of change of tau during decelerative tasks, such as when braking or landing, is one common perceptual control strategy. However, many tasks require accelerating before decelerating to a goal, such as reaching. An advancement of tau theory shows how a single action formula may be used to control the full action unit from initiation to peak velocity, and to rest at the goal, with the same perceptual tau information as before and accounting for the same decelerative kinematics as before. Here, we test the theory against data from high-speed video of a hummingbird flying to its flower feeder. We find that the theory accounts for 97% of the variance in the data, and thus supports it

An athletic approach to studying perception-action integration: Does sport-specific training, and the impact of injury, influence how individuals visually guide navigation?

The objective of this thesis was to investigate perception-action integration capabilities of individuals during a choice navigation task. This task assessed navigation strategies in open space while individuals avoided colliding with two vertical obstacles that created a body-scaled, horizontal gap, at three varying obstacle distances from the starting location (3m, 5m, 7m). The two studies completed in this thesis employed the same paradigm to assess the hypothesized group differences. Gaze behaviours and kinematics of navigation strategies were compared between: 1) athletes specifically trained in navigating in open space versus non-athletes; and 2) athletes with post-concussion syndrome (PCS) versus non-concussed, specifically trained athletes. Specifically trained athletes have been identified as demonstrating more successful perception-action integration in discrete motor tasks related to their sport (Mann et al., 2007; Vickers, 2007). However, whether these abilities translate to the continuous motor task of obstacle avoidance in open space was unknown. The purpose of Study 1 was to identify the influence of sport-specific training on navigating in open space (i.e. navigational strategies of large field sport athletes) compared to age-matched, non-athletes. It was hypothesized that specifically-trained athletes would demonstrate fewer, longer fixations, suggesting a more successful perception-action integration strategy (as defined by Mann et al., 2007), and would employ more sport-specific navigation strategies than non-athletes by maintaining their straight trajectory toward the goal (Fajen & Warren, 2003). Athletes were found to make fewer, longer fixations than non-athletes. However, no differences were observed between navigation strategies of the two groups, nor were any kinematic measures found to differ between groups. It can be concluded that athletes and non-athletes differentially obtain visual information to perform the same actions, suggesting that athletes and non-athletes differentially perform perception-action integration when navigating in open space. Future studies are required to identify sport-specific nuances of navigation (moving obstacles, running) to better identify athletic-related navigation strategies. Although athletic training can enhance perception-action integration strategies, sport-related injuries can hinder this process. Following a concussion, individuals experience deficits of perception-action integration that persist well beyond 30 days of recovery, post-concussion (Baker and Cinelli, 2014; Slobounov et al., 2006). These perception-action integration deficits may also exist in individual with postconcussion syndrome (PCS). The purpose of the Study 2 was to identify whether perception-action integration deficits persist with the persistent physical symptoms of concussion characteristic of PCS. The current study revealed that athletes with PCS did not differ from non-concussed athletes on any measure of visual fixation strategy, nor were they found to differ on any kinematic measure assessed. These findings suggest that in the context of the current paradigm, athletes with PCS have no perception-action integration deficit. In that, athletes with PCS may have adapted perception-action integration strategies to navigate with equal efficiency as a specifically-trained group of athletes or that the paradigm was not sensitive enough to identify these differences. Such findings suggest that more research is required to assess what, if any, perception-action integration deficits persist with persisting physical symptoms of PCS to better benefit rehabilitative procedures and outcomes for these individuals. Together, these studies add to what was previously known about perception-action integration, as it relates to navigation. Both studies assessed perception-action integration in unique populations that add to understanding of behavioural dynamics in the sport setting. Study 1 builds on a line of research assessing affordance theory and behavioural dynamics in sport (Fajen, Riley, & Turvey, 2008). The findings of this study suggest that although navigation strategies did not differ between specifically trained athletes and non-athletes, visual search strategies employed in task did. Such findings add to the understanding that sport-specific training influences perception-action integration, through our understanding of how athletes obtain visual information to perform actions. This thesis did not identify perception-action integration deficits in athletes with PCS. These findings suggest that the individuals in the present study likely adapted to their injury as they demonstrated equal ability in gaze and navigation strategies to specifically-trained athletes. As such, further research is required to assess the cognitive, motor, and sensory-motor deficits that may persist with the persisting physical symptoms of PCS. As individuals with PCS do not demonstrate similar visuomotor integration deficits as individuals with acute concussions (Baker & Cinelli, 2014), such individuals must be assessed and researched as a separate population

Tracking Information Flow through the Environment: Simple Cases of Stigmerg

Recent work in sensor evolution aims at studying the perception-action loop in a formalized information-theoretic manner. By treating sensors as extracting information and actuators as having the capability to "imprint" information on the environment we can view agents as creating, maintaining and making use of various information flows. In our paper we study the perception-action loop of agents using Shannon information flows. We use information theory to track and reveal the important relationships between agents and their environment. For example, we provide an information-theoretic characterization of stigmergy and evolve finite-state automata as agent controllers to engage in stigmergic communication. Our analysis of the evolved automata and the information flow provides insight into how evolution organizes sensoric information acquisition, implicit internal and external memory, processing and action selection

An information-theoretic on-line update principle for perception-action coupling

Inspired by findings of sensorimotor coupling in humans and animals, there has recently been a growing interest in the interaction between action and perception in robotic systems [Bogh et al., 2016]. Here we consider perception and action as two serial information channels with limited information-processing capacity. We follow [Genewein et al., 2015] and formulate a constrained optimization problem that maximizes utility under limited information-processing capacity in the two channels. As a solution we obtain an optimal perceptual channel and an optimal action channel that are coupled such that perceptual information is optimized with respect to downstream processing in the action module. The main novelty of this study is that we propose an online optimization procedure to find bounded-optimal perception and action channels in parameterized serial perception-action systems. In particular, we implement the perceptual channel as a multi-layer neural network and the action channel as a multinomial distribution. We illustrate our method in a NAO robot simulator with a simplified cup lifting task.Comment: 8 pages, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS

Perception, Action, and Depression

Agential pathology (sometimes referred to as impaired agency or motivational pathology) is a phenomenon whereby people suffering from depressive illnesses struggle to initiate and sustain day-to-day action, in the absence of any identifiable organic motor abnormality. In this paper, I argue that all extant attempts to explain agential pathology share the same explanatory weakness; they are unable to account for why the phenomenon is typically accompanied by an experience of diminished practical significance of objects and features of the world (i.e. experiences of objects’ and features’ ‘availability’ for action or ‘invitingness’). After outlining this explanandum, I argue that the two broad classes of theory already proposed to explain agential pathology (which I term mental state theories and somatic theories) fall short of explaining it. I use this explanatory lacuna to motivate a novel theory of agential pathology (which I term the perceptual theory). This posits that those afflicted by agential pathology struggle to act and experience diminished practical significance in the world around them due to an absence of certain action-centric perceptual representations. This both fills the explanatory gap left by mental state and somatic theories, and provides evidence for the explanatory indispensability of a number of controversial kinds of high-level, action-oriented perceptual contents

Intrinsically Motivated Learning of Visual Motion Perception and Smooth Pursuit

We extend the framework of efficient coding, which has been used to model the development of sensory processing in isolation, to model the development of the perception/action cycle. Our extension combines sparse coding and reinforcement learning so that sensory processing and behavior co-develop to optimize a shared intrinsic motivational signal: the fidelity of the neural encoding of the sensory input under resource constraints. Applying this framework to a model system consisting of an active eye behaving in a time varying environment, we find that this generic principle leads to the simultaneous development of both smooth pursuit behavior and model neurons whose properties are similar to those of primary visual cortical neurons selective for different directions of visual motion. We suggest that this general principle may form the basis for a unified and integrated explanation of many perception/action loops.Comment: 6 pages, 5 figure

A commentary on perception-action relationships in spatial display instruments

Transfer of information across disciplines is promoted, while basic and applied researchers are cautioned about the danger of assuming simple relationships between stimulus information, perceptual impressions, and performance including pattern recognition and sensorimotor skills. A theoretical and empirical foundation was developed predicting those relationships

Perception-action relationships reconsidered in light of spatial display instruments

Spatial display instruments convey information about both the identity and the location of objects in order to assist surgeons, astronauts, pilots, blind individuals, and others in identification, remote manipulations, navigation, and obstacle avoidance. Scientists believe that these instruments have not reached their full potential and that progress toward new applications, including the possibility of restoring sight to the blind, will be accelerated by advancing the understanding of perceptual processes. This stimulating challenge to basic researchers was advanced by Paul Bach-Y-Rita (1972) and by the National Academy of Science (1986) report on Electronic Aids for the Blind. Although progress has been made, new applications of spatial display instruments in medicine, space, aviation, and rehabilitation await improved theoretical and empirical foundations