Perceptual Perspective Taking and Action Recognition

Robots that operate in social environments need to be able to recognise and understand the actions of other robots, and humans, in order to facilitate learning through imitation and collaboration. The success of the simulation theory approach to action recognition and imitation relies on the ability to take the perspective of other people, so as to generate simulated actions from their point of view. In this paper, simulation of visual perception is used to re-create the visual egocentric sensory space and egocentric behaviour space of an observed agent, and through this increase the accuracy of action recognition. To demonstrate the approach, experiments are performed with a robot attributing perceptions to and recognising the actions of a second robot

Learning coupled forward-inverse models with combined prediction errors

Challenging tasks in unstructured environments require robots to learn complex models. Given a large amount of information, learning multiple simple models can offer an efficient alternative to a monolithic complex network. Training multiple models—that is, learning their parameters and their responsibilities—has been shown to be prohibitively hard as optimization is prone to local minima. To efficiently learn multiple models for different contexts, we thus develop a new algorithm based on expectation maximization (EM). In contrast to comparable concepts, this algorithm trains multiple modules of paired forward-inverse models by using the prediction errors of both forward and inverse models simultaneously. In particular, we show that our method yields a substantial improvement over only considering the errors of the forward models on tasks where the inverse space contains multiple solution

Motor simulation via coupled internal models using sequential Monte Carlo

We describe a generative Bayesian model for action understanding in which inverse-forward internal model pairs are considered \u27hypotheses\u27 of plausible action goals that are explored in parallel via an approximate inference mechanism based on sequential Monte Carlo methods. The reenactment of internal model pairs can be considered a form of motor simulation, which supports both perceptual prediction and action understanding at the goal level. However, this procedure is generally considered to be computationally inefficient. We present a model that dynamically reallocates computational resources to more accurate internal models depending on both the available prior information and the prediction error of the inverse-forward models, and which leads to successful action recognition. We present experimental results that test the robustness and efficiency of our model in real-world scenarios

Intention Tremor and Deficits of Sensory Feedback Control in Multiple Sclerosis: a Pilot Study

Background Intention tremor and dysmetria are leading causes of upper extremity disability in Multiple Sclerosis (MS). The development of effective therapies to reduce tremor and dysmetria is hampered by insufficient understanding of how the distributed, multi-focal lesions associated with MS impact sensorimotor control in the brain. Here we describe a systems-level approach to characterizing sensorimotor control and use this approach to examine how sensory and motor processes are differentially impacted by MS. Methods Eight subjects with MS and eight age- and gender-matched healthy control subjects performed visually-guided flexion/extension tasks about the elbow to characterize a sensory feedback control model that includes three sensory feedback pathways (one for vision, another for proprioception and a third providing an internal prediction of the sensory consequences of action). The model allows us to characterize impairments in sensory feedback control that contributed to each MS subject’s tremor. Results Models derived from MS subject performance differed from those obtained for control subjects in two ways. First, subjects with MS exhibited markedly increased visual feedback delays, which were uncompensated by internal adaptive mechanisms; stabilization performance in individuals with the longest delays differed most from control subject performance. Second, subjects with MS exhibited misestimates of arm dynamics in a way that was correlated with tremor power. Subject-specific models accurately predicted kinematic performance in a reach and hold task for neurologically-intact control subjects while simulated performance of MS patients had shorter movement intervals and larger endpoint errors than actual subject responses. This difference between simulated and actual performance is consistent with a strategic compensatory trade-off of movement speed for endpoint accuracy. Conclusions Our results suggest that tremor and dysmetria may be caused by limitations in the brain’s ability to adapt sensory feedback mechanisms to compensate for increases in visual information processing time, as well as by errors in compensatory adaptations of internal estimates of arm dynamics