Learning Latent Space Dynamics for Tactile Servoing

To achieve a dexterous robotic manipulation, we need to endow our robot with tactile feedback capability, i.e. the ability to drive action based on tactile sensing. In this paper, we specifically address the challenge of tactile servoing, i.e. given the current tactile sensing and a target/goal tactile sensing --memorized from a successful task execution in the past-- what is the action that will bring the current tactile sensing to move closer towards the target tactile sensing at the next time step. We develop a data-driven approach to acquire a dynamics model for tactile servoing by learning from demonstration. Moreover, our method represents the tactile sensing information as to lie on a surface --or a 2D manifold-- and perform a manifold learning, making it applicable to any tactile skin geometry. We evaluate our method on a contact point tracking task using a robot equipped with a tactile finger. A video demonstrating our approach can be seen in https://youtu.be/0QK0-Vx7WkIComment: Accepted to be published at the International Conference on Robotics and Automation (ICRA) 2019. The final version for publication at ICRA 2019 is 7 pages (i.e. 6 pages of technical content (including text, figures, tables, acknowledgement, etc.) and 1 page of the Bibliography/References), while this arXiv version is 8 pages (added Appendix and some extra details

Engineering data compendium. Human perception and performance. User's guide

The concept underlying the Engineering Data Compendium was the product of a research and development program (Integrated Perceptual Information for Designers project) aimed at facilitating the application of basic research findings in human performance to the design and military crew systems. The principal objective was to develop a workable strategy for: (1) identifying and distilling information of potential value to system design from the existing research literature, and (2) presenting this technical information in a way that would aid its accessibility, interpretability, and applicability by systems designers. The present four volumes of the Engineering Data Compendium represent the first implementation of this strategy. This is the first volume, the User's Guide, containing a description of the program and instructions for its use

Perception of the Body in Space: Mechanisms

The principal topic is the perception of body orientation and motion in space and the extent to which these perceptual abstraction can be related directly to the knowledge of sensory mechanisms, particularly for the vestibular apparatus. Spatial orientation is firmly based on the underlying sensory mechanisms and their central integration. For some of the simplest situations, like rotation about a vertical axis in darkness, the dynamic response of the semicircular canals furnishes almost enough information to explain the sensations of turning and stopping. For more complex conditions involving multiple sensory systems and possible conflicts among their messages, a mechanistic response requires significant speculative assumptions. The models that exist for multisensory spatial orientation are still largely of the non-rational parameter variety. They are capable of predicting relationships among input motions and output perceptions of motion, but they involve computational functions that do not now and perhaps never will have their counterpart in central nervous system machinery. The challenge continues to be in the iterative process of testing models by experiment, correcting them where necessary, and testing them again

Spatially valid proprioceptive cues improve the detection of a visual stimulus

Vision and proprioception are the main sensory modalities that convey hand location and direction of movement. Fusion of these sensory signals into a single robust percept is now well documented. However, it is not known whether these modalities also interact in the spatial allocation of attention, which has been demonstrated for other modality pairings. The aim of this study was to test whether proprioceptive signals can spatially cue a visual target to improve its detection. Participants were instructed to use a planar manipulandum in a forward reaching action and determine during this movement whether a near-threshold visual target appeared at either of two lateral positions. The target presentation was followed by a masking stimulus, which made its possible location unambiguous, but not its presence. Proprioceptive cues were given by applying a brief lateral force to the participant’s arm, either in the same direction (validly cued) or in the opposite direction (invalidly cued) to the on-screen location of the mask. The d′ detection rate of the target increased when the direction of proprioceptive stimulus was compatible with the location of the visual target compared to when it was incompatible. These results suggest that proprioception influences the allocation of attention in visual spac

Impedance hand controllers for increasing efficiency in teleoperations

An impedance hand controller with direct force feedback is examined as an alternative to bilateral force reflection in teleoperations involving force contact. Experimentation revealed an operator preference for direct force feedback which provided a better feel of contact with the environment. The advantages of variable arm impedance were also made clear in tracking tests where subjects preferred the larger hand controller inertias made possible by the acceleration feedback loop in the master arm. The ability to decouple the hand controller impedance from the slave arm dynamics is expected to be even more significant when the inertial properties of various payloads in the slave arm are considered

Sensing with the Motor Cortex

The primary motor cortex is a critical node in the network of brain regions responsible for voluntary motor behavior. It has been less appreciated, however, that the motor cortex exhibits sensory responses in a variety of modalities including vision and somatosensation. We review current work that emphasizes the heterogeneity in sensorimotor responses in the motor cortex and focus on its implications for cortical control of movement as well as for brain-machine interface development

Towards transparent telepresence

It is proposed that the concept of transparent telepresence can be closely approached through high fidelity technological mediation. It is argued that the matching of the system capabilities to those of the human user will yield a strong sense of immersion and presence at a remote site. Some applications of such a system are noted. The concept is explained and critical system elements are described together with an overview of some of the necessary system specifications

Adaptation to moving tactile stimuli and its effects on perceived speed and direction

Like other senses, tactile perception is subject to adaptation effects in which systematic changes in the pattern of sensory input lead to predictable changes in perception. In this thesis, aftereffects of adaptation to tactile motion are used to reveal the processes that give rise to tactile motion perception from the relevant sensory inputs. The first aftereffect is the tactile speed aftereffect (tSAE), in which the speed of motion appears slower following exposure to a moving surface. Perceived speed of a test surface was reduced by about 30% regardless of the direction of the adapting stimulus, indicating that the tSAE is not direction sensitive. Additionally, higher adapting speeds produced a stronger tSAE, and this dependence on adapting speed could not be attributed to differences in temporal frequency or spatial period that accompanied the different adapting speeds. The second motion aftereffect that was investigated is the dynamic tactile motion aftereffect (tMAE), in which a direction-neutral test stimulus appears to move in the opposite direction to previously felt adapting motion. The strength of the tMAE depended on the speed of the adapting motion, with higher speeds producing a stronger aftereffect. Both the tSAE and the tMAE showed evidence of an intensive speed code in their underlying neural populations, with faster adapting speeds resulting in stronger aftereffects. In neither case was any evidence of speed tuning found, that is, neither aftereffect was strongest with a match between the speeds of the adapting and test stimuli. This is compatible with the response properties of motion sensitive neurons in the primary somatosensory cortex. Despite these shared features, speed and direction are unlikely to be jointly coded in the same neurons because the lack of direction sensitivity of the tSAE requires neural adaptation effects to be uniform across neurons preferring all directions, whereas the tMAE requires direction selective adaptation