Synergy-based Hand Pose Sensing: Reconstruction Enhancement

Low-cost sensing gloves for reconstruction posture provide measurements which are limited under several regards. They are generated through an imperfectly known model, are subject to noise, and may be less than the number of Degrees of Freedom (DoFs) of the hand. Under these conditions, direct reconstruction of the hand posture is an ill-posed problem, and performance can be very poor. This paper examines the problem of estimating the posture of a human hand using(low-cost) sensing gloves, and how to improve their performance by exploiting the knowledge on how humans most frequently use their hands. To increase the accuracy of pose reconstruction without modifying the glove hardware - hence basically at no extra cost - we propose to collect, organize, and exploit information on the probabilistic distribution of human hand poses in common tasks. We discuss how a database of such an a priori information can be built, represented in a hierarchy of correlation patterns or postural synergies, and fused with glove data in a consistent way, so as to provide a good hand pose reconstruction in spite of insufficient and inaccurate sensing data. Simulations and experiments on a low-cost glove are reported which demonstrate the effectiveness of the proposed techniques.Comment: Submitted to International Journal of Robotics Research (2012

Synergy-Based Hand Pose Sensing: Optimal Glove Design

In this paper we study the problem of improving human hand pose sensing device performance by exploiting the knowledge on how humans most frequently use their hands in grasping tasks. In a companion paper we studied the problem of maximizing the reconstruction accuracy of the hand pose from partial and noisy data provided by any given pose sensing device (a sensorized "glove") taking into account statistical a priori information. In this paper we consider the dual problem of how to design pose sensing devices, i.e. how and where to place sensors on a glove, to get maximum information about the actual hand posture. We study the continuous case, whereas individual sensing elements in the glove measure a linear combination of joint angles, the discrete case, whereas each measure corresponds to a single joint angle, and the most general hybrid case, whereas both continuous and discrete sensing elements are available. The objective is to provide, for given a priori information and fixed number of measurements, the optimal design minimizing in average the reconstruction error. Solutions relying on the geometrical synergy definition as well as gradient flow-based techniques are provided. Simulations of reconstruction performance show the effectiveness of the proposed optimal design.Comment: Submitted to International Journal of Robotics Research 201

From Optimal Synthesis to Optimal Visual Servoing for Autonomous Vehicles

This thesis focuses on the characterization of optimal (shortest) paths to a desired position for a robot with unicycle kinematics and an on-board camera with limited Field-Of-View (FOV), which must keep a given feature in sight. In particular, I provide a complete optimal synthesis for the problem, i.e., a language of optimal control words, and a global partition of the motion plane induced by shortest paths, such that a word in the optimal language is univocally associated to a region and completely describes the shortest path from any starting point in that region to the goal point. Moreover, I provide a generalization to the case of arbitrary FOVs, including the case that the direction of motion is not an axis of symmetry for the FOV, and even that it is not contained in the FOV. Finally, based on the shortest path synthesis available, feedback control laws are defined for any point on the motion plane exploiting geometric properties of the synthesis itself. Moreover, by using a slightly generalized stability analysis setting, which is that of stability on a manifold, a proof of stability is given for the controlled system. At the end, simulation results are reported to demonstrate the effectiveness of the proposed technique

Proactive-Cooperative Navigation in Human-Like Environment for Autonomous Robots

This work deals with the problem of navigating a robot in a constrained human-like environment. We provide a method to generate a control strategy that enables the robot to proactively move in order to induce desired and socially acceptable cooperative behaviors in neighboring pedestrians. Contrary to other control strategies that simply aim to passively avoid neighboring pedestrians, this approach aims to simplify the navigation task of a robot by looking for cooperation with humans, especially in crowded and constrained environments. The co-navigation process between humans and a robot is formalized as a multi-objective optimization problem and a control strategy is obtained through the Model Predictive Control (MPC) approach. The Extended Headed Social Force Model with Collision Prediction (EHSFM with CP) is used to predict the human motion. Different social behaviors of humans when moving in a group are also taken into account. A switching strategy between purely reactive and pro active-cooperative planning depending on the evaluation of human intentions is also furnished. Validation of the proactive-cooperative planner enables the robot to generate more socially and understandable behaviors is done with different navigation scenarios

Optimal Reconstruction of Human Motion From Scarce Multimodal Data

Wearable sensing has emerged as a promising solution for enabling unobtrusive and ergonomic measurements of the human motion. However, the reconstruction performance of these devices strongly depends on the quality and the number of sensors, which are typically limited by wearability and economic constraints. A promising approach to minimize the number of sensors is to exploit dimensionality reduction approaches that fuse prior information with insufficient sensing signals, through minimum variance estimation. These methods were successfully used for static hand pose reconstruction, but their translation to motion reconstruction has not been attempted yet. In this work, we propose the usage of functional principal component analysis to decompose multimodal, time-varying motion profiles in terms of linear combinations of basis functions. Functional decomposition enables the estimation of the a priori covariance matrix, and hence the fusion of scarce and noisy measured data with a priori information. We also consider the problem of identifying which elemental variables to measure as the most informative for a given class of tasks. We applied our method to two different datasets of upper limb motion D1 (joint trajectories) and D2 (joint trajectories + EMG data) considering an optimal set of measures (four joints for D1 out of seven, three joints, and eight EMGs for D2 out of seven and twelve, respectively). We found that our approach enables the reconstruction of upper limb motion with a median error of $0.013 \pm 0.006$ rad for D1 (relative median error 0.9%), and $0.038 \pm 0.023$ rad and $0.003 \pm 0.002$ mV for D2 (relative median error 2.9% and 5.1%, respectively)

Proactive-Cooperative Navigation in Human-Like Environment for Autonomous Robots

International audienceThis work d deals with the problem of navigating a robot in a constrained human-like environment. We provide a method to generate a control strategy that enables the robot to proactively move in order to induce desired and socially acceptable cooperative behaviors in neighboring pedestrians. Contrary to other control strategies that simply aim to passively avoid neighboring pedestrians, this approach aims to simplify the navigation task of a robot by looking for cooperation with humans, especially in crowded and constrained environments. The co-navigation process between humans and a robot is formalized as a multi-objective optimization problem and a control strategy is obtained through the Model Predictive Control (MPC) approach. The Extended Headed Social Force Model with Collision Prediction (EHSFM with CP) is used to predict the human motion. Different social behaviors of humans when moving in a group are also taken into account. A switching strategy between purely reactive and proactive-cooperative planning depending on the evaluation of human intentions is also furnished. Validation of the proactive-cooperative planner enables the robot to generate more socially and understandable behaviors is done with different navigation scenarios

Perception-Aware Human-Assisted Navigation of Mobile Robots on Persistent Trajectories

International audienceWe propose a novel shared control and active perception framework combining the skills of a human operator in accomplishing complex tasks with the capabilities of a mobile robot in autonomously maximizing the information acquired by the onboard sensors for improving its state estimation. The human operator modifies at runtime some suitable properties of a persistent cyclic path followed by the robot so as to achieve the given task (e.g., explore an environment). At the same time, the path is concurrently adjusted by the robot with the aim of maximizing the collected information. This combined behavior enables the human operator to control the high-level task of the robot while the latter autonomously improves its state estimation. The user's commands are included in a task priority framework together with other relevant constraints, while the quality of the acquired information is measured by the Shatten norm of the Constructibility Gramian. The user is also provided with guidance feedback pointing in the direction that would maximize this information metric. We evaluated the proposed approach in two human subject studies, testing the effectiveness of including the Constructibility Gramian into the task priority framework as well as the viability of providing either visual or haptic feedback to convey this information metric

Nonwoven fiber meshes for oxygen sensing

Accurate oxygen sensing and cost-effective fabrication are crucial for the adoption of wearable devices inside and outside the clinical setting. Here we introduce a simple strategy to create nonwoven polymeric fibrous mats for a notable contribution towards addressing this need. Although morphological manipulation of polymers for cell culture proliferation is commonplace, especially in the field of regenerative medicine, non-woven structures have not been used for oxygen sensing. We used an airbrush spraying, i.e. solution blowing, to obtain nonwoven fiber meshes embedded with a phosphorescent dye. The fibers serve as a polymer host for the phosphorescent dye and are shown to be non-cytotoxic. Different composite fibrous meshes were prepared and favorable mechanical and oxygen-sensing properties were demonstrated. A Young's modulus of 9.8 MPa was achieved and the maximum oxygen sensitivity improved by a factor of ∼2.9 compared to simple drop cast film. The fibers were also coated with silicone rubbers to produce mechanically robust sensing films. This reduced the sensing performance but improved flexibility and mechanical properties. Lastly, we are able to capture oxygen concentration maps via colorimetry using a smartphone camera, which should offer unique advantages in wider usage. Overall, the introduced composite fiber meshes show a potential to significantly improve cell cultures and healthcare monitoring via absolute oxygen sensing