Methods for autonomous wristband placement with a search-and-rescue aerial manipulator

A new robotic system for Search And Rescue (SAR) operations based on the automatic wristband placement on the victims’ arm, which may provide identification, beaconing and remote sensor readings for continuous health monitoring. This paper focuses on the development of the automatic target localization and the device placement using an unmanned aerial manipulator. The automatic wrist detection and localization system uses an RGB-D camera and a convolutional neural network based on the region faster method (Faster R-CNN). A lightweight parallel delta manipulator with a large workspace has been built, and a new design of a wristband in the form of a passive detachable gripper, is presented, which under contact, automatically attaches to the human, while disengages from the manipulator. A new trajectory planning method has been used to minimize the torques caused by the external forces during contact, which cause attitude perturbations. Experiments have been done to evaluate the machine learning method for detection and location, and for the assessment of the performance of the trajectory planning method. The results show how the VGG-16 neural network provides a detection accuracy of 67.99%. Moreover, simulation experiments have been done to show that the new trajectories minimize the perturbations to the aerial platform.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Autonomous Wristband Placement in a Moving Hand for Victims in Search and Rescue Scenarios With a Mobile Manipulator.

In this letter, we present an autonomous method for the placement of a sensorized wristband to victims in a Search-And-Rescue (SAR) scenario. For this purpose, an all-terrain mobile robot includes a mobile manipulator, which End-Effector (EE) is equipped with a detachable sensorized wristband. The wristband consists of two links with a shared shaft and a spring. This configuration allows the wristband to maintain fixed to the EE while moving and get placed around the victim’s forearm once the contact is produced. The method has two differentiated phases: i) The visual moving hand tracking phase, where a 3D vision system detects the victim’s hand pose. At the same time, the robotic manipulator tracks it with a Model Predictive Controller (MPC). ii) The haptic force-controlled phase, where the wristband gets placed around the victim’s forearm controlling the forces exerted. The wristband design is also discussed, considering the magnitude of the force needed for the attachment and the torque the wristband exerts to the forearm. Two experiments are carried out, one in the laboratory to evaluate the performance of the method and the second one in a SAR scenario, with the robotic manipulator integrated with the all-terrain mobile robot. Results show a 97.4% success in the wristband placement procedure and a good performance of the whole system in a large scale disaster exercisePlan Propio de la Universidad de Málaga, y Ministerio de Ciencia, Innovaci ón y Universidades, Gobierno de España, RTI2018-093421-B-I00. Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Intelligent Haptic Perception for Physical Robot Interaction

Doctorado en Ingeniería mecatrónica. Fecha de entrega de la Tesis doctoral: 8 de enero de 2020. Fecha de lectura de Tesis doctoral: 30 de marzo 2020.The dream of having robots living among us is coming true thanks to the recent advances in Artificial Intelligence (AI). The gap that still exists between that dream and reality will be filled by scientific research, but manifold challenges are yet to be addressed. Handling the complexity and uncertainty of real-world scenarios is still the major challenge in robotics nowadays. In this respect, novel AI methods are giving the robots the capability to learn from experience and therefore to cope with real-life situations. Moreover, we live in a physical world in which physical interactions are both vital and natural. Thus, those robots that are being developed to live among humans must perform tasks that require physical interactions. Haptic perception, conceived as the idea of feeling and processing tactile and kinesthetic sensations, is essential for making this physical interaction possible. This research is inspired by the dream of having robots among us, and therefore, addresses the challenge of developing robots with haptic perception capabilities that can operate in real-world scenarios. This PhD thesis tackles the problems related to physical robot interaction by employing machine learning techniques. Three AI solutions are proposed for different physical robot interaction challenges: i) Grasping and manipulation of humans’ limbs; ii) Tactile object recognition; iii) Control of Variable-Stiffness-Link (VSL) manipulators. The ideas behind this research work have potential robotic applications such as search and rescue, healthcare or rehabilitation. This dissertation consists of a compendium of publications comprising as the main body a compilation of previously published scientific articles. The baseline of this research is composed of a total of five papers published in prestigious peer-reviewed scientific journals and international robotics conferences

A survey of single and multi-UAV aerial manipulation

Aerial manipulation has direct application prospects in environment, construction, forestry, agriculture, search, and rescue. It can be used to pick and place objects and hence can be used for transportation of goods. Aerial manipulation can be used to perform operations in environments inaccessible or unsafe for human workers. This paper is a survey of recent research in aerial manipulation. The aerial manipulation research has diverse aspects, which include the designing of aerial manipulation platforms, manipulators, grippers, the control of aerial platform and manipulators, the interaction of aerial manipulator with the environment, through forces and torque. In particular, the review paper presents the survey of the airborne platforms that can be used for aerial manipulation including the new aerial platforms with aerial manipulation capability. We also classified the aerial grippers and aerial manipulators based on their designs and characteristics. The recent contributions regarding the control of the aerial manipulator platform is also discussed. The environment interaction of aerial manipulators is also surveyed which includes, different strategies used for end-effectors interaction with the environment, application of force, application of torque and visual servoing. A recent and growing interest of researchers about the multi-UAV collaborative aerial manipulation was also noticed and hence different strategies for collaborative aerial manipulation are also surveyed, discussed and critically analyzed. Some key challenges regarding outdoor aerial manipulation and energy constraints in aerial manipulation are also discussed