Development of an intelligent object for grasp and manipulation research

Kõiva R, Haschke R, Ritter H. Development of an intelligent object for grasp and manipulation research. Presented at the ICAR 2011, Tallinn, Estonia.In this paper we introduce a novel device, called iObject, which is equipped with tactile and motion tracking sensors that allow for the evaluation of human and robot grasping and manipulation actions. Contact location and contact force, object acceleration in space (6D) and orientation relative to the earth (3D magnetometer) are measured and transmitted wirelessly over a Bluetooth connection. By allowing human-human, human-robot and robot-robot comparisons to be made, iObject is a versatile tool for studying manual interaction. To demonstrate the efficiency and flexibility of iObject for the study of bimanual interactions, we report on a physiological experiment and evaluate the main parameters of the considered dual-handed manipulation task

Prefrontal cortex activation upon a demanding virtual hand-controlled task: A new frontier for neuroergonomics

open9noFunctional near-infrared spectroscopy (fNIRS) is a non-invasive vascular-based functional neuroimaging technology that can assess, simultaneously from multiple cortical areas, concentration changes in oxygenated-deoxygenated hemoglobin at the level of the cortical microcirculation blood vessels. fNIRS, with its high degree of ecological validity and its very limited requirement of physical constraints to subjects, could represent a valid tool for monitoring cortical responses in the research field of neuroergonomics. In virtual reality (VR) real situations can be replicated with greater control than those obtainable in the real world. Therefore, VR is the ideal setting where studies about neuroergonomics applications can be performed. The aim of the present study was to investigate, by a 20-channel fNIRS system, the dorsolateral/ventrolateral prefrontal cortex (DLPFC/VLPFC) in subjects while performing a demanding VR hand-controlled task (HCT). Considering the complexity of the HCT, its execution should require the attentional resources allocation and the integration of different executive functions. The HCT simulates the interaction with a real, remotely-driven, system operating in a critical environment. The hand movements were captured by a high spatial and temporal resolution 3-dimensional (3D) hand-sensing device, the LEAP motion controller, a gesture-based control interface that could be used in VR for tele-operated applications. Fifteen University students were asked to guide, with their right hand/forearm, a virtual ball (VB) over a virtual route (VROU) reproducing a 42 m narrow road including some critical points. The subjects tried to travel as long as possible without making VB fall. The distance traveled by the guided VB was 70.2 ± 37.2 m. The less skilled subjects failed several times in guiding the VB over the VROU. Nevertheless, a bilateral VLPFC activation, in response to the HCT execution, was observed in all the subjects. No correlation was found between the distance traveled by the guided VB and the corresponding cortical activation. These results confirm the suitability of fNIRS technology to objectively evaluate cortical hemodynamic changes occurring in VR environments. Future studies could give a contribution to a better understanding of the cognitive mechanisms underlying human performance either in expert or non-expert operators during the simulation of different demanding/fatiguing activities.openCarrieri, Marika; Petracca, Andrea; Lancia, Stefania; Basso Moro, Sara; Brigadoi, Sabrina; Spezialetti, Matteo; Ferrari, Marco; Placidi, Giuseppe; Quaresima, ValentinaCarrieri, Marika; Petracca, Andrea; Lancia, Stefania; BASSO MORO, Sara; Brigadoi, Sabrina; Spezialetti, Matteo; Ferrari, Marco; Placidi, Giuseppe; Quaresima, Valentin

Sensors for Robotic Hands: A Survey of State of the Art

Recent decades have seen significant progress in the field of artificial hands. Most of the surveys, which try to capture the latest developments in this field, focused on actuation and control systems of these devices. In this paper, our goal is to provide a comprehensive survey of the sensors for artificial hands. In order to present the evolution of the field, we cover five year periods starting at the turn of the millennium. At each period, we present the robot hands with a focus on their sensor systems dividing them into categories, such as prosthetics, research devices, and industrial end-effectors.We also cover the sensors developed for robot hand usage in each era. Finally, the period between 2010 and 2015 introduces the reader to the state of the art and also hints to the future directions in the sensor development for artificial hands

Tactile feedback display with spatial and temporal resolutions.

We report the electronic recording of the touch contact and pressure using an active matrix pressure sensor array made of transparent zinc oxide thin-film transistors and tactile feedback display using an array of diaphragm actuators made of an interpenetrating polymer elastomer network. Digital replay, editing and manipulation of the recorded touch events were demonstrated with both spatial and temporal resolutions. Analog reproduction of the force is also shown possible using the polymer actuators, despite of the high driving voltage. The ability to record, store, edit, and replay touch information adds an additional dimension to digital technologies and extends the capabilities of modern information exchange with the potential to revolutionize physical learning, social networking, e-commerce, robotics, gaming, medical and military applications

Use of MMG signals for the control of powered orthotic devices: Development of a rectus femoris measurement protocol

Copyright © 2009 Rehabilitation Engineering and Assistive Technology Society (RESNA). This is an Author's Accepted Manuscript of an article published in Assistive Technology, 21(1), 1 - 12, 2009, copyright Taylor & Francis, available online at: http://www.tandfonline.com/10.1080/10400430902945678.A test protocol is defined for the purpose of measuring rectus femoris mechanomyographic (MMG) signals. The protocol is specified in terms of the following: measurement equipment, signal processing requirements, human postural requirements, test rig, sensor placement, sensor dermal fixation, and test procedure. Preliminary tests of the statistical nature of rectus femoris MMG signals were performed, and Gaussianity was evaluated by means of a two-sided Kolmogorov-Smirnov test. For all 100 MMG data sets obtained from the testing of two volunteers, the null hypothesis of Gaussianity was rejected at the 1%, 5%, and 10% significance levels. Most skewness values were found to be greater than 0.0, while all kurtosis values were found to be greater than 3.0. A statistical convergence analysis also performed on the same 100 MMG data sets suggested that 25 MMG acquisitions should prove sufficient to statistically characterize rectus femoris MMG. This conclusion is supported by the qualitative characteristics of the mean rectus femoris MMG power spectral densities obtained using 25 averages

Mechanical Redesign and Implementation of Intuitive User Input Methods for a Hand Exoskeleton Informed by User Studies on Individuals with Chronic Upper Limb Impairments

Individuals with upper limb motor deficits due to neurological conditions, such as stroke and traumatic brain injury, may exhibit hypertonia and spasticity, which makes it difficult for these individuals to open their hand. The Hand Orthosis with Powered Extension (HOPE) Hand was created in 2018. The performance of the HOPE Hand was evaluated by conducting a Box and Blocks test with an impaired subject. Improvements were identified and the HOPE Hand was mechanically redesigned to increase the functionality in performing grasps. The original motor configuration was reorganized to include active thumb flexion and extension, as well as thumb abduction/adduction. An Electromyography (EMG) study was conducted on 19 individuals (10 healthy, 9 impaired) to evaluate the viability of EMG device control for the specified user group. EMG control, voice control, and manual control were implemented with the HOPE Hand 2.0 and the exoskeleton system was tested for usability during a second Box and Blocks test

Advanced Bionic Attachment Equipment Inspired by the Attachment Performance of Aquatic Organisms: A Review

In nature, aquatic organisms have evolved various attachment systems, and their attachment ability has become a specific and mysterious survival skill for them. Therefore, it is significant to study and use their unique attachment surfaces and outstanding attachment characteristics for reference and develop new attachment equipment with excellent performance. Based on this, in this review, the unique non-smooth surface morphologies of their suction cups are classified and the key roles of these special surface morphologies in the attachment process are introduced in detail. The recent research on the attachment capacity of aquatic suction cups and other related attachment studies are described. Emphatically, the research progress of advanced bionic attachment equipment and technology in recent years, including attachment robots, flexible grasping manipulators, suction cup accessories, micro-suction cup patches, etc., is summarized. Finally, the existing problems and challenges in the field of biomimetic attachment are analyzed, and the focus and direction of biomimetic attachment research in the future are pointed out

Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe