A review on humanoid robotics in healthcare

Humanoid robots have evolved over the years and today it is in many different areas of applications, from homecare to social care and healthcare robotics. This paper deals with a brief overview of the current and potential applications of humanoid robotics in healthcare settings. We present a comprehensive contextualization of humanoid robots in healthcare by identifying and characterizing active research activities on humanoid robot that can work interactively and effectively with humans so as to fill some identified gaps in current healthcare deficiency

Optical coherence tomography-based consensus definition for lamellar macular hole.

BackgroundA consensus on an optical coherence tomography definition of lamellar macular hole (LMH) and similar conditions is needed.MethodsThe panel reviewed relevant peer-reviewed literature to reach an accord on LMH definition and to differentiate LMH from other similar conditions.ResultsThe panel reached a consensus on the definition of three clinical entities: LMH, epiretinal membrane (ERM) foveoschisis and macular pseudohole (MPH). LMH definition is based on three mandatory criteria and three optional anatomical features. The three mandatory criteria are the presence of irregular foveal contour, the presence of a foveal cavity with undermined edges and the apparent loss of foveal tissue. Optional anatomical features include the presence of epiretinal proliferation, the presence of a central foveal bump and the disruption of the ellipsoid zone. ERM foveoschisis definition is based on two mandatory criteria: the presence of ERM and the presence of schisis at the level of Henle's fibre layer. Three optional anatomical features can also be present: the presence of microcystoid spaces in the inner nuclear layer (INL), an increase of retinal thickness and the presence of retinal wrinkling. MPH definition is based on three mandatory criteria and two optional anatomical features. Mandatory criteria include the presence of a foveal sparing ERM, the presence of a steepened foveal profile and an increased central retinal thickness. Optional anatomical features are the presence of microcystoid spaces in the INL and a normal retinal thickness.ConclusionsThe use of the proposed definitions may provide uniform language for clinicians and future research

Development and evaluation of hand-held robotic technology for safe and successful peripheral intravenous catheterization on pediatric patients

Peripheral IntraVenous Catheterization (PIVC) is often required in hospitals to fulfil urgent needs of blood sampling or fluid/medication administration. Despite of the importance of a high success rate, the conventional PIVC operation suffers from low insertion accuracy especially on young pediatric patients. On average, each pediatric patient is submitted to 2.1 attempts before venous access is obtained, with around 50% failure for the first attempt. The risks of such multiple attempts can be severe and life-threatening as they can cause serious extravasation injuries. Given the levels of precision and controllability needed for PIVC, robotic systems show a good potential to effectively assist the operation and improve its success rate. Therefore, this study aims to provide such robotic assistance by focusing on the most challenging and error-prone parts of the operation. In order to understand the difficulties of a pediatric PIVC, a survey investigation is conducted with specialists at the beginning of this research. The feedbacks from this survey indicates an urgent need of a hand-held robot to assist in the catheter insertion control to precisely access the target vein. To achieve the above goal, a novel venipuncture detection system based on sensing the electrical impedance of the contacting tissue at the needle tip has been proposed and developed. Then several ex-vivo and in-vivo experiments were conducted to assess this detection system. Experimental results show that this system can be highly effective to detect venipuncture. Subsequently, based on this venipuncture detection system, four different handheld robots have been developed to provide different levels of autonomy and assistance while executing a PIVC insertion: 1. SVEI, short for \u2018Smart Venous Enter Indicator\u2019, is the simplest device without actuation. The user needs to do the whole PIVC operation, and this device only provides an indication of venipuncture by lighting up an LED. 5 2. SAID, short for \u2018Semi-Autonomous Intravenous access Device\u2019, integrates a motor to control the catheter insertion. The user is required to hold the device still and target it to a vein site. He/She then activates the device. The device inserts the catheter automatically and stops it when venipuncture is detected. 3. SDOP, short for \u2018Smart hand-held Device for Over-puncture Prevention\u2019, integrates a latch-based disengage mechanism to prevent over-puncture during PIVC. The user can keep the conventional way of operation and do the insertion manually. At the moment of venipuncture, the device automatically activates the disengage mechanism to stop further advancement of the catheter. 4. CathBot represents \u2018hand-held roBot for peripheral intravenous Catheterization\u2019. The device uses a crank-slider mechanism and a solenoid actuator to convert the complicated intravenous catheterization motion to a simple linear forward motion. The user just needs to push the device\u2019s handle forwards and the device completes the whole PIVC insertion procedure automatically. All the devices were characterized to ensure they can satisfy the design specifications. Then a series of comparative experiments were conducted to assess each of them. In the first experiment, 25 na\uefve subjects were invited to perform 10 trials of PIVC on a realistic baby arm phantom. The subjects were divided into 5 groups, and each group was asked to do the PIVC with one device only (SVEI, SAID, SDOP, CathBot and regular iv catheter). The experimental results show that all devices can provide the needed assistance to significantly facilitate and improve the success rates compared to the conventional method. People who have no experience of PIVC operation before can achieve considerably high success rates in robot-assisted PIVC (86% with SVEI, 80% with SAID, 78% with SDOP and 84% with CathBot) compared to the control group (12%) who used a regular iv catheter. Also, all 5 subjects using SVEI, 3 out of 5 subjects using SAID, 2 out of 5 subjects using SDOP and 4 out of 5 subjects using CathBot were able to successfully catheterize the baby arm phantom on their first attempt, while no subjects in the control group succeeded in their first attempts. Since SVEI showed the best results, it was selected for the second round of evaluation. In the second experiment, clinicians including both PIVC experts and general clinicians were invited to perform PIVC on a realistic baby arm phantom with 3 trials using SVEI and 3 trials in the conventional way. The results demonstrate that SVEI can bring great benefits to both specialists and general clinicians. The average success rates were found to be significantly improved from 48.3% to 71.7% when SVEI was used. The experimental results reveal that all experts achieved better or equal results with SVEI compared to the conventional method, and 9 out of 12 non-experts also had better or equal performance when SVEI was used. Finally, subjective feedback acquired through post-trial questionnaires showed that all devices were highly rated in terms of usability. Overall, the results of this doctoral research support continued investment in the technology to bring the handheld robotic devices closer to clinical us

Deep Learning Guided Autonomous Surgery: Guiding Small Needles into Sub-Millimeter Scale Blood Vessels

We propose a general strategy for autonomous guidance and insertion of a needle into a retinal blood vessel. The main challenges underpinning this task are the accurate placement of the needle-tip on the target vein and a careful needle insertion maneuver to avoid double-puncturing the vein, while dealing with challenging kinematic constraints and depth-estimation uncertainty. Following how surgeons perform this task purely based on visual feedback, we develop a system which relies solely on \emph{monocular} visual cues by combining data-driven kinematic and contact estimation, visual-servoing, and model-based optimal control. By relying on both known kinematic models, as well as deep-learning based perception modules, the system can localize the surgical needle tip and detect needle-tissue interactions and venipuncture events. The outputs from these perception modules are then combined with a motion planning framework that uses visual-servoing and optimal control to cannulate the target vein, while respecting kinematic constraints that consider the safety of the procedure. We demonstrate that we can reliably and consistently perform needle insertion in the domain of retinal surgery, specifically in performing retinal vein cannulation. Using cadaveric pig eyes, we demonstrate that our system can navigate to target veins within 22$\mu m$ XY accuracy and perform the entire procedure in less than 35 seconds on average, and all 24 trials performed on 4 pig eyes were successful. Preliminary comparison study against a human operator show that our system is consistently more accurate and safer, especially during safety-critical needle-tissue interactions. To the best of the authors' knowledge, this work accomplishes a first demonstration of autonomous retinal vein cannulation at a clinically-relevant setting using animal tissues

Does infrared visualization improve selection of venipuncture sites for indwelling needle at the forearm in second-year nursing students?

AbstractObjectivesTo evaluate the effectiveness of a vein visualization display system using near-infrared light (“Vein Display”) for the safe and proper selection of venipuncture sites for indwelling needle placement in the forearm.MethodsTen second year nursing students were recruited to apply an indwelling needle line with and without Vein Display. Another ten participants were recruited from various faculty to serve as patients. The quality of the venipuncture procedure at various selected sites was evaluated according to a scale developed by the authors. Time, scores and patterns of puncture-site selection were compared with respect to three different methods: [1] attempt 1 (tourniquet only), [2] attempt 2 (Vein Display only) and [3] attempt 3 (both). To validate the effectiveness of Vein Display, 52 trials were conducted in total.ResultsWe found that venipuncture site selection time was significantly improved with the Vein Display, particularly in the case of difficult to administer venipuncture sites. Overall, we found no significant difference with respect to venipuncture quality, as determined by our scale.ConclusionThese results suggest that equipment such as the Vein Display can contribute immensely to the improvement of practical skills, such as venipuncture, especially in the context of elderly patients

Autonomous Robotic Screening of Tubular Structures based only on Real-Time Ultrasound Imaging Feedback

Ultrasound (US) imaging is widely employed for diagnosis and staging of peripheral vascular diseases (PVD), mainly due to its high availability and the fact it does not emit radiation. However, high inter-operator variability and a lack of repeatability of US image acquisition hinder the implementation of extensive screening programs. To address this challenge, we propose an end-to-end workflow for automatic robotic US screening of tubular structures using only the real-time US imaging feedback. We first train a U-Net for real-time segmentation of the vascular structure from cross-sectional US images. Then, we represent the detected vascular structure as a 3D point cloud and use it to estimate the longitudinal axis of the target tubular structure and its mean radius by solving a constrained non-linear optimization problem. Iterating the previous processes, the US probe is automatically aligned to the orientation normal to the target tubular tissue and adjusted online to center the tracked tissue based on the spatial calibration. The real-time segmentation result is evaluated both on a phantom and in-vivo on brachial arteries of volunteers. In addition, the whole process is validated both in simulation and physical phantoms. The mean absolute radius error and orientation error ($\pm$ SD) in the simulation are $1.16\pm0.1~mm$ and $2.7\pm3.3^{\circ}$, respectively. On a gel phantom, these errors are $1.95\pm2.02~mm$ and $3.3\pm2.4^{\circ}$. This shows that the method is able to automatically screen tubular tissues with an optimal probe orientation (i.e. normal to the vessel) and at the same to accurately estimate the mean radius, both in real-time.Comment: Accepted for publication in IEEE Transactions on Industrial Electronics Video: https://www.youtube.com/watch?v=VAaNZL0I5i

Force-Sensing-Based Multi-Platform Robotic Assistance for Vitreoretinal Surgery

Vitreoretinal surgery aims to treat disorders of the retina, vitreous body, and macula, such as retinal detachment, diabetic retinopathy, macular hole, epiretinal membrane and retinal vein occlusion. Challenged by several technical and human limitations, vitreoretinal practice currently ranks amongst the most demanding fields in ophthalmic surgery. Of vitreoretinal procedures, membrane peeling is the most common to be performed, over 0.5 million times annually, and among the most prone to complications. It requires an extremely delicate tissue manipulation by various micron scale maneuvers near the retina despite the physiological hand tremor of the operator. In addition, to avoid injuries, the applied forces on the retina need to be kept at a very fine level, which is often well below the tactile sensory threshold of the surgeon. Retinal vein cannulation is another demanding procedure where therapeutic agents are injected into occluded retinal veins. The feasibility of this treatment is limited due to challenges in identifying the moment of venous puncture, achieving cannulation and maintaining it throughout the drug delivery period. Recent advancements in medical robotics have significant potential to address most of the challenges in vitreoretinal practice, and therefore to prevent traumas, lessen complications, minimize intra-operative surgeon effort, maximize surgeon comfort, and promote patient safety. This dissertation presents the development of novel force-sensing tools that can easily be used on various robotic platforms, and robot control methods to produce integrated assistive surgical systems that work in partnership with surgeons against the current limitations in vitreoretinal surgery, specifically focusing on membrane peeling and vein cannulation procedures. Integrating high sensitivity force sensing into the ophthalmic instruments enables precise quantitative monitoring of applied forces. Auditory feedback based upon the measured forces can inform (and warn) the surgeon quickly during the surgery and help prevent injury due to excessive forces. Using these tools on a robotic platform can attenuate hand tremor of the surgeon, which effectively promotes tool manipulation accuracy. In addition, based upon certain force signatures, the robotic system can precisely identify critical instants, such as the venous puncture in retinal vein cannulation, and actively guide the tool towards clinical targets, compensate any involuntary motion of the surgeon, or generate additional motion that will make the surgical task easier. The experimental results using two distinct robotic platforms, the Steady-Hand Eye Robot and Micron, in combination with the force-sensing ophthalmic instruments, show significant performance improvement in artificial dry phantoms and ex vivo biological tissues

Minimally Invasive Expeditionary Surgical Care Using Human-Inspired Robots

This technical report serves as an updated collection of subject matter experts on surgical care using human-inspired robotics for human exploration. It is a summary of the Blue Sky Meeting, organized by the Florida Institute for Human and Machine Cognition (IHMC), Pensacola, Florida, and held on October 2-3, 2018. It contains an executive summary, the final report, all of the presentation materials, and an updated reference list

Research and technology

Significant research and technology activities at the Johnson Space Center (JSC) during Fiscal Year 1990 are reviewed. Research in human factors engineering, the Space Shuttle, the Space Station Freedom, space exploration and related topics are covered