Ilaptic Feedback Device for Needle Insertion

Tele-surgery is one of the emerging fields which combine engineering and medical sciences. Application of tole-surgery can be found in remote communities, war-zones and disasterstricken areas. One of the most complex and tedious issue in tele-surgery is needle insertion. The surgeon relies on haptic feedback during needle insertion. The force exerted on needle during insertion is measured and reproduced at surgeon's end is known as haptic feedback. The realistic force reproduction requires haptic feedback device which should be dynamically identical to needle. The haptic feedback device enables the surgeon to sense the needle insertion remotely. The basic objective of this thesis is to design a device used for needle insertions in soft tissue. The force information from needle insertions is measured by a sensor. The force feedback produced by the device can be used in robot-assisted needle insertion. A device is designed for reality-based data that results in more accurate representation of a needle insertion haptic feedback scenario. The device is modeled dynamically and it is clear from the model that the reactive force is reproduced by the friction forces which is controlled by the motors. The system is sensitive to mass of rollers, mass of the stick and friction between the stick and rollers. The needle insertion force is modeled in three parts; force due to capsule stiffness, friction, and cutting. The force due to capsule stiffness is modeled terms of three components namely diameter of needle, elasticity of tissue and deformation of tissue. The data from model is compared with real time force data. The haptic feedback device input and output forces are compared and the highest correlation factor is 82%. The sensitivity analysis of the device is performed. The capsule stiffness force for 0.9 millimeter diameter needle is 0.98 Newton, the stiffness force for 0.8 millimeter is 0.91 Newton and stiffness force for 0.6 millimeter diameter is 0.41 Newton. The capsule stiffness force for 0.6 millimeter needle is not following the capsule stiffness model. The insertion force data was collected on chicken skin and meat. The device designed in this work is having one degree of freedom; it only produces force feedback for vertical needle insertion. This design is not able to produce the force feedback for angular needle insertion. Graphical User Interface is designed for the visual haptic feedback. The data acquisition is done with the help of a PC sound card. Future work should include the design of a multidegree of freedom haptic feedback device and to advance the GUI for audio feedback that may be extended to accommodate the design of a simulator

Novel Haptic Cueing for UAV Tele-Operation.

The use of Unmanned Aerial Vehicles (UAVs) is continuously increasing both for military and civilian operations. The degree of automation inside an UAV has reached the capability of high levels of autonomy, increasing but human participation/action is still a requirement to ensure an ultimate level of safety for the mission. Direct remote piloting is often required for a board range of situations; this is true especially for larger UAVs, where a fault might be dangerous for the platform but even for the other entities of its environment (people, building etc.). Unfortunately the physical separation between pilot/operator and the UAV reduces greatly the situational awareness; this has a negative impact on system performance in the presence of remote and unforeseen environmental constraints and disturbances. This is why this thesis is dedicated to the study of means to increase the level of situational awareness of the UAV operator. The sense of telepresence is very important in teleoperation, and it appears reasonable, and it has already been shown in the literature, that extending the visual feedback with force feedback is able to complement the visual information (when missing or limited). An artificially recreated sense of touch (haptic) may allow the operator to better perceive information from the remote aircraft state, the environment and its constraints, hopefully preventing dangerous situations. This thesis introdues first a novel classification for haptic aid systems in two large classes: Direct Haptic Aid (DHA) and Indirect Haptic Aid (IHA), then, after showing that almost all existing aid concepts belong to the first class, focuses on IHA and tries to show that classical applications (that used a DHA approach) can be revised in a IHA fashion. The novel IHA systems produce different sensations, which in most cases may appear as exactly "opposite in sign" from the corresponding DHA; these sensations can provide valuable cues for the pilot, both in terms of improvement of performance and "level of appreciation". Furthermore, it will be shown that the novel cueing algorithms, which were designed just to appear "natural" to the operator, and not to directly help the pilot in his task (as in the DHA cases), can outperform the corresponding DHA systems. Three case studies were selected: obstacle avoidance, wind gust rejection, and a combination of the two. For all the cases, DHA and IHA systems were designed and compared against baseline performance with no haptic aid. Test results show that a net improvement in terms of performance is provided by employing the IHA cuse instead of both the DHA cues or the visual cues only. Both professional pilots and naïve subjects were used in some of the experiments. The perceived feelings transmitted by the haptic cues, strongly depend by the type of the experiment and the quality of the participants: the professional pilots, for instance, retained the DHA the most helpful force while they preferred IHA because they found it more natural and because they felt a better control authority on the aircraft; different results were obtained with naive participants. In the end, this thesis aim is to show that the IHA philosophy is a valid and promising alternative to the other commonly used, and published in the scientific literature, approaches which fall in the DHA category. Finally the haptic cueing for the obstacle avoidance task was tested in the presence of time delay in the communication link, as in a classical bilateral teleoperation scheme. The Master was provide with an admittance controller and an observer for force exerted by the human on the stick was developed. Experiments have shown that the proposed system is capable of standing substantial communication delays

Aerial Tele-Manipulation with Passive Tool via Parallel Position/Force Control

This paper addresses the problem of unilateral contact interaction by an under-actuated quadrotor UAV equipped with a passive tool in a bilateral teleoperation scheme. To solve the challenging control problem of force regulation in contact interaction while maintaining flight stability and keeping the contact, we use a parallel position/force control method, commensurate to the system dynamics and constraints in which using the compliant structure of the end-effector the rotational degrees of freedom are also utilized to attain a broader range of feasible forces. In a bilateral teleoperation framework, the proposed control method regulates the aerial manipulator position in free flight and the applied force in contact interaction. On the master side, the human operator is provided with force haptic feedback to enhance his/her situational awareness. The validity of the theory and efficacy of the solution are shown by experimental results. This control architecture, integrated with a suitable perception/localization pipeline, could be used to perform outdoor aerial teleoperation tasks in hazardous and/or remote sites of interest

The use of modern tools for modelling and simulation of UAV with Haptic

Unmanned Aerial Vehicle (UAV) is a research field in robotics which is in high demand in recent years, although there still exist many unanswered questions. In contrast, to the human operated aerial vehicles, it is still far less used to the fact that people are dubious about flying in or flying an unmanned vehicle. It is all about giving the control right to the computer (which is the Artificial Intelligence) for making decisions based on the situation like human do but this has not been easy to make people understand that it’s safe and to continue the enhancement on it. These days there are many types of UAVs available in the market for consumer use, for applications like photography to play games, to map routes, to monitor buildings, for security purposes and much more. Plus, these UAVs are also being widely used by the military for surveillance and for security reasons. One of the most commonly used consumer product is a quadcopter or quadrotor. The research carried out used modern tools (i.e., SolidWorks, Java Net Beans and MATLAB/Simulink) to model controls system for Quadcopter UAV with haptic control system to control the quadcopter in a virtual simulation environment and in real time environment. A mathematical model for the controlling the quadcopter in simulations and real time environments were introduced. Where, the design methodology for the quadcopter was defined. This methodology was then enhanced to develop a virtual simulation and real time environments for simulations and experiments. Furthermore, the haptic control was then implemented with designed control system to control the quadcopter in virtual simulation and real time experiments. By using the mathematical model of quadcopter, PID & PD control techniques were used to model the control setup for the quadcopter altitude and motion controls as work progressed. Firstly, the dynamic model is developed using a simple set of equations which evolves further by using complex control & mathematical model with precise function of actuators and aerodynamic coefficients Figure5-7. The presented results are satisfying and shows that flight experiments and simulations of the quadcopter control using haptics is a novel area of research which helps perform operations more successfully and give more control to the operator when operating in difficult environments. By using haptic accidents can be minimised and the functional performance of the operator and the UAV will be significantly enhanced. This concept and area of research of haptic control can be further developed accordingly to the needs of specific applications

The use of modern tools for modelling and simulation of UAV with Haptic

Unmanned Aerial Vehicle (UAV) is a research field in robotics which is in high demand in recent years, although there still exist many unanswered questions. In contrast, to the human operated aerial vehicles, it is still far less used to the fact that people are dubious about flying in or flying an unmanned vehicle. It is all about giving the control right to the computer (which is the Artificial Intelligence) for making decisions based on the situation like human do but this has not been easy to make people understand that it’s safe and to continue the enhancement on it. These days there are many types of UAVs available in the market for consumer use, for applications like photography to play games, to map routes, to monitor buildings, for security purposes and much more. Plus, these UAVs are also being widely used by the military for surveillance and for security reasons. One of the most commonly used consumer product is a quadcopter or quadrotor. The research carried out used modern tools (i.e., SolidWorks, Java Net Beans and MATLAB/Simulink) to model controls system for Quadcopter UAV with haptic control system to control the quadcopter in a virtual simulation environment and in real time environment. A mathematical model for the controlling the quadcopter in simulations and real time environments were introduced. Where, the design methodology for the quadcopter was defined. This methodology was then enhanced to develop a virtual simulation and real time environments for simulations and experiments. Furthermore, the haptic control was then implemented with designed control system to control the quadcopter in virtual simulation and real time experiments. By using the mathematical model of quadcopter, PID & PD control techniques were used to model the control setup for the quadcopter altitude and motion controls as work progressed. Firstly, the dynamic model is developed using a simple set of equations which evolves further by using complex control & mathematical model with precise function of actuators and aerodynamic coefficients Figure5-7. The presented results are satisfying and shows that flight experiments and simulations of the quadcopter control using haptics is a novel area of research which helps perform operations more successfully and give more control to the operator when operating in difficult environments. By using haptic accidents can be minimised and the functional performance of the operator and the UAV will be significantly enhanced. This concept and area of research of haptic control can be further developed accordingly to the needs of specific applications

Distributed Real-Time Hardware- and Man-in-the-loop Simulation for the ICARO II Unmanned Systems Autopilot

The autopilot market for small and research UAVs offers several products, but most of them, although widely configurable or even open-source, do not constitute a practical and safe development system for custom guidance, navigation and control systems. The ICARO project aims at providing the small UAV community with a valid autopilot alternative. The ICARO autopilot exploits rapid control system prototyping techniques and immersive manned simulation with the possibility of testing the autopilot using the Hardware- In-the-Loop (HIL) approach. This paper describes the hardware-in-the-loop and man-in-the-loop simulator for the ICARO II platform together with the synchronization protocol we developed to keep simulator and autopilot synchronized. Experimental evidence of the effectiveness of the synchronization protocol is given

Haptic Feedback Effects on Human Control of a UAV in a Remote Teleoperation Flight Task

The remote manual teleoperation of an unmanned aerial vehicle (UAV) by a human operator creates a human-in-the loop system that is of great concern. In a remote teleoperation task, a human pilot must make control decisions based upon sensory information provided by the governed system. Often, this information consists of limited visual feedback provided by onboard cameras that do not provide an operator with an accurate portrayal of their immediate surroundings compromising the safety of the mobile robot. Due to this shortfall, haptic force feedback is often provided to the human in an effort to increase their perceptual awareness of the surrounding world. To investigate the effects of this additional sensory information provided to the human op-erator, we consider two haptic force feedback strategies. They were designed to provide either an attractive force to influence control behavior towards a reference trajectory along a flight path, or a repulsive force directing operators away from obstacles to prevent collision. Subject tests were con-ducted where human operators manually operated a remote UAV through a corridor environment under the conditions of the two strategies. For comparison, the conditions of no haptic feedback and the liner combination of both attractive and repulsive strategies were included in the study. Experi-mental results dictate that haptic force feedback in general (including both attractive and repulsive force feedback) improves the average distance from surrounding obstacles up to 21%. Further statis-tical comparison of repulsive and attractive feedback modalities reveal that even though a repulsive strategy is based directly on obstacles, an attractive strategy towards a reference trajectory is more suitable across all performance metrics. To further examine the effects of haptic aides in a UAV teleoperation task, the behavior of the human system as part of the control loop was also investigated. Through a novel device placed on the end effector of the haptic device, human-haptic interaction forces were captured and further analyzed. With this information, system identification techniques were carried out to determine the plausibility of deriving a human control model for the system. By defining lateral motion as a one-dimensional compensatory tracking task the results show that general human control behavior can be identified where lead compensation in invoked to counteract second-order UAV dynamics

Aerial Robotics for Inspection and Maintenance

Aerial robots with perception, navigation, and manipulation capabilities are extending the range of applications of drones, allowing the integration of different sensor devices and robotic manipulators to perform inspection and maintenance operations on infrastructures such as power lines, bridges, viaducts, or walls, involving typically physical interactions on flight. New research and technological challenges arise from applications demanding the benefits of aerial robots, particularly in outdoor environments. This book collects eleven papers from different research groups from Spain, Croatia, Italy, Japan, the USA, the Netherlands, and Denmark, focused on the design, development, and experimental validation of methods and technologies for inspection and maintenance using aerial robots