RESEARCH ON SMALL FIDUCIAL MARK USE FOR ROBOTIC MANIPULATION AND ALIGNMENT OF OPHTHALMIC LENSES

Abstract -Robotic manipulation and alignment of ophthalmic lenses during their manufacturing process can take advantage of machine vision location of smallPducia1 marks engraved or printed on the lens surface. Industry research efSorts are currently devoted to obtain a proper fiducial mark design that optimises the reliability of robotic lens manipulation. In this paper the work in progress in this area is presented

State of the art of robotic surgery related to vision: Brain and eye applications of newly available devices

Raffaele Nuzzi, Luca Brusasco Department of Surgical Sciences, Eye Clinic, University of Torino, Turin, Italy Background: Robot-assisted surgery has revolutionized many surgical subspecialties, mainly where procedures have to be performed in confined, difficult to visualize spaces. Despite advances in general surgery and neurosurgery, in vivo application of robotics to ocular surgery is still in its infancy, owing to the particular complexities of microsurgery. The use of robotic assistance and feedback guidance on surgical maneuvers could improve the technical performance of expert surgeons during the initial phase of the learning curve. Evidence acquisition: We analyzed the advantages and disadvantages of surgical robots, as well as the present applications and future outlook of robotics in neurosurgery in brain areas related to vision and ophthalmology. Discussion: Limitations to robotic assistance remain, that need to be overcome before it can be more widely applied in ocular surgery. Conclusion: There is heightened interest in studies documenting computerized systems that filter out hand tremor and optimize speed of movement, control of force, and direction and range of movement. Further research is still needed to validate robot-assisted procedures. Keywords: robotic surgery related to vision, robots, ophthalmological applications of robotics, eye and brain robots, eye robot

Design, Manufacturing and Control of an Advanced High-Precision Robotic System for Microsurgery

Microsurgeries like ophthalmic surgery confront many challenges like limited workspace and hand motion, steady hand movements, manipulating delicate thin tissues, and holding the instrument in place for a long time. New developments in robotically-assisted surgery can highly benefits this field and facilitate those complicated surgeries. Robotic eye surgery can save time, reduce surgical complications and inspire more delicate surgical procedures that cannot be done currently by surgeon’s hands. In this thesis work, the requirements for ophthalmic surgeries were studied and based on that a robotic system with 6 DOF is proposed and designed. This robotic system is capable of handling the position and orientation of the surgical instrument with theoretical accuracy of 10 μm. The design features a remote center of motion that defines the point of entry into the eye or patient’s body. The forward and inverse kinematics equations and workspace analysis of the robot is also discussed and presented. Six miniature DC motors with their PID controllers were installed on robot arms in order to run 6 DOF systems. Therefore, the dynamic behavior of a DC motor was studied and modeled and then the position and velocity transfer functions were derived and used to study the behavior of the system and also to manually tune the PID controller. The function of different elements of the control system including encoder, controller modules, Controller Area Network (CAN) and the controller software were discussed as well. The graphical user interface called EPOS Studio and performs as the motion controller is introduced and the way it organizes communications among the elements of the control system was described

Robot Control for Remote Ophthalmology and Pediatric Physical Rehabilitation

The development of a robotic slit-lamp for remote ophthalmology is the primary purpose of this work. In addition to novel mechanical designs and implementation, it was also a goal to develop a control system that was flexible enough to be adapted with minimal user adjustment to various styles and configurations of slit-lamps. The system was developed with intentions of commercialization, so common hardware was used for all components to minimize the costs. In order to improve performance using this low-cost hardware, investigations were made to attempt to achieve better performance by applying control theory algorithms in the system software. Ultimately, the controller was to be flexible enough to be applied to other areas of human-robot interaction including pediatric rehabilitation via the use of humanoid robotic aids. This application especially requires a robust controller to facilitate safe interaction. Though all of the prototypes were successfully developed and made to work sufficiently with the control hardware, the application of advanced control did not yield notable gains as was hoped. Further investigations were made attempting to alter the performance of the control system, but the components selected did not have the physical capabilities for improved response above the original software implemented. Despite this disappointment, numerous novel advances were made in the area of teleoperated ophthalmic technology and pediatric physical rehabilitation tools. This includes a system that is used to remote control a slit-lamp and lens for examinations and some laser procedures. Secondly, a series of of humanoid systems suitable for both medical research and therapeutic modeling were developed. This included a robotic face used as an interactive system for ophthalmic testing and training. It can also be used as one component in an interactive humanoid robotic system that includes hands and arms to allow use of teaching sign language, social skills or modeling occupational therapy tasks. Finally, a humanoid system is presented that can serve as a customized surrogate between a therapist and client to model physical therapy tasks in a realistic manner. These systems are all functional, safe and low-cost to allow for feasible implementation with patients in the near future

NASA technology applications team: Applications of aerospace technology

Two critical aspects of the Applications Engineering Program were especially successful: commercializing products of Application Projects; and leveraging NASA funds for projects by developing cofunding from industry and other agencies. Results are presented in the following areas: the excimer laser was commercialized for clearing plaque in the arteries of patients with coronary artery disease; the ultrasound burn depth analysis technology is to be licensed and commercialized; a phased commercialization plan was submitted to NASA for the intracranial pressure monitor; the Flexible Agricultural Robotics Manipulator System (FARMS) is making progress in the development of sensors and a customized end effector for a roboticized greenhouse operation; a dual robot are controller was improved; a multisensor urodynamic pressure catherer was successful in clinical tests; commercial applications were examined for diamond like carbon coatings; further work was done on the multichannel flow cytometer; progress on the liquid airpack for fire fighters; a wind energy conversion device was tested in a low speed wind tunnel; and the Space Shuttle Thermal Protection System was reviewed

Robotically assisted eye surgery : a haptic master console

Vitreo-retinal surgery encompasses the surgical procedures performed on the vitreous humor and the retina. A procedure typically consists of the removal of the vitreous humor, the peeling of a membrane and/or the repair of a retinal detachment. Operations are performed with needle shaped instruments which enter the eye through surgeon made scleral openings. An instrument is moved by hand in four degrees of freedom (three rotations and one translation) through this opening. Two rotations (? and ? ) are for a lateral instrument tip movement. The other two DoFs (z and ?) are the translation and rotation along the instrument axis. Actuation of for example a forceps can be considered as a fifth DoF. Characteristically, the manipulation of delicate, micrometer range thick intraocular tissue is required. Today, eye surgery is performed with a maximum of two instruments simultaneously. The surgeon relies on visual feedback only, since instrument forces are below the human detection limit. A microscope provides the visual feedback. It forces the surgeon to work in a static and non ergonomic body posture. Although the surgeon’s proficiency improves throughout his career, hand tremor may become a problem around his mid-fifties. Robotically assisted surgery with a master-slave system enhances dexterity. The slave with instrument manipulators is placed over the eye. The surgeon controls the instrument manipulators via haptic interfaces at the master. The master and slave are connected by electronic hardware and control software. Implementation of tremor filtering in the control software and downscaling of the hand motion allow prolongation of the surgeon’s career. Furthermore, it becomes possible to do tasks like intraocular cannulation which can not be done by manually performed surgery. This thesis focusses on the master console. Eye surgery procedures are observed in the operating room of different hospitals to gain insight in the requirements for the master. The master console as designed has an adjustable frame, a 3D display and two haptic interfaces with a coarse adjustment arm each. The console is mounted at the head of the operating table and is combined with the slave. It is compact, easy to place and allows the surgeon to have a direct view on and a physical contact with the patient. Furthermore, it fits in today’s manual surgery arrangement. Each haptic interface has the same five degrees of freedom as the instrument inside the eye. Through these interfaces, the surgeon can feel the augmented instrument forces. Downscaling of the hand motion results in a more accurate instrument movement compared to manually performed surgery. Together with the visual feedback, it is like the surgeon grasps the instrument near the tip inside the eye. The similarity between hand motion and motion of the instrument tip as seen on the display results in an intuitive manipulation. Pre-adjustment of the interface is done via the coarse adjustment arm. Mode switching enables to control three or more instruments manipulators with only two interfaces. Two one degree of freedom master-slave systems with force feedback are built to derive the requirements for the haptic interface. Hardware in the loop testing provides valuable insights and shows the possibility of force feedback without the use of force sensors. Two five DoF haptic interfaces are realized for bimanual operation. Each DoF has a position encoder and a force feedback motor. A correct representation of the upscaled instrument forces is only possible if the disturbance forces are low. Actuators are therefore mounted to the fixed world or in the neighborhood of the pivoting point for a low contribution to the inertia. The use of direct drive for ' and and low geared, backdriveable transmissions for the other three DoFs gives a minimum of friction. Disturbance forces are further minimized by a proper cable layout and actuator-amplifier combinations without torque ripple. The similarity in DoFs between vitreo-retinal eye surgery and minimally invasive surgery (MIS) enables the system to be used for MIS as well. Experiments in combination with a slave robot for laparoscopic and thoracoscopic surgery show that an instrument can be manipulated in a comfortable and intuitive way. User experience of surgeons and others is utilized to improve the haptic interface further. A parallel instead of a serial actuation concept for the ' and DoFs reduces the inertia, eliminates the flexible cable connection between frame and motor and allows that the heat of the motor is transferred directly to the frame. A newly designed z-?? module combines the actuation and suspension of the hand held part of the interface and has a three times larger z range than in the first design of the haptic interface

Vitreo-retinal eye surgery robot : sustainable precision

Vitreo-retinal eye surgery encompasses the surgical procedures performed on the vitreous humor and the retina. A procedure typically consists of the removal of the vitreous humor, the peeling of a membrane and/or the repair of a retinal detachment. Vitreo-retinal surgery is performed minimal invasively. Small needle shaped instruments are inserted into the eye. Instruments are manipulated by hand in four degrees of freedom about the insertion point. Two rotations move the instrument tip laterally, in addition to a translation in axial instrument direction and a rotation about its longitudinal axis. The manipulation of the instrument tip, e.g. a gripping motion can be considered as a fifth degree of freedom. While performing vitreo-retinal surgery manually, the surgeon faces various challenges. Typically, delicate micrometer range thick tissue is operated, for which steady hand movements and high accuracy instrument manipulation are required. Lateral instrument movements are inverted by the pivoting insertion point and scaled depending on the instrument insertion depth. A maximum of two instruments can be used simultaneously. There is nearly no perception of surgical forces, since most forces are below the human detection limit. Therefore, the surgeon relies only on visual feedback, obtained via a microscope or endoscope. Both vision systems force the surgeon to work in a static and non ergonomic body posture. Although the surgeon’s proficiency improves throughout his career, hand tremor will become a problem at higher age. Robotically assisted surgery with a master-slave system can assist the surgeon in these challenges. The slave system performs the actual surgery, by means of instrument manipulators which handle the instruments. The surgeon remains in control of the instruments by operating haptic interfaces via a master. Using electronic hardware and control software, the master and slave are connected. Amongst others, advantages as tremor filtering, up-scaled force feedback, down-scaled motions and stabilized instrument positioning will enhance dexterity on surgical tasks. Furthermore, providing the surgeon an ergonomic body posture will prolong the surgeon’s career. This thesis focuses on the design and realization of a high precision slave system for eye surgery. The master-slave system uses a table mounted design, where the system is compact, lightweight, easy to setup and equipped to perform a complete intervention. The slave system consists of two main parts: the instrument manipulators and their passive support system. Requirements are derived from manual eye surgery, conversations with medical specialists and analysis of the human anatomy and vitreo-retinal interventions. The passive support system provides a stiff connection between the instrument manipulator, patient and surgical table. Given the human anatomical diversity, presurgical adjustments can be made to allow the instrument manipulators to be positioned over each eye. Most of the support system is integrated within the patient’s headrest. On either the left or right side, two exchangeable manipulator-support arms can be installed onto the support system, depending on the eye being operated upon. The compact, lightweight and easy to install design, allows for a short setup time and quick removal in case of a complication. The slave system’s surgical reach is optimized to emulate manually performed surgery. For bimanual instrument operation, two instrument manipulators are used. Additional instrument manipulators can be used for non-active tools e.g. an illumination probe or an endoscope. An instrument manipulator allows the same degrees of freedom and a similar reach as manually performed surgery. Instrument forces are measured to supply force feedback to the surgeon via haptic interfaces. The instrument manipulator is designed for high stiffness, is play free and has low friction to allow tissue manipulation with high accuracy. Each instrument manipulator is equipped with an on board instrument change system, by which instruments can be changed in a fast and secure way. A compact design near the instrument allows easy access to the surgical area, leaving room for the microscope and peripheral equipment. The acceptance of a surgical robot for eye surgery mostly relies on equipment safety and reliability. The design of the slave system features various safety measures, e.g. a quick release mechanism for the instrument manipulator and additional locks on the pre-surgical adjustment fixation clamp. Additional safety measures are proposed, like a hard cover over the instrument manipulator and redundant control loops in the controlling FPGA. A method to fixate the patient’s head to the headrest by use of a custom shaped polymer mask is proposed. Two instrument manipulators and their passive support system have been realized so far, and the first experimental results confirm the designed low actuation torque and high precision performance

Insight into the Design of Aerosol Spray Systems for Cell Therapies for Retinal Diseases using Computational Modelling and Experimental Assessment

Retinal degenerative diseases affect numerous people worldwide and in the UK; they lead to dysfunction of retinal cells and retinal dysfunction, in turn leading to vision loss and in some cases blindness. Existing treatments aim to alleviate current risk factors leading to retinal degeneration, such as increased high pressure. However, these procedures do not restore lost cell, vision nor retinal function, and therefore may still lead to blindness. Developing cell-based therapies to replace lost cells provides one option for retinal tissue repair in order to restore retinal function. These therapies involve delivering stem cells to encourage neural cell-like functions within the retinal tissue. Despite progress in developing stem-cells compatible with the retinal layers, there is also a need to developing a minimal invasive technique for cell delivery, without damaging the neighbouring optical structure. After evaluating several methods of cell delivery, this thesis explores the need for developing aerosol spraying systems for stem-cell delivery into the human eye. Mathematical modelling is used as a tool to define spraying parameters which, alongside experimental work, may accelerate the design of aerosol spraying systems to treat retinal degenerative disease such as glaucoma. Firstly, an organic biomaterial is developed and used as scaffold to spray and protect cells from aerodynamic forces and stresses associated with aerosolization. The rheological properties of this biomaterial are incorporated within a computational model to predict cell-spraying into a human eye. Boundary and initial conditions mimic the experimental spraying conditions, and the parameterised model is used to explore the link between operator-defined conditions (namely volume flow rate of the cell-laden hydrogel, external pressure needed for aerosolization and angle of the spraying) and spraying outputs (surface area of the retina covered, droplets speed, wall shear stress on the retinal surface). Data from both computational and experimental analyses were gathered. Computational modelling is used to explore the impact of spraying parameters (pressure and volume flow rate at the injector nozzle, outer cone angle for the spray) on key outputs of high priority, namely the spatial distribution of the delivered hydrogel on the retinal wall, the surface area of the retina covered and droplet speed. Droplets speed at the retinal wall appeared to increase with increasing pressure conditions and were observed at a constant volume flow rate. Experimental assessments were used to validate the computational data and determine cell viability under set environmental conditions (external pressure and volume flow rate of cell-laden hydrogel) through in-vitro testing. This thesis defines indicative spraying parameters for delivering therapeutic cells to the human retina, based on a combination of computational modelling and experimental studies. Mathematical modelling provides the potential to transfer these findings to other organ systems, aligning with broader effects to develop cell delivery systems to treat organ disease and repair