Towards Safer Obstacle Avoidance for Continuum-Style Manipulator in Dynamic Environments

The flexibility and dexterity of continuum manipulators in comparison with rigid-link counterparts have become main features behind their recent popularity. Despite of that, the problem of navigation and motion planning for continuum manipulators turns out to be demanding tasks due to the complexity of their flexible structure modelling which in turns complicates the pose estimation. In this paper, we present a real-time obstacle avoidance algorithm for tendondriven continuum-style manipulator in dynamic environments. The algorithm is equipped with a non-linear observer based on an Extended Kalman Filter to estimate the pose of every point along the manipulator’s body. A local observability analysis for the kinematic model of the manipulator is also presented. The overall algorithm works well for a model of a single-segment continuum manipulator in a real-time simulation environment with moving obstacles in the workspace of manipulators, able to avoid the whole body of manipulators from collision

Gesture Recognition and Control for Semi-Autonomous Robotic Assistant Surgeons

The next stage for robotics development is to introduce autonomy and cooperation with human agents in tasks that require high levels of precision and/or that exert considerable physical strain. To guarantee the highest possible safety standards, the best approach is to devise a deterministic automaton that performs identically for each operation. Clearly, such approach inevitably fails to adapt itself to changing environments or different human companions. In a surgical scenario, the highest variability happens for the timing of different actions performed within the same phases. This thesis explores the solutions adopted in pursuing automation in robotic minimally-invasive surgeries (R-MIS) and presents a novel cognitive control architecture that uses a multi-modal neural network trained on a cooperative task performed by human surgeons and produces an action segmentation that provides the required timing for actions while maintaining full phase execution control via a deterministic Supervisory Controller and full execution safety by a velocity-constrained Model-Predictive Controller

Shape Memory Alloy Actuators and Sensors for Applications in Minimally Invasive Interventions

Reduced access size in minimally invasive surgery and therapy (MIST) poses several restriction on the design of the dexterous robotic instruments. The instruments should be developed that are slender enough to pass through the small sized incisions and able to effectively operate in a compact workspace. Most existing robotic instruments are operated by big actuators, located outside the patient’s body, that transfer forces to the end effector via cables or magnetically controlled actuation mechanism. These instruments are certainly far from optimal in terms of their cost and the space they require in operating room. The lack of adequate sensing technologies make it very challenging to measure bending of the flexible instruments, and to measure tool-tissue contact forces of the both flexible and rigid instruments during MIST. Therefore, it requires the development of the cost effective miniature actuators and strain/force sensors. Having several unique features such as bio-compatibility, low cost, light weight, large actuation forces and electrical resistivity variations, the shape memory alloys (SMAs) show promising applications both as the actuators and strain sensors in MIST. However, highly nonlinear hysteretic behavior of the SMAs hinders their use as actuators. To overcome this problem, an adaptive artificial neural network (ANN) based Preisach model and a model predictive controller have been developed in this thesis to precisely control the output of the SMA actuators. A novel ultra thin strain sensor is also designed using a superelastic SMA wire, which can be used to measure strain and forces for many surgical and intervention instruments. A da Vinci surgical instrument is sensorized with these sensors in order to validate their force sensing capability

Nanofibrous Disc-Like Angle Ply Structure for Total Disc Replacement in a Small Animal Model

Low back pain affects 85% of the population and carries a socioeconomic price tag of $100 billion USD per year. Lumbar intervertebral disc disease is strongly implicated as a causative factor in back pain, as degeneration, which is ubiquitous in the population, leads to loss of normal spine function. For these reasons, our lab has developed disc-like angle ply structures (DAPS) for total disc replacement. These cell-seeded replacements are designed to match the natural hierarchical structure and function of the native disc and correct spinal kinematics after end-stage disc disease. In this dissertation, I describe the development of a rat caudal spine (tail) model of total disc replacement as a platform to evaluate DAPS in vivo; an external fixation system that immobilized caudal vertebrae at the site of implantation was required for DAPS retention and a radiopaque scaffold was developed to confirm intervertebral DAPS positioning. A detailed analysis of the DAPS in vitro growth trajectory was performed to select the optimum pre-culture duration before implantation. Cell-seeded DAPS were subsequently implanted in the rat tail and evaluated by histological, mechanical, and MRI analyses. DAPS successfully restored the mechanical properties of the native motion segment in compression, providing the first evidence of the efficacy of engineered disc replacements. Adaptations of the implant to the in vivo environment were identified; there was a reduction in glycosaminoglycan after implantation, structural modifications to the NP material, and no evidence of vertebral integration. In tackling the first of these issues, a pre-culture strategy that primed DAPS for the in vivo environment was developed; using a rat subcutaneous model, implant phenotype was best conserved post-implantation using a pre-culture strategy with a transient high dose of TGF-b3. Future work will address maintenance of NP structure, vertebral integration and scaling up to human sizes. In my work, the most promising finding was that DAPS replicated compressive motion segment mechanical properties after implantation supporting the idea that engineered biological disc replacement is a possibility for clinical treatment of advanced disc disease

Robotic manipulators for single access surgery

This thesis explores the development of cooperative robotic manipulators for enhancing surgical precision and patient outcomes in single-access surgery and, specifically, Transanal Endoscopic Microsurgery (TEM). During these procedures, surgeons manipulate a heavy set of instruments via a mechanical clamp inserted in the patient’s body through a surgical port, resulting in imprecise movements, increased patient risks, and increased operating time. Therefore, an articulated robotic manipulator with passive joints is initially introduced, featuring built-in position and force sensors in each joint and electronic joint brakes for instant lock/release capability. The articulated manipulator concept is further improved with motorised joints, evolving into an active tool holder. The joints allow the incorporation of advanced robotic capabilities such as ultra-lightweight gravity compensation and hands-on kinematic reconfiguration, which can optimise the placement of the tool holder in the operating theatre. Due to the enhanced sensing capabilities, the application of the active robotic manipulator was further explored in conjunction with advanced image guidance approaches such as endomicroscopy. Recent advances in probe-based optical imaging such as confocal endomicroscopy is making inroads in clinical uses. However, the challenging manipulation of imaging probes hinders their practical adoption. Therefore, a combination of the fully cooperative robotic manipulator with a high-speed scanning endomicroscopy instrument is presented, simplifying the incorporation of optical biopsy techniques in routine surgical workflows. Finally, another embodiment of a cooperative robotic manipulator is presented as an input interface to control a highly-articulated robotic instrument for TEM. This master-slave interface alleviates the drawbacks of traditional master-slave devices, e.g., using clutching mechanics to compensate for the mismatch between slave and master workspaces, and the lack of intuitive manipulation feedback, e.g. joint limits, to the user. To address those drawbacks a joint-space robotic manipulator is proposed emulating the kinematic structure of the flexible robotic instrument under control.Open Acces

Research on real-time physics-based deformation for haptic-enabled medical simulation

This study developed a multiple effective visuo-haptic surgical engine to handle a variety of surgical manipulations in real-time. Soft tissue models are based on biomechanical experiment and continuum mechanics for greater accuracy. Such models will increase the realism of future training systems and the VR/AR/MR implementations for the operating room

Flexible tactile digital feedback for clinical applications

Trauma and damage to the delicate structures of the inner ear frequently occurs during insertion of electrode array into the cochlea. This is strongly related to the excessive manual insertion force of the surgeon without any tool/tissue interaction feedback. The research is examined tool-tissue interaction of large prototype scale (12.5:1) digit embedded with distributive tactile sensor based upon cochlear electrode and large prototype scale (4.5:1) cochlea phantom for simulating the human cochlear which could lead to small scale digit requirements. This flexible digit classified the tactile information from the digit-phantom interaction such as contact status, tip penetration, obstacles, relative shape and location, contact orientation and multiple contacts. The digit, distributive tactile sensors embedded with silicon-substrate is inserted into the cochlea phantom to measure any digit/phantom interaction and position of the digit in order to minimize tissue and trauma damage during the electrode cochlear insertion. The digit is pre-curved in cochlea shape so that the digit better conforms to the shape of the scala tympani to lightly hug the modiolar wall of a scala. The digit have provided information on the characteristics of touch, digit-phantom interaction during the digit insertion. The tests demonstrated that even devices of such a relative simple design with low cost have potential to improve cochlear implants surgery and other lumen mapping applications by providing tactile feedback information by controlling the insertion through sensing and control of the tip of the implant during the insertion. In that approach, the surgeon could minimize the tissue damage and potential damage to the delicate structures within the cochlear caused by current manual electrode insertion of the cochlear implantation. This approach also can be applied diagnosis and path navigation procedures. The digit is a large scale stage and could be miniaturized in future to include more realistic surgical procedures