In-vivo pan/tilt endoscope with integrated light source

Endoscopic imaging is still dominated by the paradigm of pushing long sticks into small openings. This approach has a number of limitations for minimal access surgery, such as narrow angle imaging, limited workspace, counter-intuitive motions and additional incisions for the endoscpic instruments. Our intent is to go beyond this paradigm, and remotize sensors and effectors directly into the body cavity. To this end, we have developed a prototype of a novel insertable pan/tilt endoscopic camera with an integrated light source. The package has a size of 110 mm in length and 10 mm in diameter and can be inserted into the abdomen through a standard trocar and then anchored onto the abdominal wall, leaving the incision port open for access. The camera package contains three parts: an imaging module, an illumination module, and a pan/tilt motion platform. The imaging module includes a lens and CCD imaging sensor. The illumination module attaches to the imaging module and has an array of LED light sources. The pan/tilt platform provides the imaging module with pan of 120 degrees and tilt motion of 90 degrees using small servo motors. A fixing mechanism is designed to hold the device in the cavity. A standard joy stick can be used to control the motion of the camera in a natural way. The design allows for multiple camera packages to be inserted through a single incision as well

In-vivo pan/tilt endoscope with integrated light source

Endoscopic imaging is still dominated by the paradigm of pushing long sticks into small openings. This approach has a number of limitations for minimal access surgery, such as narrow angle imaging, limited workspace, counter-intuitive motions and additional incisions for the endoscpic instruments. Our intent is to go beyond this paradigm, and remotize sensors and effectors directly into the body cavity. To this end, we have developed a prototype of a novel insertable pan/tilt endoscopic camera with an integrated light source. The package has a size of 110 mm in length and 10 mm in diameter and can be inserted into the abdomen through a standard trocar and then anchored onto the abdominal wall, leaving the incision port open for access. The camera package contains three parts: an imaging module, an illumination module, and a pan/tilt motion platform. The imaging module includes a lens and CCD imaging sensor. The illumination module attaches to the imaging module and has an array of LED light sources. The pan/tilt platform provides the imaging module with pan of 120 degrees and tilt motion of 90 degrees using small servo motors. A fixing mechanism is designed to hold the device in the cavity. A standard joy stick can be used to control the motion of the camera in a natural way. The design allows for multiple camera packages to be inserted through a single incision as well

In vivo laparoscopic robotics

AbstractRobotic laparoscopic surgery is evolving to include in vivo robotic assistants. The impetus for the development of this technology is to provide surgeons with additional viewpoints and unconstrained manipulators that improve safety and reduce patient trauma. A family of these robots have been developed to provide vision and task assistance. Fixed-base and mobile robots have been designed and tested in animal models with much success. A cholecystectomy, prostatectomy, and nephrectomy have all been performed with the assistance of these robots. These early successful tests show how in vivo laparoscopic robotics may be part of the next advancement in surgical technology

Design of a monitor and simulation terminal (master) for space station telerobotics and telescience

Based on Space Station and planetary spacecraft communication time delays and bandwidth limitations, it will be necessary to develop an intelligent, general purpose ground monitor terminal capable of sophisticated data display and control of on-orbit facilities and remote spacecraft. The basic elements that make up a Monitor and Simulation Terminal (MASTER) include computer overlay video, data compression, forward simulation, mission resource optimization and high level robotic control. Hardware and software elements of a MASTER are being assembled for testbed use. Applications of Neural Networks (NNs) to some key functions of a MASTER are also discussed. These functions are overlay graphics adjustment, object correlation and kinematic-dynamic characterization of the manipulator

Advances in Fiber-Optic Extrinsic Fabry-Perot Interferometric Physical and Mechanical Sensors: A Review

Fabry-Perot Interferometers Have Found a Multitude of Scientific and Industrial Applications Ranging from Gravitational Wave Detection, High-Resolution Spectroscopy, and Optical Filters to Quantum Optomechanics. Integrated with Optical Fiber Waveguide Technology, the Fiber-Optic Fabry-Perot Interferometers Have Emerged as a Unique Candidate for High-Sensitivity Sensing and Have Undergone Tremendous Growth and Advancement in the Past Two Decades with their Successful Applications in an Expansive Range of Fields. the Extrinsic Cavity-Based Devices, I.e., the Fiber-Optic Extrinsic Fabry-Perot Interferometers (EFPIs), Enable Great Flexibility in the Design of the Sensitive Fabry-Perot Cavity Combined with State-Of-The-Art Micromachining and Conventional Mechanical Fabrication, Leading to the Development of a Diverse Array of EFPI Sensors Targeting at Different Physical Quantities. Here, We Summarize the Recent Progress of Fiber-Optic EFPI Sensors, Providing an overview of Different Physical and Mechanical Sensors based on the Fabry-Perot Interferometer Principle, with a Special Focus on Displacement-Related Quantities, Such as Strain, Force, Tilt, Vibration and Acceleration, Pressure, and Acoustic. the Working Principle and Signal Demodulation Methods Are Shown in Brief. Perspectives on Further Advancement of EFPI Sensing Technologies Are Also Discussed

Smart Camera Robotic Assistant for Laparoscopic Surgery

The cognitive architecture also includes learning mechanisms to adapt the behavior of the robot to the different ways of working of surgeons, and to improve the robot behavior through experience, in a similar way as a human assistant would do. The theoretical concepts of this dissertation have been validated both through in-vitro experimentation in the labs of medical robotics of the University of Malaga and through in-vivo experimentation with pigs in the IACE Center (Instituto Andaluz de Cirugía Experimental), performed by expert surgeons.In the last decades, laparoscopic surgery has become a daily practice in operating rooms worldwide, which evolution is tending towards less invasive techniques. In this scenario, robotics has found a wide field of application, from slave robotic systems that replicate the movements of the surgeon to autonomous robots able to assist the surgeon in certain maneuvers or to perform autonomous surgical tasks. However, these systems require the direct supervision of the surgeon, and its capacity of making decisions and adapting to dynamic environments is very limited. This PhD dissertation presents the design and implementation of a smart camera robotic assistant to collaborate with the surgeon in a real surgical environment. First, it presents the design of a novel camera robotic assistant able to augment the capacities of current vision systems. This robotic assistant is based on an intra-abdominal camera robot, which is completely inserted into the patient’s abdomen and it can be freely moved along the abdominal cavity by means of magnetic interaction with an external magnet. To provide the camera with the autonomy of motion, the external magnet is coupled to the end effector of a robotic arm, which controls the shift of the camera robot along the abdominal wall. This way, the robotic assistant proposed in this dissertation has six degrees of freedom, which allow providing a wider field of view compared to the traditional vision systems, and also to have different perspectives of the operating area. On the other hand, the intelligence of the system is based on a cognitive architecture specially designed for autonomous collaboration with the surgeon in real surgical environments. The proposed architecture simulates the behavior of a human assistant, with a natural and intuitive human-robot interface for the communication between the robot and the surgeon

sCAM: An Untethered Insertable Laparoscopic Surgical Camera Robot

Fully insertable robotic imaging devices represent a promising future of minimally invasive laparoscopic vision. Emerging research efforts in this field have resulted in several proof-of-concept prototypes. One common drawback of these designs derives from their clumsy tethering wires which not only cause operational interference but also reduce camera mobility. Meanwhile, these insertable laparoscopic cameras are manipulated without any pose information or haptic feedback, which results in open loop motion control and raises concerns about surgical safety caused by inappropriate use of force.This dissertation proposes, implements, and validates an untethered insertable laparoscopic surgical camera (sCAM) robot. Contributions presented in this work include: (1) feasibility of an untethered fully insertable laparoscopic surgical camera, (2) camera-tissue interaction characterization and force sensing, (3) pose estimation, visualization, and feedback with sCAM, and (4) robotic-assisted closed-loop laparoscopic camera control. Borrowing the principle of spherical motors, camera anchoring and actuation are achieved through transabdominal magnetic coupling in a stator-rotor manner. To avoid the tethering wires, laparoscopic vision and control communication are realized with dedicated wireless links based on onboard power. A non-invasive indirect approach is proposed to provide real-time camera-tissue interaction force measurement, which, assisted by camera-tissue interaction modeling, predicts stress distribution over the tissue surface. Meanwhile, the camera pose is remotely estimated and visualized using complementary filtering based on onboard motion sensing. Facilitated by the force measurement and pose estimation, robotic-assisted closed-loop control has been realized in a double-loop control scheme with shared autonomy between surgeons and the robotic controller.The sCAM has brought robotic laparoscopic imaging one step further toward less invasiveness and more dexterity. Initial ex vivo test results have verified functions of the implemented sCAM design and the proposed force measurement and pose estimation approaches, demonstrating the technical feasibility of a tetherless insertable laparoscopic camera. Robotic-assisted control has shown its potential to free surgeons from low-level intricate camera manipulation workload and improve precision and intuitiveness in laparoscopic imaging

Calibration of miniature inertial and magnetic sensor units for robust attitude estimation

Attitude estimation from miniature inertial and magnetic sensors has been used in a wide variety of applications, ranging from virtual reality, underwater vehicles, handheld navigation devices, to biomotion analysis. However, appropriate sensor calibrations for accurate sensor measurements are essential to the performance of attitude estimation algorithms. In this paper, we present a robust sensor calibration method for accurate attitude estimation from three-axis accelerometers, gyroscopes, and magnetometer measurements. The proposed calibration method only requires a simple pan-tilt unit. A unified sensor model for inertial and magnetic sensors is used to convert the sensor readings to physical quantities in metric units. Based on the sensor model, a cost function is constructed, and a two-step iterative algorithm is then proposed to calibrate the inertial sensors. Due to the difficulties of acquiring the ground-truth of the Earth magnetic field, a simplified pseudomagnetometer calibration method is also presented based on an ellipsoid fitting algorithm. The calibration method is then applied to our sensor nodes, and the good performance of the orientation estimation has illustrated the effectiveness of the proposed sensor calibration method

In vivo laparoscopic robotics

Robotic laparoscopic surgery is evolving to include in vivo robotic assistants. The impetus for the development of this technology is to provide surgeons with additional viewpoints and unconstrained manipulators that improve safety and reduce patient trauma. A family of these robots have been developed to provide vision and task assistance. Fixed-base and mobile robots have been designed and tested in animal models with much success. A cholecystectomy, prostatectomy, and nephrectomy have all been performed with the assistance of these robots. These early successful tests show how in vivo laparoscopic robotics may be part of the next advancement in surgical technology

Two Degree-Of-Freedom Camera Support System

A surveillance camera is used to observer and record the surroundings. There are many types of existing surveillance camera and each of them has their own specifications made to suit their respective purposes. For example, there are fixed, 1-degree-of- freedom (DOF) and2-DOF cameras. As for a moving camera, it is essential for it to be able to move freely so that it can capture the target object in awider range. The camera also should be able to be controlled wirelessly to give a better practicality to the user. Based on the specifications, this project is constructed to overcome these problems. A 2-DOF camera support system is to be created which can be controlled wirelessly via Bluetooth. The support will e made with two motors that can pan and tilt the camera. The user will need to download an application which has o screen control into their gadgets and this can be connected to the Arduino which controls the motors. The Arduino will process the command from the user and will move the right motor to execute the command. This project will help the user to control the surveillance camera from a distance wirelessly and have at least a 360B0; pan view and 90B0; tilt view