Robot-aided tunnel inspection and maintenance system by vision and proximity sensor integration

This article describes an unprecedented alternative to manual procedures for the application of advanced composite materials, such as Fiber Reinforced Polymer (FRP) and epoxy resins. A complete mobile integrated system is presented for the inspection and maintenance of concrete surfaces in tunnels. It allows performance of operations with minimum interference on passing traffic. The core of this system resides in a specially designed light-weight robotic tool, which is sensed and automated for processes. Sensing includes vision and a laser telemeter to assure precise inspection, superficial preparation, and composite application. The designed interconnection flange allows simple and robust attachment of the tool to a robotic arm's tip. The robot&-tool set is to be mounted on a standard articulated lift platform. Therefore, an operator can direct the platform and the robot&-tool set's operations from a control station placed at ground-level, in a wheeled vehicle on which the articulated lift platform is mounted. A graphical Human&-Machine Interface (HMI) has been developed for the system. It allows the operator to identify fissures for the injection of epoxy resin, and weakened surfaces for FRP adhesion. Actual procedures are planned and performed by the system's automatic components.This work has been supported by the CAM Project S2009/DPI-1559/ROBOCITY2030 II, developed by the research team RoboticsLab at the University Carlos III of Madrid

Image-based 3-D reconstruction of constrained environments

Nuclear power plays a important role to the United Kingdom electricity generation infrastructure, providing a reliable baseload of low carbon electricity. The Advanced Gas-cooled Reactor (AGR) design makes up approximately 50% of the existing fleet, however, many of the operating reactors have exceeding their original design lifetimes.To ensure safe reactor operation, engineers perform periodic in-core visual inspections of reactor components to monitor the structural health of the core as it ages. However, current inspection mechanisms deployed provide limited structural information about the fuel channel or defects.;This thesis investigates the suitability of image-based 3-D reconstruction techniques to acquire 3-D structural geometry to enable improved diagnostic and prognostic abilities for inspection engineers. The application of image-based 3-D reconstruction to in-core inspection footage highlights significant challenges, most predominantly that the image saliency proves insuffcient for general reconstruction frameworks. The contribution of the thesis is threefold. Firstly, a novel semi-dense matching scheme which exploits sparse and dense image correspondence in combination with a novel intra-image region strength approach to improve the stability of the correspondence between images.;This results in a percentage increase of 138.53% of correct feature matches over similar state-of-the-art image matching paradigms. Secondly, a bespoke incremental Structure-from-Motion (SfM) framework called the Constrained Homogeneous SfM (CH-SfM) which is able to derive structure from deficient feature spaces and constrained environments. Thirdly, the application of the CH-SfM framework to remote visual inspection footage gathered within AGR fuel channels, outperforming other state-of-the-art reconstruction approaches and extracting representative 3-D structural geometry of orientational scans and fully circumferential reconstructions.;This is demonstrated on in-core and laboratory footage, achieving an approximate 3-D point density of 2.785 - 23.8025NX/cm² for real in-core inspection footage and high quality laboratory footage respectively. The demonstrated novelties have applicability to other constrained or feature-poor environments, with future work looking to producing fully dense, photo-realistic 3-D reconstructions.Nuclear power plays a important role to the United Kingdom electricity generation infrastructure, providing a reliable baseload of low carbon electricity. The Advanced Gas-cooled Reactor (AGR) design makes up approximately 50% of the existing fleet, however, many of the operating reactors have exceeding their original design lifetimes.To ensure safe reactor operation, engineers perform periodic in-core visual inspections of reactor components to monitor the structural health of the core as it ages. However, current inspection mechanisms deployed provide limited structural information about the fuel channel or defects.;This thesis investigates the suitability of image-based 3-D reconstruction techniques to acquire 3-D structural geometry to enable improved diagnostic and prognostic abilities for inspection engineers. The application of image-based 3-D reconstruction to in-core inspection footage highlights significant challenges, most predominantly that the image saliency proves insuffcient for general reconstruction frameworks. The contribution of the thesis is threefold. Firstly, a novel semi-dense matching scheme which exploits sparse and dense image correspondence in combination with a novel intra-image region strength approach to improve the stability of the correspondence between images.;This results in a percentage increase of 138.53% of correct feature matches over similar state-of-the-art image matching paradigms. Secondly, a bespoke incremental Structure-from-Motion (SfM) framework called the Constrained Homogeneous SfM (CH-SfM) which is able to derive structure from deficient feature spaces and constrained environments. Thirdly, the application of the CH-SfM framework to remote visual inspection footage gathered within AGR fuel channels, outperforming other state-of-the-art reconstruction approaches and extracting representative 3-D structural geometry of orientational scans and fully circumferential reconstructions.;This is demonstrated on in-core and laboratory footage, achieving an approximate 3-D point density of 2.785 - 23.8025NX/cm² for real in-core inspection footage and high quality laboratory footage respectively. The demonstrated novelties have applicability to other constrained or feature-poor environments, with future work looking to producing fully dense, photo-realistic 3-D reconstructions

Advances in navigation and intraoperative imaging for intraoperative electron radiotherapy

Mención Internacional en el título de doctorEsta tesis se enmarca dentro del campo de la radioterapia y trata específicamente sobre la radioterapia intraoperatoria (RIO) con electrones. Esta técnica combina la resección quirúrgica de un tumor y la radiación terapéutica directamente aplicada sobre el lecho tumoral post-resección o sobre el tumor no resecado. El haz de electrones de alta energía es colimado y conducido por un aplicador específico acoplado a un acelerador lineal. La planificación de la RIO con electrones es compleja debido a las modificaciones geométricas y anatómicas producidas por la retracción de estructuras y la eliminación de tejidos cancerosos durante la cirugía. Actualmente, no se dispone del escenario real en este tipo de tratamientos (por ejemplo, la posición/orientación del aplicador respecto a la anatomía del paciente o las irregularidades en la superficie irradiada), sólo de una estimación grosso modo del tratamiento real administrado al paciente. Las imágenes intraoperatorias del escenario real durante el tratamiento (concretamente imágenes de tomografía axial computarizada [TAC]) serían útiles no sólo para la planificación intraoperatoria, sino también para registrar y evaluar el tratamiento administrado al paciente. Esta información es esencial en estudios prospectivos. En esta tesis se evaluó en primer lugar la viabilidad de un sistema de seguimiento óptico de varias cámaras para obtener la posición/orientación del aplicador en los escenarios de RIO con electrones. Los resultados mostraron un error de posición del aplicador inferior a 2 mm (error medio del centro del bisel) y un error de orientación menor de 2º (error medio del eje del bisel y del eje longitudinal del aplicador). Estos valores están dentro del rango propuesto por el Grupo de Trabajo 147 (encargo del Comité de Terapia y del Subcomité para la Mejora de la Garantía de Calidad y Resultados de la Asociación Americana de Físicos en Medicina [AAPM] para estudiar en radioterapia externa la exactitud de la localización con métodos no radiográficos, como los sistemas infrarrojos). Una limitación importante de la solución propuesta es que el aplicador se superpone a la imagen preoperatoria del paciente. Una imagen intraoperatoria proporcionaría información anatómica actualizada y permitiría estimar la distribución tridimensional de la dosis. El segundo estudio específico de esta tesis evaluó la viabilidad de adquirir con un TAC simulador imágenes TAC intraoperatorias de escenarios reales de RIO con electrones. No hubo complicaciones en la fase de transporte del paciente utilizando la camilla y su acople para el transporte, o con la adquisición de imágenes TAC intraoperatorias en la sala del TAC simulador. Los estudios intraoperatorios adquiridos se utilizaron para evaluar la mejora obtenida en la estimación de la distribución de dosis en comparación con la obtenida a partir de imágenes TAC preoperatorias, identificando el factor dominante en esas estimaciones (la región de aire y las irregularidades en la superficie, no las heterogeneidades de los tejidos). Por último, el tercer estudio específico se centró en la evaluación de varias tecnologías TAC de kilovoltaje, aparte del TAC simulador, para adquirir imágenes intraoperatorias con las que estimar la distribución de la dosis en RIO con electrones. Estos dispositivos serían necesarios en el caso de disponer de aceleradores lineales portátiles en el quirófano ya que no se aprobaría mover al paciente a la sala del TAC simulador. Los resultados con un maniquí abdominal mostraron que un TAC portátil (BodyTom) e incluso un acelerador lineal con un TAC de haz de cónico (TrueBeam) serían adecuados para este propósito.This thesis is framed within the field of radiotherapy, specifically intraoperative electron radiotherapy (IOERT). This technique combines surgical resection of a tumour and therapeutic radiation directly applied to a post-resection tumour bed or to an unresected tumour. The high-energy electron beam is collimated and conducted by a specific applicator docked to a linear accelerator (LINAC). Dosimetry planning for IOERT is challenging owing to the geometrical and anatomical modifications produced by the retraction of structures and removal of cancerous tissues during the surgery. No data of the actual IOERT 3D scenario is available (for example, the applicator pose in relation to the patient’s anatomy or the irregularities in the irradiated surface) and consequently only a rough approximation of the actual IOERT treatment administered to the patient can be estimated. Intraoperative computed tomography (CT) images of the actual scenario during the treatment would be useful not only for intraoperative planning but also for registering and evaluating the treatment administered to the patient. This information is essential for prospective trials. In this thesis, the feasibility of using a multi-camera optical tracking system to obtain the applicator pose in IOERT scenarios was firstly assessed. Results showed that the accuracy of the applicator pose was below 2 mm in position (mean error of the bevel centre) and 2º in orientation (mean error of the bevel axis and the longitudinal axis), which are within the acceptable range proposed in the recommendation of Task Group 147 (commissioned by the Therapy Committee and the Quality Assurance and Outcomes Improvement Subcommittee of the American Association of Physicists in Medicine [AAPM] to study the localization accuracy with non-radiographic methods such as infrared systems in external beam radiation therapy). An important limitation of this solution is that the actual pose of applicator is superimposed on a patient’s preoperative image. An intraoperative image would provide updated anatomical information and would allow estimating the 3D dose distribution. The second specific study of this thesis evaluated the feasibility of acquiring intraoperative CT images with a CT simulator in real IOERT scenarios. There were no complications in the whole procedure related to the transport step using the subtable and its stretcher or the acquisition of intraoperative CT images in the CT simulator room. The acquired intraoperative studies were used to evaluate the improvement achieved in the dose distribution estimation when compared to that obtained from preoperative CT images, identifying the dominant factor in those estimations (air gap and the surface irregularities, not tissue heterogeneities). Finally, the last specific study focused on assessing several kilovoltage (kV) CT technologies other than CT simulators to acquire intraoperative images for estimating IOERT dose distribution. That would be necessary when a mobile electron LINAC was available in the operating room as transferring the patient to the CT simulator room could not be approved. Our results with an abdominal phantom revealed that a portable CT (BodyTom) and even a LINAC with on-board kV cone-beam CT (TrueBeam) would be suitable for this purpose.Programa Oficial de Doctorado en Multimedia y ComunicacionesPresidente: Joaquín López Herráiz.- Secretario: María Arrate Muñoz Barrutia.- Vocal: Óscar Acosta Tamay

A gantry robot automatic positioning system using computational vision

Este trabalho foi financiado pelo Concurso Anual para Projetos de Investigação, Desenvolvimento, Inovação e Criação Artística (IDI&CA) 2016 do Instituto Politécnico de Lisboa. Código de referência IPL/2017/ROBOTCLEAN/ISELWith the new industrial revolution (industry 4.0) under way, there is a need to automate/digitalize even the simplest processes to keep companies competitive, efficient and secure. This work proposes an automatic and robotic positioning system with position control through the image of video cameras. The objective is to propose this type of automatic system to companies aiming to improve robotic systems operations that are often controlled manually and with associated risks. The developed system was tested in simulation (using Matlab) and in an experimental scale prototype.info:eu-repo/semantics/publishedVersio