Automatic 3D segmentation of the prostate on magnetic resonance images for radiotherapy planning

Abstract. Accurate segmentation of the prostate, the seminal vesicles, the bladder and the rectum is a crucial step for planning radiotherapy (RT) procedures. Modern radiotherapy protocols have included the delineation of the pelvic organs in magnetic resonance images (MRI), as the guide to the therapeutic beam irradiation over the target organ. However, this task is highly inter and intra-expert variable and may take about 20 minutes per patient, even for trained experts, constituting an important burden in most radiological services. Automatic or semi-automatic segmentation strategies might then improve the efficiency by decreasing the measured times while conserving the required accuracy. This thesis presents a fully automatic prostate segmentation framework that selects the most similar prostates w.r.t. a test prostate image and combines them to estimate the segmentation for the test prostate. A robust multi-scale analysis establishes the set of most similar prostates from a database, independently of the acquisition protocol. Those prostates are then non-rigidly registered towards the test image and fusioned by a linear combination. The proposed approach was evaluated using a MRI public dataset of patients with benign hyperplasia or cancer, following different acquisition protocols, namely 26 endorectal and 24 external. Evaluating under a leave-one-out scheme, results show reliable segmentations, obtaining an average dice coefficient of 79%, when comparing with the expert manual segmentation.La delineación exacta de la próstata, las vesículas seminales, la vejiga y el recto es un paso fundamental para el planeamiento de procedimientos de radioterapia. Protocolos modernos han incluido la delineación de los órganos pélvicos en imágenes de resonancia magnética (IRM), como la guia para la irradiación del haz terapéutico sobre el órgano objetivo. Sin embargo, esta tarea es altamente variable intra e inter-experto y puede tomar al rededor de 20 minutos por paciente, incluso para expertos entrenados, convirtiéndose en una carga importante en la mayoría de los servicios de radiología. Métodos automáticos o semi-automáticos podrían mejorar la eficiencia disminuyendo los tiempos medidos mientras se conserva la precisión requerida. Este trabajo presenta una estrategia de segmentación de la próstata completamente automático que selecciona las prostatas más similares con respecto a una imagen de resonancia magnética de prueba y combina las delineaciones asociadas a dichas imágenes para estimar la segmentación de la imagen de prueba. Un análisis multiescala robusto permite establecer el conjunto de las próstatas más parecidas de una base de datos, independiente del protocolo de adquisición. Las imágenes seleccionadas son registradas de forma no rigida con respecto a la imagen de prueba y luego son fusionadas mediante una combinación lineal. El enfoque propuesto fue evaluado utilizando un conjunto público de imágenes de resonancia magnética de pacientes con hiperplasia benigna o con cancer, con diferentes protocolos de adquisición, esto es 26 externas y 24 endorectales. Este trabajo fue evaluado bajo un esquema leave-one-out, cuyos resultados mostraron segmentaciones confiables, obteniendo un DSC promedio de 79%, cuando se compararon los resultados obtenidos con las segmentaciones manuales de expertos.Maestrí

Characterization and modelling of complex motion patterns

Movement analysis is the principle of any interaction with the world and the survival of living beings completely depends on the effciency of such analysis. Visual systems have remarkably developed eficient mechanisms that analyze motion at different levels, allowing to recognize objects in dynamical and cluttered environments. In artificial vision, there exist a wide spectrum of applications for which the study of complex movements is crucial to recover salient information. Yet each domain may be different in terms of scenarios, complexity and relationships, a common denominator is that all of them require a dynamic understanding that captures the relevant information. Overall, current strategies are highly dependent on the appearance characterization and usually they are restricted to controlled scenarios. This thesis proposes a computational framework that is inspired in known motion perception mechanisms and structured as a set of modules. Each module is in due turn composed of a set of computational strategies that provide qualitative and quantitative descriptions of the dynamic associated to a particular movement. Diverse applications were herein considered and an extensive validation was performed for each of them. Each of the proposed strategies has shown to be reliable at capturing the dynamic patterns of different tasks, identifying, recognizing, tracking and even segmenting objects in sequences of video.Resumen. El análisis del movimiento es el principio de cualquier interacción con el mundo y la supervivencia de los seres vivos depende completamente de la eficiencia de este tipo de análisis. Los sistemas visuales notablemente han desarrollado mecanismos eficientes que analizan el movimiento en diferentes niveles, lo cual permite reconocer objetos en entornos dinámicos y saturados. En visión artificial existe un amplio espectro de aplicaciones para las cuales el estudio de los movimientos complejos es crucial para recuperar información saliente. A pesar de que cada dominio puede ser diferente en términos de los escenarios, la complejidad y las relaciones de los objetos en movimiento, un común denominador es que todos ellos requieren una comprensión dinámica para capturar información relevante. En general, las estrategias actuales son altamente dependientes de la caracterización de la apariencia y por lo general están restringidos a escenarios controlados. Esta tesis propone un marco computacional que se inspira en los mecanismos de percepción de movimiento conocidas y esta estructurado como un conjunto de módulos. Cada módulo esta a su vez compuesto por un conjunto de estrategias computacionales que proporcionan descripciones cualitativas y cuantitativas de la dinámica asociada a un movimiento particular. Diversas aplicaciones fueron consideradas en este trabajo y una extensa validación se llevó a cabo para cada uno de ellas. Cada una de las estrategias propuestas ha demostrado ser fiable en la captura de los patrones dinámicos de diferentes tareas identificando, reconociendo, siguiendo e incluso segmentando objetos en secuencias de video.Doctorad

Robust density modelling using the student's t-distribution for human action recognition

The extraction of human features from videos is often inaccurate and prone to outliers. Such outliers can severely affect density modelling when the Gaussian distribution is used as the model since it is highly sensitive to outliers. The Gaussian distribution is also often used as base component of graphical models for recognising human actions in the videos (hidden Markov model and others) and the presence of outliers can significantly affect the recognition accuracy. In contrast, the Student's t-distribution is more robust to outliers and can be exploited to improve the recognition rate in the presence of abnormal data. In this paper, we present an HMM which uses mixtures of t-distributions as observation probabilities and show how experiments over two well-known datasets (Weizmann, MuHAVi) reported a remarkable improvement in classification accuracy. © 2011 IEEE

Development of an image guidance system for laparoscopic liver surgery and evaluation of optical and computer vision techniques for the assessment of liver tissue

Introduction: Liver resection is increasingly being carried out via the laparoscopic approach (keyhole surgery) because there is mounting evidence that it benefits patients by reducing pain and length of hospitalisation. There are however ongoing concerns about oncological radicality (i.e. ability to completely remove cancer) and an inability to control massive haemorrhage. These issues can partially be attributed to a loss of sensation such as depth perception, tactile feedback and a reduced field of view. Utilisation of optical imaging and computer vision may be able to compensate for some of the lost sensory input because these modalities can facilitate visualisation of liver tissue and structural anatomy. Their use in laparoscopy is attractive because it is easy to adapt or integrate with existing technology. The aim of this thesis is to explore to what extent this technology can aid in the detection of normal and abnormal liver tissue and structures. / Methods: The current state of the art for optical imaging and computer vision in laparoscopic liver surgery is assessed in a systematic review. Evaluation of confocal laser endomicroscopy is carried out on a murine and porcine model of liver disease. Multispectral near infrared imaging is evaluated on ex-vivo liver specimen. Video magnification is assessed on a mechanical flow phantom and a porcine model of liver disease. The latter model was also employed to develop a computer vision based image guidance system for laparoscopic liver surgery. This image guidance system is further evaluated in a clinical feasibility study. Where appropriate, experimental findings are substantiated with statistical analysis. / Results: Use of confocal laser endomicroscopy enabled discrimination between cancer and normal liver tissue with a sub-millimetre precision. This technology also made it possible to verify the adequacy of thermal liver ablation. Multispectral imaging, at specific wavelengths was shown to have the potential to highlight the presence of colorectal and hepatocellular cancer. An image reprocessing algorithm is proposed to simplify visual interpretation of the resulting images. It is shown that video magnification can determine the presence of pulsatile motion but that it cannot reliably determine the extent of motion. Development and performance metrics of an image guidance system for laparoscopic liver surgery are outlined. The system was found to improve intraoperative orientation more development work is however required to enable reliable prediction of oncological margins. / Discussion: The results in this thesis indicate that confocal laser endomicroscopy and image guidance systems have reached a development stage where their intraoperative use may benefit surgeons by visualising features of liver anatomy and tissue characteristics. Video magnification and multispectral imaging require more development and suggestions are made to direct this work. It is also highlighted that it is crucial to standardise assessment methods for these technologies which will allow a more direct comparison between the outcomes of different groups. Limited imaging depth is a major restriction of these technologies but this may be overcome by combining them with preoperatively obtained imaging data. Just like laparoscopy, optical imaging and computer vision use functions of light, a shared characteristic that makes their combined use complementary