Active contours for intensity inhomogeneous image segmentation

La “inhomogeneidad” (falta d'homogeneïtat) d'intensitat és un problema ben conegut en la segmentació d'imatges, la qual cosa afecta la precisió dels mètodes de segmentació basats en la intensitat. En aquesta tesi, es proposen mètodes de contorn actiu basat en fronteres i regions per segmentar imatges inhomogènies. En primer lloc, s'ha proposat un mètode de contorn actiu basat en fronteres mitjançant Diferència de Gaussianes (DoG), que ajuda a segmentar l'estructura global de la imatge. En segon lloc, hem proposat un mètode de contorn actiu basat en regions per corregir i segmentar imatges inhomogènies. S'ha utilitzat un nucli de transformació de fase (phase stretch transform - PST) per calcular noves intensitats mitjanes i camps de polarització, que s'empren per definir una imatge ajustada de polarització. En tercer lloc, s'ha proposat un altre mètode de contorn actiu basat en regions utilitzant un funcional d'energia basat en imatges ajustades locals i globals. El camp de polarització s'aproxima amb una distribució Gaussiana i el biaix de les regions no homogènies es corregeix dividint la imatge original pel camp aproximat de polarització. Finalment, s'ha proposat un mètode híbrid de contorns actius multifàsic (quatre fases) per dividir una imatge de RM cerebral en tres regions diferents: matèria blanca (WM), matèria grisa (GM) i líquid cefaloraquidi (CSF). En aquest treball, també s'ha dissenyat un mètode de post-processat (correcció de píxels) per millorar la precisió de les regions WM, GM i CSF segmentades. S'han utilitzat resultats experimentals tant amb imatges sintètiques com amb imatges reals de RM del cervell per a una comparació quantitativa i qualitativa amb mètodes de contorns actius de l'estat de l'art per mostrar els avantatges de les tècniques de segmentació proposades.La “inhomogeneidad” (falta de homogeneidad) de intensidad es un problema bien conocido en la segmentación de imágenes, lo que afecta la precisión de los métodos de segmentación basados en la intensidad. En esta tesis, se proponen métodos de contorno activo basado en bordes y regiones para segmentar imágenes inhomogéneas. En primer lugar, se ha propuesto un método de contorno activo basado en fronteras mediante Diferencia de Gaussianas (DoG), que ayuda a segmentar la estructura global de la imagen. En segundo lugar, hemos propuesto un método de contorno activo basado en regiones para corregir y segmentar imágenes inhomogéneas. Se ha utilizado un núcleo de transformación de fase (phase stretch transform - PST) para calcular nuevas intensidades medias y campos de polarización, que se emplean para definir una imagen ajustada de polarización. En tercer lugar, se ha propuesto otro método de contorno activo basado en regiones utilizando un funcional de energía basado en imágenes ajustadas locales y globales. El campo de polarización se aproxima con una distribución Gaussiana y el sesgo de las regiones no homogéneas se corrige dividiendo la imagen original por el campo aproximado de polarización. Finalmente, se ha propuesto un método híbrido de contornos activos multifásico (cuatro fases) para dividir una imagen de RM cerebral en tres regiones distintas: materia blanca (WM), materia gris (GM) y líquido cefalorraquídeo (CSF). En este trabajo, también se ha diseñado un método de post-procesado (corrección de píxeles) para mejorar la precisión de las regiones WM, GM y CSF segmentadas. Se han utilizado resultados experimentales tanto con imágenes sintéticas como con imágenes reales de RM del cerebro para una comparación cuantitativa y cualitativa con métodos de contornos activos del estado del arte para mostrar las ventajas de las técnicas de segmentación propuestas.Intensity inhomogeneity is a well-known problem in image segmentation, which affects the accuracy of intensity-based segmentation methods. In this thesis, edge-based and region-based active contour methods are proposed to segment intensity inhomogeneous images. Firstly, we have proposed an edge-based active contour method based on the Difference of Gaussians (DoG), which helps to segment the global structure of the image. Secondly, we have proposed a region-based active contour method to both correct and segment intensity inhomogeneous images. A phase stretch transform (PST) kernel has been used to compute new intensity means and bias field, which are employed to define a bias fitted image. Thirdly, another region-based active contour method has been proposed using an energy functional based on local and global fitted images. Bias field is approximated with a Gaussian distribution and the bias of intensity inhomogeneous regions is corrected by dividing the original image by the approximated bias field. Finally, a hybrid region-based multiphase (four-phase) active contours method has been proposed to partition a brain MR image into three distinct regions: white matter (WM), gray matter (GM) and cerebrospinal fluid (CSF). In this work, a post-processing (pixel correction) method has also been devised to improve the accuracy of the segmented WM, GM and CSF regions. Experimental results with both synthetic and real brain MR images have been used for a quantitative and qualitative comparison with state-of-the-art active contour methods to show the advantages of the proposed segmentation techniques

Semisupervised Soft Mumford-Shah Model for MRI Brain Image Segmentation

One challenge of unsupervised MRI brain image segmentation is the central gray matter due to the faint contrast with respect to the surrounding white matter. In this paper, the necessity of supervised image segmentation is addressed, and a soft Mumford-Shah model is introduced. Then, a framework of semisupervised image segmentation based on soft Mumford-Shah model is developed. The main contribution of this paper lies in the development a framework of a semisupervised soft image segmentation using both Bayesian principle and the principle of soft image segmentation. The developed framework classifies pixels using a semisupervised and interactive way, where the class of a pixel is not only determined by its features but also determined by its distance from those known regions. The developed semisupervised soft segmentation model turns out to be an extension of the unsupervised soft Mumford-Shah model. The framework is then applied to MRI brain image segmentation. Experimental results demonstrate that the developed framework outperforms the state-of-the-art methods of unsupervised segmentation. The new method can produce segmentation as precise as required

Unsupervised Multi Class Segmentation of 3D Images with Intensity Inhomogeneities

Intensity inhomogeneities in images constitute a considerable challenge in image segmentation. In this paper we propose a novel biconvex variational model to tackle this task. We combine a total variation approach for multi class segmentation with a multiplicative model to handle the inhomogeneities. Our method assumes that the image intensity is the product of a smoothly varying part and a component which resembles important image structures such as edges. Therefore, we penalize in addition to the total variation of the label assignment matrix a quadratic difference term to cope with the smoothly varying factor. A critical point of our biconvex functional is computed by a modified proximal alternating linearized minimization method (PALM). We show that the assumptions for the convergence of the algorithm are fulfilled by our model. Various numerical examples demonstrate the very good performance of our method. Particular attention is paid to the segmentation of 3D FIB tomographical images which was indeed the motivation of our work

PET/MRI 및 MR-IGRT를 위한 MRI 기반 합성 CT 생성의 타당성 연구

학위논문 (박사) -- 서울대학교 대학원 : 의과대학 의과학과, 2020. 8. 이재성.Over the past decade, the application of magnetic resonance imaging (MRI) in the field of diagnosis and treatment has increased. MRI provides higher soft-tissue contrast, especially in the brain, abdominal organ, and bone marrow without the expose of ionizing radiation. Hence, simultaneous positron emission tomography/MR (PET/MR) system and MR-image guided radiation therapy (MR-IGRT) system has recently been emerged and currently available for clinical study. One major issue in PET/MR system is attenuation correction from MRI scans for PET quantification and a similar need for the assignment of electron densities to MRI scans for dose calculation can be found in MR-IGRT system. Because the MR signals are related to the proton density and relaxation properties of tissue, not to electron density. To overcome this problem, the method called synthetic CT (sCT), a pseudo CT derived from MR images, has been proposed. In this thesis, studies on generating synthetic CT and investigating the feasibility of using a MR-based synthetic CT for diagnostic and radiotherapy application were presented. Firstly, MR image-based attenuation correction (MR-AC) method using level-set segmentation for brain PET/MRI was developed. To resolve conventional inaccuracy MR-AC problem, we proposed an improved ultrashort echo time MR-AC method that was based on a multiphase level-set algorithm with main magnetic field inhomogeneity correction. We also assessed the feasibility of level-set based MR-AC method, compared with CT-AC and MR-AC provided by the manufacturer of the PET/MRI scanner. Secondly, we proposed sCT generation from the low field MR images using 2D convolution neural network model for MR-IGRT system. This sCT images were compared to the deformed CT generated using the deformable registration being used in the current system. We assessed the feasibility of using sCT for radiation treatment planning from each of the patients with pelvic, thoraic and abdominal region through geometric and dosimetric evaluation.지난 10년간 진단 및 치료분야에서 자기공명영상(Magnetic resonance imaging; MRI) 의 적용이 증가하였다. MRI는 CT와 비교해 추가적인 전리방사선의 피폭없이 뇌, 복부 기관 및 골수 등에서 더 높은 연조직 대비를 제공한다. 따라서 MRI를 적용한 양전자방출단층촬영(Positron emission tomography; PET)/MR 시스템과 MR 영상 유도 방사선 치료 시스템(MR-image guided radiation therapy; MR-IGRT)이 진단 및 치료 방사선분야에 등장하여 임상에 사용되고 있다. PET/MR 시스템의 한 가지 주요 문제는 PET 정량화를 위한 MRI 스캔으로부터의 감쇠 보정이며, MR-IGRT 시스템에서 선량 계산을 위해 MR 영상에 전자 밀도를 할당하는 것과 비슷한 필요성을 찾을 수 있다. 이는 MR 신호가 전자 밀도가 아닌 조직의 양성자 밀도 및 T1, T2 이완 특성과 관련이 있기 때문이다. 이 문제를 극복하기 위해, MR 이미지로부터 유래된 가상의 CT인 합성 CT라 불리는 방법이 제안되었다. 본 학위논문에서는 합성 CT 생성 방법 및 진단 및 방사선 치료에 적용을 위한 MR 영상 기반 합성 CT 사용의 임상적 타당성을 조사하였다. 첫째로, 뇌 PET/MR를 위한 레벨셋 분할을 이용한 MR 이미지 기반 감쇠 보정 방법을 개발하였다. MR 이미지 기반 감쇠 보정의 부정확성은 정량화 오류와 뇌 PET/MRI 연구에서 병변의 잘못된 판독으로 이어진다. 이 문제를 해결하기 위해, 자기장 불균일 보정을 포함한 다상 레벨셋 알고리즘에 기초한 개선된 초단파 에코 시간 MR-AC 방법을 제안하였다. 또한 CT-AC 및 PET/MRI 스캐너 제조업체가 제공한 MR-AC와 비교하여 레벨셋 기반 MR-AC 방법의 임상적 사용가능성을 평가하였다. 둘째로, MR-IGRT 시스템을 위한 심층 컨볼루션 신경망 모델을 사용하여 저필드 MR 이미지에서 생성된 합성 CT 방법를 제안하였다. 이 합성 CT 이미지를 변형 정합을 사용하여 생성된 변형 CT와 비교 하였다. 또한 골반, 흉부 및 복부 환자에서의 기하학적, 선량적 분석을 통해 방사선 치료계획에서의 합성 CT를 사용가능성을 평가하였다.Chapter 1. Introduction 1 1.1. Background 1 1.1.1. The Integration of MRI into Other Medical Devices 1 1.1.2. Chanllenges in the MRI Integrated System 4 1.1.3. Synthetic CT Generation 5 1.2. Purpose of Research 6 Chapter 2. MRI-based Attenuation Correction for PET/MRI 8 2.1. Background 8 2.2. Materials and Methods 10 2.2.1. Brain PET Dataset 19 2.2.2. MR-Based Attenuation Map using Level-Set Algorithm 12 2.2.3. Image Processing and Reconstruction 18 2.3. Results 20 2.4. Discussion 28 Chapter 3. MRI-based synthetic CT generation for MR-IGRT 30 3.1. Background 30 3.2. Materials and Methods 32 3.2.1. MR-dCT Paired DataSet 32 3.2.2. Synthetic CT Generation using 2D CNN 36 3.2.3. Data Analysis 38 3.3. Results 41 3.3.1. Image Comparison 41 3.3.2. Geometric Analysis 49 3.3.3. Dosimetric Analysis 49 3.4. Discussion 56 Chapter 4. Conclusions 59 Bibliography 60 Abstract in Korean (국문 초록) 64Docto