Cardiac motion and deformation estimation in tagged magnetic resonance imaging

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Electrónica Médica)Cardiovascular diseases are the main cause of death in Europe, with an estimate of 4.3 million deaths each year. The assessment of the regional wall deformation is a relevant clinical indicator, and can be used to detect several cardiac lesions. Nowadays, this study can be performed using several image modalities. In the current thesis, we focus on tagged Magnetic Resonance imaging (t-MRI) technique. Such technique allows acquiring images with tags on the myocardium, which deform with the muscle. The present thesis intends to assess the left ventricle (LV) deformation using radial and circumferential strain. To compute such strain values, both endo- and epicardial contours of the LV are required. As such, a new framework to automatically assess the LV function is proposed. This framework presents: (i) an automatic segmentation technique, based on a tag suppression strategy followed by an active contour segmentation method, and (ii) a tracking approach to extract myocardial deformation, based on a non-rigid registration method. The automatic segmentation uses the B-spline Explicit Active Surface framework, which was previously applied in ultra-sound and cine-MRI images. In both cases, a real-time and accurate contour was achieved. Regarding the registration step, starting from a state-of-art approach, termed sequential 2D, we suggest a new method (termed sequential 2D+t), where the temporal information is included on the model. The tracking methods were first tested on synthetic data to study the registration parameters influence. Furthermore, the proposed and original methods were applied on porcine data with myocardial ischemia. Both methods were able to detect dysfunctional regions. A comparison between the strain curve in the sequential 2D and sequential 2D+t strategies was also shown. As conclusion, a smoothing effect in the strain curve was detected in the sequential 2D+t strategy. The validation of the segmentation approach uses a human dataset. A comparison between the manual contour and the proposed segmentation method results was performed. The results, suggest that proposed method has an acceptable performance, removing the tedious task related with manual segmentation and the intra-observer variability. Finally, a comparison between the proposed framework and the currently available commercial software was performed. The commercial software results were obtained from core-lab analysis. An acceptable result (r = 0.601) was achieved when comparing the strain peak values. Importantly, the proposed framework appears to present a more acceptable result.As doenças cardiovasculares são a principal causa de morte na Europa, com aproximadamente 4.7 milhões de mortes por ano. A avaliação da deformação do miocárdio a um nível local é um importante indicador clínico e pode ser usado para a deteção de lesões cardíacas. Este estudo é normalmente realizado usando várias modalidades de imagem médica. Nesta tese, a Resonância Magnética (RM) marcada foi a técnica selecionada. Estas imagens têm marcadores no músculo cardíaco, os quais se deformam com o miocárdio e podem ser usados para o estudo da deformação cardíaca. Nesta tese, pretende-se estudar a deformação radial e circunferencial do ventrículo esquerdo (VE). Assim, um contorno do endo- e epicárdio no VE é essencial. Desta forma, uma ferramenta para o estudo da deformação do VE foi desenvolvida. Esta possui: (i) um método de segmentação automático, usando uma estratégia de supressão dos marcadores, seguido de uma segmentação c um contorno ativo, e (ii) um método de tracking para determinação da deformação cardíaca, baseado em registo não rígido. A segmentação automática utiliza a ferramenta B-spline Explicit Active Surface, que foi previamente aplicada em imagens de ultrassons e cine-RM. Em ambos os casos, uma segmentação em tempo real e com elevada exatidão foi alcançada. Vários esquemas de registo foram apresentados. Neste ponto, começando com uma técnica do estado da arte (designada de sequencial 2D), uma nova metodologia foi proposta (sequencial 2D+t), onde a informação temporal é incorporada no modelo. De forma a analisar a influência dos parâmetros do registo, estes foram estudados num dataset sintético. De seguida, os diferentes esquemas de registo foram testados num dataset suíno com isquemia. Ambos os métodos foram capazes de detetar as regiões disfuncionais. De igual forma, utilizando as curvas de deformação obtidas para cada um dos métodos propostos, foi possível observar uma suavização na direção temporal para o método sequencial 2D+t. Relativamente à segmentação, esta foi validada com um dataset humano. Um contorno manual foi comparado com o obtido pelo método proposto. Os resultados sugerem que a nova estratégia é aceitável, sendo mais rápida do que a realização de um contorno manual e eliminando a variabilidade entre observadores. Por fim, realizou-se uma comparação entre a ferramenta proposta e um software comercial (com análise de core-lab). A comparação entre os valores de pico da deformação exibe uma correlação plausível (r=0.601). Contudo, é importante notar, que a nova ferramenta tende a apresentar um resultado mais aceitável

Dual consistency loss for contour-aware segmentation in medical images

Medical image segmentation is a paramount task for several clinical applications, namely for the diagnosis of pathologies, for treatment planning, and for aiding image-guided surgeries. With the development of deep learning, Convolutional Neural Networks (CNN) have become the state-of-the-art for medical image segmentation. However, issues are still raised concerning the precise object boundary delineation, since traditional CNNs can produce non-smooth segmentations with boundary discontinuities. In this work, a U-shaped CNN architecture is proposed to generate both pixel-wise segmentation and probabilistic contour maps of the object to segment, in order to generate reliable segmentations at the object's boundaries. Moreover, since the segmentation and contour maps must be inherently related to each other, a dual consistency loss that relates the two outputs of the network is proposed. Thus, the network is enforced to consistently learn the segmentation and contour delineation tasks during the training. The proposed method was applied and validated on a public dataset of cardiac 3D ultrasound images of the left ventricle. The results obtained showed the good performance of the method and its applicability for the cardiac dataset, showing its potential to be used in clinical practice for medical image segmentation.Clinical Relevance-The proposed network with dual consistency loss scheme can improve the performance of state-of-the-art CNNs for medical image segmentation, proving its value to be applied for computer-aided diagnosis.- (undefined

A review of image processing methods for fetal head and brain analysis in ultrasound images

Background and objective: Examination of head shape and brain during the fetal period is paramount to evaluate head growth, predict neurodevelopment, and to diagnose fetal abnormalities. Prenatal ultrasound is the most used imaging modality to perform this evaluation. However, manual interpretation of these images is challenging and thus, image processing methods to aid this task have been proposed in the literature. This article aims to present a review of these state-of-the-art methods. Methods: In this work, it is intended to analyze and categorize the different image processing methods to evaluate fetal head and brain in ultrasound imaging. For that, a total of 109 articles published since 2010 were analyzed. Different applications are covered in this review, namely analysis of head shape and inner structures of the brain, standard clinical planes identification, fetal development analysis, and methods for image processing enhancement. Results: For each application, the reviewed techniques are categorized according to their theoretical approach, and the more suitable image processing methods to accurately analyze the head and brain are identified. Furthermore, future research needs are discussed. Finally, topics whose research is lacking in the literature are outlined, along with new fields of applications. Conclusions: A multitude of image processing methods has been proposed for fetal head and brain analysis. Summarily, techniques from different categories showed their potential to improve clinical practice. Nevertheless, further research must be conducted to potentiate the current methods, especially for 3D imaging analysis and acquisition and for abnormality detection. (c) 2022 Elsevier B.V. All rights reserved.FCT - Fundação para a Ciência e a Tecnologia(UIDB/00319/2020)This work was funded by projects “NORTE-01–0145-FEDER- 0 0 0 059 , NORTE-01-0145-FEDER-024300 and “NORTE-01–0145- FEDER-0 0 0 045 , supported by Northern Portugal Regional Opera- tional Programme (Norte2020), under the Portugal 2020 Partner- ship Agreement, through the European Regional Development Fund (FEDER). It was also funded by national funds, through the FCT – Fundação para a Ciência e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020 and by FCT and FCT/MCTES in the scope of the projects UIDB/05549/2020 and UIDP/05549/2020 . The authors also acknowledge support from FCT and the Euro- pean Social Found, through Programa Operacional Capital Humano (POCH), in the scope of the PhD grant SFRH/BD/136670/2018 and SFRH/BD/136721/2018

Automatic 3D aortic annulus sizing by computed tomography in the planning of transcatheter aortic valve implantation

Background: Accurate imaging assessment of aortic annulus (AoA) dimension is paramount to decide on the correct transcatheter heart valve (THV) size for patients undergoing transcatheter aortic valve implantation (TAVI). We evaluated the feasibility and accuracy of a novel automatic framework for multi detector row computed tomography (MDCT)-based TAVI planning. Methods: Among 122 consecutive patients undergoing TAVI and retrospectively reviewed for this study, 104 patients with preoperative MDCT of sufficient quality were enrolled and analyzed with the proposed software. Fully automatic (FA) and semi-automatic (SA) AoA measurements were compared to manual measurements, with both automated and manual-based interobserver variability (IOV) being assessed. Finally, the effect of these measures on hypothetically selected THV size was evaluated against the implanted size, as well as with respect to manually-derived sizes. Results: FA analysis was feasible in 92.3% of the cases, increasing to 100% if using the SA approach. Automatically-extracted measurements showed excellent agreement with manually-derived ones, with small biases and narrow limits of agreement, and comparable to the interobserver agreement. The SA approach presented a statistically lower IOV than manual analysis, showing the potential to reduce interobserver sizing disagreements. Moreover, the automated approaches displayed close agreement with the implanted sizes, similar to the ones obtained by the experts. Conclusion: The proposed automatic framework provides an accurate and robust tool for AoA measurements and THV sizing in patients undergoing TAVI.FCT - Fundação para a Ciência e a Tecnologia, Portugal, and the European Social Found, European Union, through the Programa Operacional Capital Humano (POCH) in the scope of the PhD grants SFRH/BD/93443/2013 (S. Queirós) and SFRH/BD/95438/2013 (P. Morais), and the project ‘PersonalizedNOS (01-0145-FEDER-000013)’ co-funded by Programa Operacional Regional do Norte (QREN), through Fundo Europeu de Desenvolvimento Regional (FEDER)info:eu-repo/semantics/publishedVersio

Fast left ventricle tracking in CMR images using localized anatomical affine optical flow

"Progress in Biomedical Optics and Imaging, vol. 16, nr. 41"In daily cardiology practice, assessment of left ventricular (LV) global function using non-invasive imaging remains central for the diagnosis and follow-up of patients with cardiovascular diseases. Despite the different methodologies currently accessible for LV segmentation in cardiac magnetic resonance (CMR) images, a fast and complete LV delineation is still limitedly available for routine use. In this study, a localized anatomically constrained affine optical flow method is proposed for fast and automatic LV tracking throughout the full cardiac cycle in short-axis CMR images. Starting from an automatically delineated LV in the end-diastolic frame, the endocardial and epicardial boundaries are propagated by estimating the motion between adjacent cardiac phases using optical flow. In order to reduce the computational burden, the motion is only estimated in an anatomical region of interest around the tracked boundaries and subsequently integrated into a local affine motion model. Such localized estimation enables to capture complex motion patterns, while still being spatially consistent. The method was validated on 45 CMR datasets taken from the 2009 MICCAI LV segmentation challenge. The proposed approach proved to be robust and efficient, with an average distance error of 2.1 mm and a correlation with reference ejection fraction of 0.98 (1.9 ± 4.5%). Moreover, it showed to be fast, taking 5 seconds for the tracking of a full 4D dataset (30 ms per image). Overall, a novel fast, robust and accurate LV tracking methodology was proposed, enabling accurate assessment of relevant global function cardiac indices, such as volumes and ejection fraction.The authors acknowledge funding support from FCT - Fundação para a Ciência e Tecnologia, Portugal, in the scope of the PhD grant SFRH/BD/93443/2013 and the project EXPL/BBB-BMD/2473/2013. D. Barbosa would also like to acknowledge the kind support of the Fundação Luso-Americana para o Desenvolvimento (FLAD), which has funded the travel costs for participation at SPIE Medical Imaging 2015.info:eu-repo/semantics/publishedVersio

Fetal head circumference delineation using convolutional neural networks with registration-based ellipse fitting

Examination of head shape during the fetal period is an important task to evaluate head growth and to diagnose fetal abnormalities. Traditional clinical practice frequently relies on the estimation of head circumference (HC) from 2D ultrasound (US) images by manually fitting an ellipse to the fetal skull. However, this process tends to be prone to observer variability, and therefore, automatic approaches for HC delineation can bring added value for clinical practice. In this paper, an automatic method to accurately delineate the fetal head in US images is proposed. The proposed method is divided into two stages: (i) head delineation through a regression convolutional neural network (CNN) that estimates a gaussian-like map of the head contour; and (ii) robust ellipse fitting using a registration-based approach that combines the random sample consensus (RANSAC) and iterative closest point (ICP) algorithms. The proposed method was applied to the HC18 Challenge dataset, which contains 999 training and 335 testing images. Experiments showed that the proposed strategy achieved a mean average difference of -0.11 ± 2.67 mm and a Dice coefficient of 97.95 ± 1.12% against manual annotation, outperforming other approaches in the literature. The obtained results showed the effectiveness of the proposed method for HC delineation, suggesting its potential to be used in clinical practice for head shape assessment.FCT - Fundação para a Ciência e a Tecnologia(UIDB/00319/2020

3D facial landmark localization for cephalometric analysis

Cephalometric analysis is an important and routine task in the medical field to assess craniofacial development and to diagnose cranial deformities and midline facial abnormalities. The advance of 3D digital techniques potentiated the development of 3D cephalometry, which includes the localization of cephalometric landmarks in the 3D models. However, manual labeling is still applied, being a tedious and time-consuming task, highly prone to intra/inter-observer variability. In this paper, a framework to automatically locate cephalometric landmarks in 3D facial models is presented. The landmark detector is divided into two stages: (i) creation of 2D maps representative of the 3D model; and (ii) landmarks' detection through a regression convolutional neural network (CNN). In the first step, the 3D facial model is transformed to 2D maps retrieved from 3D shape descriptors. In the second stage, a CNN is used to estimate a probability map for each landmark using the 2D representations as input. The detection method was evaluated in three different datasets of 3D facial models, namely the Texas 3DFR, the BU3DFE, and the Bosphorus databases. An average distance error of 2.3, 3.0, and 3.2 mm were obtained for the landmarks evaluated on each dataset. The obtained results demonstrated the accuracy of the method in different 3D facial datasets with a performance competitive to the state-of-the-art methods, allowing to prove its versability to different 3D models. Clinical Relevance - Overall, the performance of the landmark detector demonstrated its potential to be used for 3D cephalometric analysis.FCT - Fundação para a Ciência e a Tecnologia(LASI-LA/P/0104/2020

Developing a medical training game for visual assessment of head deformities in infants

Anatomical evaluation of an infant's head shape is an important task in clinical practice to diagnose cranial deformities. In the first stage of diagnosis, the current practice mainly relies on visual head inspection. However, this is a difficult task and subjective between physicians. Thus, medical training is paramount to correctly perform the visual head shape assessment to guarantee a safe diagnosis. The main goal of this work is the development of a prototype of a medical game called Head Shape Inspector to train individuals to perform head shape analysis. During the game, the player categorizes 3D surfaces of infants' heads according to their cranial deformity. Moreover, the game also allows the user to visualize anthropometric measurements of the head, required in clinical practice to quantify the deformities, to aid the categorization process. Preliminary experiments showed that playing the game can improve the visual inspection skills, suggesting the potential of the game to be used for medical training.FCT - Fundação para a Ciência e a Tecnologia(SFRH/BD/131545/2017). funded by project “NORTE-01-0145- FEDER-000045”, supported by Northern Portugal Regional Operational Programme (Norte2020), under the Portugal 2020 Partnership Agreement, through the European Regional Development Fund (FEDER). This project was also funded by national funds (PIDDAC), through the FCT – Fundação para a Ciência e Tecnologia and FCT/MCTES under the scope of the project UIDB/05549/2020 and UIDP/05549/2020. The authors also acknowledge support from FCT and the European Social Found, through Programa Operacional Capital Humano (POCH), in the scope of the PhD grant SFRH/BD/136670/2018, SFRH/BD/136721/2018, and SFRH/BD/131545/2017

Automatic strategy for extraction of anthropometric measurements for the diagnostic and evaluation of deformational plagiocephaly from infant’s head models

Deformational Plagiocephaly (DP) refers to an asymmetrical distortion of an infant's skull resulting from external forces applied over time. The diagnosis of this condition is performed using asymmetry indexes that are estimated from specific anatomical landmarks, whose are manually defined on head models acquired using laser scans. However, this manual identification is susceptible to intra-/inter-observer variability, being also time-consuming. Therefore, automatic strategies for the identification of the landmarks and, consequently, extraction of asymmetry indexes, are claimed. A novel pipeline to automatically identify these landmarks on 3D head models and to estimate the relevant cranial asymmetry indexes is proposed. Thus, a template database is created and then aligned with the unlabelled patient through an iterative closest point (ICP) strategy. Here, an initial rigid alignment followed by an affine one are applied to remove global misalignments between each template and the patient. Next, a non-rigid alignment is used to deform the template information to the patient-specific shape. The final position of each landmark is computed as a local weight average of all candidate results. From the identified landmarks, a head's coordinate system is automatically estimated and later used to estimate cranial asymmetry indexes. The proposed framework was evaluated in 15 synthetic infant head's model. Overall, the results demonstrated the accuracy of the identification strategy, with a mean average distance of 2.8 +/- 0.6 mm between the identified landmarks and the ground-truth. Moreover, for the estimation of cranial asymmetry indexes, a performance comparable to the inter-observer variability was achieved.The present submission corresponds to original research work of the authors and has never been submitted elsewhere. Moreover, this work was funded by the project NORTE-01-0145-FEDER-024300, supported by Northern Portugal Regional Operational Programme (Norte2020), under the Portugal 2020 Partnership Agreement, through the European Regional Development Fund (FEDER). Moreover, this work has been also supported by FCT - Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2019. Furthermore, the authors acknowledge FCT, Portugal, and the European Social Found, European Union, for funding support through the "Programa Operacional Capital Humano" (POCH) in the scope of the PhD grants SFRH/BD/136721/2018 (Bruno Oliveira), SFRH/BD/136670/2018 (Helena R. Torres), and SFRH/BD/131545/2017 (Fernando Veloso)