57 research outputs found

    Left Ventricle: Fully Automated Segmentation Based on Spatiotemporal Continuity and Myocardium Information in Cine Cardiac Magnetic Resonance Imaging (LV-FAST)

    Get PDF
    CMR quantification of LV chamber volumes typically and manually defines the basal-most LV, which adds processing time and user-dependence. This study developed an LV segmentation method that is fully automated based on the spatiotemporal continuity of the LV (LV-FAST). An iteratively decreasing threshold region growing approach was used first from the midventricle to the apex, until the LV area and shape discontinued, and then from midventricle to the base, until less than 50% of the myocardium circumference was observable. Region growth was constrained by LV spatiotemporal continuity to improve robustness of apical and basal segmentations. The LV-FAST method was compared with manual tracing on cardiac cine MRI data of 45 consecutive patients. Of the 45 patients, LV-FAST and manual selection identified the same apical slices at both ED and ES and the same basal slices at both ED and ES in 38, 38, 38, and 41 cases, respectively, and their measurements agreed within −1.6 ± 8.7 mL, −1.4 ± 7.8 mL, and 1.0 ± 5.8% for EDV, ESV, and EF, respectively. LV-FAST allowed LV volume-time course quantitatively measured within 3 seconds on a standard desktop computer, which is fast and accurate for processing the cine volumetric cardiac MRI data, and enables LV filling course quantification over the cardiac cycle

    Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved?

    Get PDF
    Delineation of the left ventricular cavity, myocardium, and right ventricle from cardiac magnetic resonance images (multi-slice 2-D cine MRI) is a common clinical task to establish diagnosis. The automation of the corresponding tasks has thus been the subject of intense research over the past decades. In this paper, we introduce the "Automatic Cardiac Diagnosis Challenge" dataset (ACDC), the largest publicly available and fully annotated dataset for the purpose of cardiac MRI (CMR) assessment. The dataset contains data from 150 multi-equipments CMRI recordings with reference measurements and classification from two medical experts. The overarching objective of this paper is to measure how far state-of-the-art deep learning methods can go at assessing CMRI, i.e., segmenting the myocardium and the two ventricles as well as classifying pathologies. In the wake of the 2017 MICCAI-ACDC challenge, we report results from deep learning methods provided by nine research groups for the segmentation task and four groups for the classification task. Results show that the best methods faithfully reproduce the expert analysis, leading to a mean value of 0.97 correlation score for the automatic extraction of clinical indices and an accuracy of 0.96 for automatic diagnosis. These results clearly open the door to highly accurate and fully automatic analysis of cardiac CMRI. We also identify scenarios for which deep learning methods are still failing. Both the dataset and detailed results are publicly available online, while the platform will remain open for new submissions

    Automatic segmentation in CMR - Development and validation of algorithms for left ventricular function, myocardium at risk and myocardial infarction

    Get PDF
    In this thesis four new algorithms are presented for automatic segmentation in cardiovascular magnetic resonance (CMR); automatic segmentation of the left ventricle, myocardial infarction, and myocardium at risk in two different image types. All four algorithms were implemented in freely available software for image analysis and were validated against reference delineations with a low bias and high regional agreement. CMR is the most accurate and reproducible method for assessment of left ventricular mass and volumes and reference standard for assessment of myocardial infarction. CMR is also validated against single photon emission computed tomography (SPECT) for assessment of myocardium at risk up to one week after acute myocardial infarction. However, the clinical standard for quantification of left ventricular mass and volumes is manual delineation which has been shown to have a large bias between observers from different sites and for myocardium at risk and myocardial infarction there is no clinical standard due to varying results shown for the previously suggested threshold methods. The new automatic algorithms were all based on intensity classification by Expectation Maximization (EM) and incorporation of a priori information specific for each application. Validation was performed in large cohorts of patients with regards to bias in clinical parameters and regional agreement as Dice Similarity Coefficient (DSC). Further, images with reference delineation of the left ventricle were made available for future benchmarking of left ventricular segmentation, and the new automatic algorithms for segmentation of myocardium at risk and myocardial infarction were directly compared to the previously suggested intensity threshold methods. Combining intensity classification by EM with a priori information as in the new automatic algorithms was shown superior to previous methods and specifically to the previously suggested threshold methods for myocardium at risk and myocardial infarction. Added value of using a priori information and intensity correction was shown significant measured by DSC even though not significant for bias. For the previously suggested methods of infarct quantification a poorer result was found in the new multi-center, multi-vendor patient data than in the original validation in animal studies or single center patient studies. Thus, the results in this thesis also show the importance ofusing both bias and DSC for validation and performing validation in images of representative quality as in multi-center, multi-vendor patient studies

    Comparison of T1-maps and late gadolinium enhancement images in the detection of Myocardial Fibrosis in Hypertrophic Cardiomyopathy

    Get PDF
    Tese de Mestrado Integrado, Engenharia Biomédica e Biofísica, 2021, Universidade de Lisboa, Faculdade de CiênciasHypertrophic Cardiomyopathy (HCM) is characterized as an abnormal and heterogeneous thickening of the Left Ventricle (LV) wall. HCM is the leading cause of sudden cardiac death in children and young people, with an estimated prevalence of 1:500 in the general population. Myocardial fibrosis is the key histopathological hallmark in HCM and is presented in different patterns: interstitial diffuse fibrosis which, if not treated, evolves to replacement fibrosis. Cardiac Magnetic Resonance (CMR) imaging has been used for the detection and quantification of myocardial fibrosis. The Late Gadolinium Enhancement (LGE) technique is the primary tool for non-invasive tissue characterization, particularly for replacement fibrosis. Conversely, T1 mapping is commonly used for the detection of diffuse interstitial fibrosis, frequently missed using LGE. The clear disadvantage of LGE relies on the need to inject contrast agents that, despite being considered safe, may accumulate in the body for years and potentially cause nephrogenic systemic fibrosis in end-stage chronic kidney disease patients. The capability of native T1 mapping identifying not only diffuse interstitial but also replacement fibrosis would play a pivotal role in HCM diagnosis. The potential of native T1 mapping for a cheaper and non-contrast HCM assessment needs to be further studied. A database of 15 HCM patients, without and with fibrosis, was acquired at Hospital da Luz, Lisboa. In this project, (1) an extensive image preprocessing pipeline was applied to aim for the best possible spatial alignment of the myocardium between the two modalities (native T1 mapping and LGE); (2) the mean native T1 values of individuals without and with the presence of scarred tissue were examined; (3) a pixel-by-pixel analysis was performed to investigate if there is a correlation between fibrotic tissue in LGE and hyperintense regions in native T1 mapping; (4) a Texture Analysis (TA) was performed to study if texture information of native T1 mapping could provide differential diagnosis or prognostic information beyond mean T1 values. The first step was the most longstanding and challenging process. The registration of T1 and LGE images is difficult due to the different intensity profiles. The registration of the myocardial masks using a model with rigid, affine, and free-form deformation transformations revealed to be the best methodology. Mean native T1 values were not increased in patients with scarred tissue. Regarding the third aim, no clear intensity correlation between techniques was observed, which suggests the need for the TA. Seven features (in a total of 350) were selected to distinguish between cardiac segments without and with fibrotic tissue using a ML (Machine Learning) algorithm that finds the features that most contribute to distinguish the two groups. Four first-order features distinguish the cohorts due to the presence of scarred tissue - hyperintense zones - and three texture features suggest that the fibrotic remodeling in the myocardium of HCM patients might be associated with a more heterogeneous tissue texture. A Receiver Operating Characteristics (ROC) analysis was performed and revealed that the Cluster Prominence is the feature that best distinguishes sections without and with fibrotic tissue (accuracy of 70%) but with low sensitivity (65%) and low specifity (64%). A model with the 90th Percentile feature revealed an accuracy of 64%, sensitivity of 71% and specificity of 57%. Studying the Variance feature, the achieved accuracy was 63%, with 66% of sensitivity and 60% of specificity. The remaining features yielded lower accuracy values than the ones previously mentioned, but all of them higher than 50%. The low sensitivity and specificity of the best three models suggest that analysing these values considering these features may help cardiologists to identify focal fibrosis regions and avoid contrast injection methods but may not provide an accurate diagnosis of the presence of fibrotic tissue alone. Further research on the correlation of native T1 mapping and LGE cardiac images is highly recommended to develop a contrast-agent-free technology to replace LGE.A Cardiomiopatia Hipertrófica (do inglês, HCM) é descrita por um espessamento anormal e heterogéneo da parede do ventrículo esquerdo (do inglês, LV). A HCM é a principal causa de morte súbita cardíaca em crianças e jovens, com uma prevalência estimada de 1:500 na população em geral. Esta doença é, na sua maioria, hereditária, e causada por variantes nos genes da proteína do sarcómero (predominantemente MYH7 e MYBPC3). A fibrose do miocárdio é a principal marca histopatológica da HCM e apresenta-se em diferentes padrões: fibrose intersticial difusa que, se não tratada, evolui para fibrose focal. A fibrose é caracterizada por um aumento da deposição de colagénio, que afeta a viabilidade do miocárdio. A imagem de Ressonância Magnética Cardíaca (do inglês, CMR) tem sido usada para a deteção e quantificação de fibrose do miocárdio. A técnica de Realce Tardio (do inglês, LGE) é a principal ferramenta para caracterização não invasiva de tecidos, particularmente de fibrose focal. Em contrapartida, o mapeamento T1 é a técnica mais utilizada para deteção de fibrose intersticial difusa, frequentemente não detetada usando LGE. A clara desvantagem do LGE reside na necessidade de injeção de agentes de contraste. Apesar destes agentes serem considerados seguros, frequentemente causam alergias, podem-se acumular no corpo, por anos, e podem causar fibrose sistémica nefrogénica em pacientes com doença renal crónica terminal. A capacidade do mapeamento T1 nativo identificar, não só a fibrose intersticial difusa mas também a fibrose focal, desempenharia um papel fundamental no diagnóstico da HCM. Consequentemente, é de extrema importância estudar o potencial do mapeamento T1 nativo para uma avaliação desta patologia sem contraste e, desta forma, eliminar os riscos associados à injeção de contraste e reduzir os custos e tempo de preparação associados à utilização de gadolínio. Uma base de dados de 15 pacientes com HCM, com e sem fibrose, previamente adquirida no Hospital da Luz, Lisboa, foi analisada. Neste projeto, (1) aplicou-se um extenso conjunto de passos de pré-processamento de imagem para alcançar a melhor técnica possível de alinhamento espacial do miocárdio entre as duas modalidades (mapeamento T1 nativo e Realce Tardio); (2) após a divisão do miocárdio em 6 secções, como sugerido pela American Heart Association, examinaram-se os valores médios de T1, para cada secção, de indivíduos sem e com presença de tecido cicatricial; (3) realizou-se uma análise pixel a pixel para investigar se existe uma correlação entre o tecido fibrótico em LGE e as regiões hiperintensas no mapeamento T1 nativo; (4) realizou-se uma análise de textura para estudar se a informação de textura do mapeamento T1 nativo poderia fornecer um diagnóstico diferencial ou informação prognóstica além dos valores médios de T1 nativo. A primeira etapa revelou ser o processo mais demorado e desafiante. O batimento cardíaco e o ciclo respiratório representam dois desafios no registo de imagens cardíacas. Para além dos comuns desafios em alinhamento de imagens cardíacas da mesma modalidade, alinhar imagens de diferentes modalidades torna-se um processo mais complexo. Em primeiro lugar, o registo de imagens T1 e de LGE é dificultado pelos distintos perfis de intensidade das duas modalidades. Em segundo lugar, a aquisição de imagens de Realce Tardio ocorre cerca de 7 minutos após a aquisição do mapeamento T1, e o movimento dos pacientes durante este intervalo de tempo é uma fonte adicional de erro. Diferentes softwares foram utilizados, e uma imagem sintética ponderada em T1 foi criada, com o intuito de apresentar intensidades mais similares à imagem a ser alinhada (imagem de LGE). O registo das máscaras miocárdicas por meio de um modelo com transformações rígida, afim e deformações livres mostrou ser a melhor metodologia a aplicar. Os valores médios de T1 nativo não aumentaram significativamente em pacientes com tecido cicatricial, apesar de haver um aumento dos valores de T1 nativo em determinadas secções, em cortes basais e intermédios. Relativamente ao terceiro objetivo abordado, não foi observada uma clara correlação de intensidades entre as técnicas, o que reforçou a necessidade de uma análise de textura (do inglês, TA). Esta análise revelou as sete melhores características (num total de 350) que distinguem segmentos cardíacos sem e com tecido fibrótico, aplicando um método de Machine Learning (do inglês, ML) que identificou, sequencialmente, as features que adicionavam mais informação ao modelo que distinguia os dois grupos de segmentos. Quatro características de primeira ordem distinguem os segmentos devido à presença de tecido cicatricial - zonas hiperintensas - e três características de textura sugerem que a remodelação fibrótica no miocárdio de pacientes com HCM pode estar associada a uma textura mais heterogénea. Foi implementada uma análise ao desempenho de modelos com as features selecionadas, que revelou que a Cluster Prominence é a característica que melhor distingue secções sem e com tecido fibrótico, apesar de com baixa sensibilidade (65%) e baixa especificidade (64%). Um modelo que analisa o Percentil 90 revelou uma precisão de 64%, sensibilidade de 71% e especificidade de 57%. No estudo da Variância, a precisão foi de 63%, a sensibilidade 66% e a especificidade 60%. As restantes features apresentaram valores de precisão inferiores aos mencionados mas acima de 50%. Um modelo com a combinação das sete features selecionadas não melhorou a performance do modelo (precisão de 62%, sensibilidade de 75% e 49% de especificidade). A baixa sensibilidade e especificidade sugerem que a análise desses valores nessas características pode ajudar os cardiologistas a identificar regiões focais de fibrose e evitar métodos de injeção de contraste, mas pode não fornecer um diagnóstico preciso da presença de tecido fibrótico por si só. Em futuras aquisições, encontrar valores semelhantes nas features acima mencionadas, principalmente na Cluster Prominence, em novos dados, poderia ajudar os cardiologistas a identificar regiões de fibrose focal. Desta forma, não seria necessário analisar imagens de Realce Tardio, o que se traduziria na eliminação de injeção de agentes de contraste. Pesquisas adicionais focadas na correlação do mapeamento T1 nativo e imagens cardíacas de LGE são de extrema importância para desenvolver uma tecnologia independente da injeção de agentes de contraste, que substitua o Realce Tardio

    Motion tracking tMRI datasets to quantify abnormal left ventricle motion using finite element modelling

    Get PDF
    According to `The Atlas of Heart Disease and Stroke'[MMMG04] published by the World Health Organization, heart disease accounts for nearly half the deaths in both the developed and developing countries and is the world's single biggest killer. However, early detection of a diseased heart condition can prevent many of these fatalities. Regional wall motion abnormalities of the heart precede both ECG abnormalities and chest pain as an indicator of myocardial ischaemia and are an excellent indicator of coronary stenosis [GZM97]. These motion abnormalities of the heart muscle are difficult to observe and track, because the heart is a relatively smooth organ with few landmarks and non-rigid motion with a twisting motion or tangential component. The MRI tissue-tagging technique gives researchers the first glimpse into how the heart actually beats. This research uses the tagged MRI images of the heart to create a three dimensional model of a beating heart indicating the stress of a region. Tagged MRI techniques are still developing and vary vastly, meaning that there needs to be a methodology that can adapt to these changes rapidly and effectively, to meet the needs of the evolving technology. The focus of this research is to develop and test such a methodology by the means of a Strain Estimation Pipeline along with an effective way of validating any changes made to the individual processes that it comprises of

    From Fully-Supervised Single-Task to Semi-Supervised Multi-Task Deep Learning Architectures for Segmentation in Medical Imaging Applications

    Get PDF
    Medical imaging is routinely performed in clinics worldwide for the diagnosis and treatment of numerous medical conditions in children and adults. With the advent of these medical imaging modalities, radiologists can visualize both the structure of the body as well as the tissues within the body. However, analyzing these high-dimensional (2D/3D/4D) images demands a significant amount of time and effort from radiologists. Hence, there is an ever-growing need for medical image computing tools to extract relevant information from the image data to help radiologists perform efficiently. Image analysis based on machine learning has pivotal potential to improve the entire medical imaging pipeline, providing support for clinical decision-making and computer-aided diagnosis. To be effective in addressing challenging image analysis tasks such as classification, detection, registration, and segmentation, specifically for medical imaging applications, deep learning approaches have shown significant improvement in performance. While deep learning has shown its potential in a variety of medical image analysis problems including segmentation, motion estimation, etc., generalizability is still an unsolved problem and many of these successes are achieved at the cost of a large pool of datasets. For most practical applications, getting access to a copious dataset can be very difficult, often impossible. Annotation is tedious and time-consuming. This cost is further amplified when annotation must be done by a clinical expert in medical imaging applications. Additionally, the applications of deep learning in the real-world clinical setting are still limited due to the lack of reliability caused by the limited prediction capabilities of some deep learning models. Moreover, while using a CNN in an automated image analysis pipeline, it’s critical to understand which segmentation results are problematic and require further manual examination. To this extent, the estimation of uncertainty calibration in a semi-supervised setting for medical image segmentation is still rarely reported. This thesis focuses on developing and evaluating optimized machine learning models for a variety of medical imaging applications, ranging from fully-supervised, single-task learning to semi-supervised, multi-task learning that makes efficient use of annotated training data. The contributions of this dissertation are as follows: (1) developing a fully-supervised, single-task transfer learning for the surgical instrument segmentation from laparoscopic images; and (2) utilizing supervised, single-task, transfer learning for segmenting and digitally removing the surgical instruments from endoscopic/laparoscopic videos to allow the visualization of the anatomy being obscured by the tool. The tool removal algorithms use a tool segmentation mask and either instrument-free reference frames or previous instrument-containing frames to fill in (inpaint) the instrument segmentation mask; (3) developing fully-supervised, single-task learning via efficient weight pruning and learned group convolution for accurate left ventricle (LV), right ventricle (RV) blood pool and myocardium localization and segmentation from 4D cine cardiac MR images; (4) demonstrating the use of our fully-supervised memory-efficient model to generate dynamic patient-specific right ventricle (RV) models from cine cardiac MRI dataset via an unsupervised learning-based deformable registration field; and (5) integrating a Monte Carlo dropout into our fully-supervised memory-efficient model with inherent uncertainty estimation, with the overall goal to estimate the uncertainty associated with the obtained segmentation and error, as a means to flag regions that feature less than optimal segmentation results; (6) developing semi-supervised, single-task learning via self-training (through meta pseudo-labeling) in concert with a Teacher network that instructs the Student network by generating pseudo-labels given unlabeled input data; (7) proposing largely-unsupervised, multi-task learning to demonstrate the power of a simple combination of a disentanglement block, variational autoencoder (VAE), generative adversarial network (GAN), and a conditioning layer-based reconstructor for performing two of the foremost critical tasks in medical imaging — segmentation of cardiac structures and reconstruction of the cine cardiac MR images; (8) demonstrating the use of 3D semi-supervised, multi-task learning for jointly learning multiple tasks in a single backbone module – uncertainty estimation, geometric shape generation, and cardiac anatomical structure segmentation of the left atrial cavity from 3D Gadolinium-enhanced magnetic resonance (GE-MR) images. This dissertation summarizes the impact of the contributions of our work in terms of demonstrating the adaptation and use of deep learning architectures featuring different levels of supervision to build a variety of image segmentation tools and techniques that can be used across a wide spectrum of medical image computing applications centered on facilitating and promoting the wide-spread computer-integrated diagnosis and therapy data science

    Comparison of Fast Acquisition Strategies in Whole-Heart Four-Dimensional Flow Cardiac MR: Two-center, 1.5 Tesla, Phantom and In-vivo Validation Study

    Get PDF
    Purpose: To validate three widely-used acceleration methods in four-dimensional (4D) flow cardiac MR; segmented 4D-spoiled-gradient-echo (4D-SPGR), 4D-echo-planar-imaging (4D-EPI), and 4D-k-t Broad-use Linear Acquisition Speed-up Technique (4D-k-t BLAST). Materials and Methods: Acceleration methods were investigated in static/pulsatile phantoms and 25 volunteers on 1.5 Tesla MR systems. In phantoms, flow was quantified by 2D phase-contrast (PC), the three 4D flow methods and the time-beaker flow measurements. The later was used as the reference method. Peak velocity and flow assessment was done by means of all sequences. For peak velocity assessment 2D PC was used as the reference method. For flow assessment, consistency between mitral inflow and aortic outflow was investigated for all pulse-sequences. Visual grading of image quality/artifacts was performed on a four-point-scale (0 = no artifacts; 3 = nonevaluable). Results: For the pulsatile phantom experiments, the mean error for 2D PC = 1.0 ± 1.1%, 4D-SPGR = 4.9 ± 1.3%, 4D-EPI = 7.6 ± 1.3% and 4D-k-t BLAST = 4.4 ± 1.9%. In vivo, acquisition time was shortest for 4D-EPI (4D-EPI = 8 ± 2 min versus 4D-SPGR = 9 ± 3 min, P < 0.05 and 4D-k-t BLAST = 9 ± 3 min, P = 0.29). 4D-EPI and 4D-k-t BLAST had minimal artifacts, while for 4D-SPGR, 40% of aortic valve/mitral valve (AV/MV) assessments scored 3 (nonevaluable). Peak velocity assessment using 4D-EPI demonstrated best correlation to 2D PC (AV:r = 0.78, P < 0.001; MV:r = 0.71, P < 0.001). Coefficient of variability (CV) for net forward flow (NFF) volume was least for 4D-EPI (7%) (2D PC:11%, 4D-SPGR: 29%, 4D-k-t BLAST: 30%, respectively). Conclusion: In phantom, all 4D flow techniques demonstrated mean error of less than 8%. 4D-EPI demonstrated the least susceptibility to artifacts, good image quality, modest agreement with the current reference standard for peak intra-cardiac velocities and the highest consistency of intra-cardiac flow quantifications

    Augmented Image-Guidance for Transcatheter Aortic Valve Implantation

    Get PDF
    The introduction of transcatheter aortic valve implantation (TAVI), an innovative stent-based technique for delivery of a bioprosthetic valve, has resulted in a paradigm shift in treatment options for elderly patients with aortic stenosis. While there have been major advancements in valve design and access routes, TAVI still relies largely on single-plane fluoroscopy for intraoperative navigation and guidance, which provides only gross imaging of anatomical structures. Inadequate imaging leading to suboptimal valve positioning contributes to many of the early complications experienced by TAVI patients, including valve embolism, coronary ostia obstruction, paravalvular leak, heart block, and secondary nephrotoxicity from contrast use. A potential method of providing improved image-guidance for TAVI is to combine the information derived from intra-operative fluoroscopy and TEE with pre-operative CT data. This would allow the 3D anatomy of the aortic root to be visualized along with real-time information about valve and prosthesis motion. The combined information can be visualized as a `merged\u27 image where the different imaging modalities are overlaid upon each other, or as an `augmented\u27 image, where the location of key target features identified on one image are displayed on a different imaging modality. This research develops image registration techniques to bring fluoroscopy, TEE, and CT models into a common coordinate frame with an image processing workflow that is compatible with the TAVI procedure. The techniques are designed to be fast enough to allow for real-time image fusion and visualization during the procedure, with an intra-procedural set-up requiring only a few minutes. TEE to fluoroscopy registration was achieved using a single-perspective TEE probe pose estimation technique. The alignment of CT and TEE images was achieved using custom-designed algorithms to extract aortic root contours from XPlane TEE images, and matching the shape of these contours to a CT-derived surface model. Registration accuracy was assessed on porcine and human images by identifying targets (such as guidewires or coronary ostia) on the different imaging modalities and measuring the correspondence of these targets after registration. The merged images demonstrated good visual alignment of aortic root structures, and quantitative assessment measured an accuracy of less than 1.5mm error for TEE-fluoroscopy registration and less than 6mm error for CT-TEE registration. These results suggest that the image processing techniques presented have potential for development into a clinical tool to guide TAVI. Such a tool could potentially reduce TAVI complications, reducing morbidity and mortality and allowing for a safer procedure
    • …
    corecore