18 research outputs found
Computer-aided image quality assessment in automated 3D breast ultrasound images
Automated 3D breast ultrasound (ABUS) is a valuable, non-ionising adjunct to X-ray mammography for breast cancer screening and diagnosis for women with dense breasts. High image quality is an important prerequisite for diagnosis and has to be guaranteed at the time of acquisition. The high throughput of images in a screening scenario demands for automated solutions. In this work, an automated image quality assessment system rating ABUS scans at the time of acquisition was designed and implemented. Quality assessment of present diagnostic ultrasound images has rarely been performed demanding thorough analysis of potential image quality aspects in ABUS. Therefore, a reader study was initiated, making two clinicians rate the quality of clinical ABUS images. The frequency of specific quality aspects was evaluated revealing that incorrect positioning and insufficiently applied contact fluid caused the most relevant image quality issues. The relative position of the nipple in the image, the acoustic shadow caused by the nipple as well as the shape of the breast contour reflect patient positioning and ultrasound transducer handling. Morphological and histogram-based features utilized for machine learning to reproduce the manual classification as provided by the clinicians. At 97 % specificity, the automatic classification achieved sensitivities of 59 %, 45 %, and 46 % for the three aforementioned aspects, respectively. The nipple is an important landmark in breast imaging, which is generally---but not always correctly---pinpointed by the technicians. An existing nipple detection algorithm was extended by probabilistic atlases and exploited for automatic detection of incorrectly annotated nipple marks. The nipple detection rate was increased from 82 % to 85 % and the classification achieved 90 % sensitivity at 89 % specificity. A lack of contact fluid between transducer and skin can induce reverberation patterns and acoustic shadows, which can possibly obscure lesions. Parameter maps were computed in order to localize these artefact regions and yielded a detection rate of 83 % at 2.6 false positives per image. Parts of the presented work were integrated to clinical workflow making up a novel image quality assessment system that supported technicians in their daily routine by detecting images of insufficient quality and indicating potential improvements for a repeated scan while the patient was still in the examination room. First evaluations showed that the proposed method sensitises technicians for the radiologists' demands on diagnostically valuable images
The Role Of Tissue Sound Speed As A Surrogate Marker Of Breast Density
Breast density is one of the strongest predictors of breast cancer risk as women with the densest breasts have a three- to five-fold increase in risk compared to women with the least dense breasts. Breast density is currently measured by using mammography, the current gold standard for breast imaging. There are many shortcomings to using mammography to measure breast density, including the use of ionizing radiation. Ultrasound tomography (UST) does not use ionizing radiation and can create tomographic breast sound speed images. These sound speed images are useful because breast density is proportional to sound speed. The purpose of this work was to assess the ability of UST to measure breast density and its ability to measure changes in breast density over short periods of time.
A cohort of 251 patients was examined using both UST and mammography. Many different associations were found between the UST density measurement, the volume averaged sound speed, and the mammographic percent density. Additional associations were found between many other UST and mammographic imaging characteristics. UST density was found to correlate with various patient characteristics in a similar manner to mammographic density. Additionally, UST was used to examine the effects of tamoxifen on breast density. Tamoxifen has been shown to reduce mammographic density and breast cancer risk for some women. Preliminary data for 52 patients has shown promising results so far. UST density has decreased for approximately a similar percentage of patients as has been measured for mammographic density. These changes have been measured over short time frames that could not be achieved using mammography.
These results show that UST\u27s ability to measure breast density is consistent with mammography, the current standard of care. UST has the potential to become a safe and effective device that can be used to reliably assess breast density and serial changes in breast density
Mass detection in digital breast tomosynthesis: Deep convolutional neural network with transfer learning from mammography
Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/135545/1/mp7345_am.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/135545/2/mp7345.pd
Computer-aided detection and diagnosis of breast cancer in 2D and 3D medical imaging through multifractal analysis
This Thesis describes the research work performed in the scope of a doctoral research program
and presents its conclusions and contributions. The research activities were carried on in the
industry with Siemens S.A. Healthcare Sector, in integration with a research team.
Siemens S.A. Healthcare Sector is one of the world biggest suppliers of products, services and
complete solutions in the medical sector. The company offers a wide selection of diagnostic
and therapeutic equipment and information systems. Siemens products for medical imaging and
in vivo diagnostics include: ultrasound, computer tomography, mammography, digital breast tomosynthesis,
magnetic resonance, equipment to angiography and coronary angiography, nuclear
imaging, and many others.
Siemens has a vast experience in Healthcare and at the beginning of this project it was strategically
interested in solutions to improve the detection of Breast Cancer, to increase its competitiveness
in the sector.
The company owns several patents related with self-similarity analysis, which formed the background
of this Thesis. Furthermore, Siemens intended to explore commercially the computer-
aided automatic detection and diagnosis eld for portfolio integration. Therefore, with the
high knowledge acquired by University of Beira Interior in this area together with this Thesis,
will allow Siemens to apply the most recent scienti c progress in the detection of the breast
cancer, and it is foreseeable that together we can develop a new technology with high potential.
The project resulted in the submission of two invention disclosures for evaluation in Siemens
A.G., two articles published in peer-reviewed journals indexed in ISI Science Citation Index,
two other articles submitted in peer-reviewed journals, and several international conference
papers. This work on computer-aided-diagnosis in breast led to innovative software and novel
processes of research and development, for which the project received the Siemens Innovation
Award in 2012.
It was very rewarding to carry on such technological and innovative project in a socially sensitive
area as Breast Cancer.No cancro da mama a deteção precoce e o diagnóstico correto são de extrema importância na
prescrição terapêutica e caz e e ciente, que potencie o aumento da taxa de sobrevivência à
doença. A teoria multifractal foi inicialmente introduzida no contexto da análise de sinal e a
sua utilidade foi demonstrada na descrição de comportamentos siológicos de bio-sinais e até
na deteção e predição de patologias. Nesta Tese, três métodos multifractais foram estendidos
para imagens bi-dimensionais (2D) e comparados na deteção de microcalci cações em mamogramas.
Um destes métodos foi também adaptado para a classi cação de massas da mama, em
cortes transversais 2D obtidos por ressonância magnética (RM) de mama, em grupos de massas
provavelmente benignas e com suspeição de malignidade. Um novo método de análise multifractal
usando a lacunaridade tri-dimensional (3D) foi proposto para classi cação de massas da
mama em imagens volumétricas 3D de RM de mama. A análise multifractal revelou diferenças
na complexidade subjacente às localizações das microcalci cações em relação aos tecidos normais,
permitindo uma boa exatidão da sua deteção em mamogramas. Adicionalmente, foram
extraídas por análise multifractal características dos tecidos que permitiram identi car os casos
tipicamente recomendados para biópsia em imagens 2D de RM de mama. A análise multifractal
3D foi e caz na classi cação de lesões mamárias benignas e malignas em imagens 3D de RM de
mama. Este método foi mais exato para esta classi cação do que o método 2D ou o método
padrão de análise de contraste cinético tumoral. Em conclusão, a análise multifractal fornece
informação útil para deteção auxiliada por computador em mamogra a e diagnóstico auxiliado
por computador em imagens 2D e 3D de RM de mama, tendo o potencial de complementar a
interpretação dos radiologistas
Numerical Approaches for Solving the Combined Reconstruction and Registration of Digital Breast Tomosynthesis
Heavy demands on the development of medical imaging modalities for breast cancer detection have been witnessed in the last three decades in an attempt to reduce the mortality associated with the disease. Recently, Digital Breast Tomosynthesis (DBT) shows its promising in the early diagnosis when lesions are small. In particular, it offers potential benefits over X-ray mammography - the current modality of choice for breast screening - of increased sensitivity and specificity for comparable X-ray dose, speed, and cost. An important feature of DBT is that it provides a pseudo-3D image of the breast. This is of particular relevance for heterogeneous dense breasts of young women, which can inhibit detection of cancer using conventional mammography. In the same way that it is difficult to see a bird from the edge of the forest, detecting cancer in a conventional 2D mammogram is a challenging task. Three-dimensional DBT, however, enables us to step through the forest, i.e., the breast, reducing the confounding effect of superimposed tissue and so (potentially) increasing the sensitivity and specificity of cancer detection. The workflow in which DBT would be used clinically, involves two key tasks: reconstruction, to generate a 3D image of the breast, and registration, to enable images from different visits to be compared as is routinely performed by radiologists working with conventional mammograms. Conventional approaches proposed in the literature separate these steps, solving each task independently. This can be effective if reconstructing using a complete set of data. However, for ill-posed limited-angle problems such as DBT, estimating the deformation is difficult because of the significant artefacts associated with DBT reconstructions, leading to severe inaccuracies in the registration. The aim of my work is to find and evaluate methods capable of allying these two tasks, which will enhance the performance of each process as a result. Consequently, I prove that the processes of reconstruction and registration of DBT are not independent but reciprocal. This thesis proposes innovative numerical approaches combining reconstruction of a pair of temporal DBT acquisitions with their registration iteratively and simultaneously. To evaluate the performance of my methods I use synthetic images, breast MRI, and DBT simulations with in-vivo breast compressions. I show that, compared to the conventional sequential method, jointly estimating image intensities and transformation parameters gives superior results with respect to both reconstruction fidelity and registration accuracy
Information Fusion of Magnetic Resonance Images and Mammographic Scans for Improved Diagnostic Management of Breast Cancer
Medical imaging is critical to non-invasive diagnosis and treatment of a wide spectrum
of medical conditions. However, different modalities of medical imaging employ/apply
di erent contrast mechanisms and, consequently, provide different depictions of bodily
anatomy. As a result, there is a frequent problem where the same pathology can be
detected by one type of medical imaging while being missed by others. This problem brings
forward the importance of the development of image processing tools for integrating the
information provided by different imaging modalities via the process of information fusion.
One particularly important example of clinical application of such tools is in the diagnostic
management of breast cancer, which is a prevailing cause of cancer-related mortality in
women. Currently, the diagnosis of breast cancer relies mainly on X-ray mammography and
Magnetic Resonance Imaging (MRI), which are both important throughout different stages
of detection, localization, and treatment of the disease. The sensitivity of mammography,
however, is known to be limited in the case of relatively dense breasts, while contrast enhanced
MRI tends to yield frequent 'false alarms' due to its high sensitivity. Given this
situation, it is critical to find reliable ways of fusing the mammography and MRI scans in
order to improve the sensitivity of the former while boosting the specificity of the latter.
Unfortunately, fusing the above types of medical images is known to be a difficult computational
problem. Indeed, while MRI scans are usually volumetric (i.e., 3-D), digital
mammograms are always planar (2-D). Moreover, mammograms are invariably acquired
under the force of compression paddles, thus making the breast anatomy undergo sizeable
deformations. In the case of MRI, on the other hand, the breast is rarely constrained and
imaged in a pendulous state. Finally, X-ray mammography and MRI exploit two completely
di erent physical mechanisms, which produce distinct diagnostic contrasts which
are related in a non-trivial way. Under such conditions, the success of information fusion
depends on one's ability to establish spatial correspondences between mammograms
and their related MRI volumes in a cross-modal cross-dimensional (CMCD) setting in the
presence of spatial deformations (+SD). Solving the problem of information fusion in the
CMCD+SD setting is a very challenging analytical/computational problem, still in need
of efficient solutions.
In the literature, there is a lack of a generic and consistent solution to the problem of
fusing mammograms and breast MRIs and using their complementary information. Most
of the existing MRI to mammogram registration techniques are based on a biomechanical
approach which builds a speci c model for each patient to simulate the effect of mammographic
compression. The biomechanical model is not optimal as it ignores the common
characteristics of breast deformation across different cases. Breast deformation is essentially the planarization of a 3-D volume between two paddles, which is common in all
patients. Regardless of the size, shape, or internal con guration of the breast tissue, one
can predict the major part of the deformation only by considering the geometry of the
breast tissue. In contrast with complex standard methods relying on patient-speci c biomechanical
modeling, we developed a new and relatively simple approach to estimate the
deformation and nd the correspondences. We consider the total deformation to consist of
two components: a large-magnitude global deformation due to mammographic compression
and a residual deformation of relatively smaller amplitude. We propose a much simpler
way of predicting the global deformation which compares favorably to FEM in terms of
its accuracy. The residual deformation, on the other hand, is recovered in a variational
framework using an elastic transformation model.
The proposed algorithm provides us with a computational pipeline that takes breast
MRIs and mammograms as inputs and returns the spatial transformation which establishes
the correspondences between them. This spatial transformation can be applied in different
applications, e.g., producing 'MRI-enhanced' mammograms (which is capable of improving
the quality of surgical care) and correlating between different types of mammograms.
We investigate the performance of our proposed pipeline on the application of enhancing
mammograms by means of MRIs and we have shown improvements over the state of the
art
Applying novel machine learning technology to optimize computer-aided detection and diagnosis of medical images
The purpose of developing Computer-Aided Detection (CAD) schemes is to assist physicians (i.e., radiologists) in interpreting medical imaging findings and reducing inter-reader variability more accurately. In developing CAD schemes, Machine Learning (ML) plays an essential role because it is widely used to identify effective image features from complex datasets and optimally integrate them with the classifiers, which aims to assist the clinicians to more accurately detect early disease, classify disease types and predict disease treatment outcome. In my dissertation, in different studies, I assess the feasibility of developing several novel CAD systems in the area of medical imaging for different purposes. The first study aims to develop and evaluate a new computer-aided diagnosis (CADx) scheme based on analysis of global mammographic image features to predict the likelihood of cases being malignant. CADx scheme is applied to pre-process mammograms, generate two image maps in the frequency domain using discrete cosine transform and fast Fourier transform, compute bilateral image feature differences from left and right breasts, and apply a support vector machine (SVM) method to predict the likelihood of the case being malignant. This study demonstrates the feasibility of developing a new global image feature analysis based CADx scheme of mammograms with high performance. This new CADx approach is more efficient in development and potentially more robust in future applications by avoiding difficulty and possible errors in breast lesion segmentation. In the second study, to automatically identify a set of effective mammographic image features and build an optimal breast cancer risk stratification model, I investigate advantages of applying a machine learning approach embedded with a locally preserving projection (LPP) based feature combination and regeneration algorithm to predict short-term breast cancer risk. To this purpose, a computer-aided image processing scheme is applied to segment fibro-glandular tissue depicted on mammograms and initially compute 44 features related to the bilateral asymmetry of mammographic tissue density distribution between left and right breasts. Next, an embedded LLP algorithm optimizes the feature space and regenerates a new operational vector with 4 features using a maximal variance approach. This study demonstrates that applying the LPP algorithm effectively reduces feature dimensionality, and yields higher and potentially more robust performance in predicting short-term breast cancer risk. In the third study, to more precisely classify malignant lesions, I investigate the feasibility of applying a random projection algorithm to build an optimal feature vector from the initially CAD-generated large feature pool and improve the performance of the machine learning model. In this process, a CAD scheme is first applied to segment mass regions and initially compute 181 features. An SVM model embedded with the feature dimensionality reduction method is then built to predict the likelihood of lesions being malignant. This study demonstrates that the random project algorithm is a promising method to generate optimal feature vectors to improve the performance of machine learning models of medical images. The last study aims to develop and test a new CAD scheme of chest X-ray images to detect coronavirus (COVID-19) infected pneumonia. To this purpose, the CAD scheme first applies two image preprocessing steps to remove the majority of diaphragm regions, process the original image using a histogram equalization algorithm, and a bilateral low-pass filter. Then, the original image and two filtered images are used to form a pseudo color image. This image is fed into three input channels of a transfer learning-based convolutional neural network (CNN) model to classify chest X-ray images into 3 classes of COVID-19 infected pneumonia, other community-acquired no-COVID-19 infected pneumonia, and normal (non-pneumonia) cases. This study demonstrates that adding two image preprocessing steps and generating a pseudo color image plays an essential role in developing a deep learning CAD scheme of chest X-ray images to improve accuracy in detecting COVID-19 infected pneumonia.
In summary, I developed and presented several image pre-processing algorithms, feature extraction methods, and data optimization techniques to present innovative approaches for quantitative imaging markers based on machine learning systems in all these studies. The studies' simulation and results show the discriminative performance of the proposed CAD schemes on different application fields helpful to assist radiologists on their assessments in diagnosing disease and improve their overall performance