Recent Advances in Machine Learning Applied to Ultrasound Imaging

Machine learning (ML) methods are pervading an increasing number of fields of application because of their capacity to effectively solve a wide variety of challenging problems. The employment of ML techniques in ultrasound imaging applications started several years ago but the scientific interest in this issue has increased exponentially in the last few years. The present work reviews the most recent (2019 onwards) implementations of machine learning techniques for two of the most popular ultrasound imaging fields, medical diagnostics and non-destructive evaluation. The former, which covers the major part of the review, was analyzed by classifying studies according to the human organ investigated and the methodology (e.g., detection, segmentation, and/or classification) adopted, while for the latter, some solutions to the detection/classification of material defects or particular patterns are reported. Finally, the main merits of machine learning that emerged from the study analysis are summarized and discussed. © 2022 by the authors. Licensee MDPI, Basel, Switzerland

Automatic image quality assessment and measurement of fetal head in two-dimensional ultrasound image

Owing to the inconsistent image quality existing in routine obstetric ultrasound (US) scans that leads to a large intraobserver and interobserver variability, the aim of this study is to develop a quality-assured, fully automated US fetal head measurement system. A texton-based fetal head segmentation is used as a prerequi- site step to obtain the head region. Textons are calculated using a filter bank designed specific for US fetal head structure. Both shape- and anatomic-based features calculated from the segmented head region are then fed into a random forest classifier to determine the quality of the image (e.g., whether the image is acquired from a correct imaging plane), from which fetal head measurements [biparietal diameter (BPD), occipital–frontal diam- eter (OFD), and head circumference (HC)] are derived. The experimental results show a good performance of our method for US quality assessment and fetal head measurements. The overall precision for automatic image quality assessment is 95.24% with 87.5% sensitivity and 100% specificity, while segmentation performance shows 99.27% (`0.26) of accuracy, 97.07% (`2.3) of sensitivity, 2.23 mm (`0.74) of the maximum symmetric contour distance, and 0.84 mm (`0.28) of the average symmetric contour distance. The statistical analysis results using paired t-test and Bland–Altman plots analysis indicate that the 95% limits of agreement for inter observer variability between the automated measurements and the senior expert measurements are 2.7 mm of BPD, 5.8 mm of OFD, and 10.4 mm of HC, whereas the mean differences are −0.038 ` 1.38 mm, −0.20 ` 2.98 mm, and −0.72 ` 5.36 mm, respectively. These narrow 95% limits of agreements indicate a good level of consistency between the automated and the senior expert’s measurements

Theoretical Interpretations and Applications of Radial Basis Function Networks

Medical applications usually used Radial Basis Function Networks just as Artificial Neural Networks. However, RBFNs are Knowledge-Based Networks that can be interpreted in several way: Artificial Neural Networks, Regularization Networks, Support Vector Machines, Wavelet Networks, Fuzzy Controllers, Kernel Estimators, Instanced-Based Learners. A survey of their interpretations and of their corresponding learning algorithms is provided as well as a brief survey on dynamic learning algorithms. RBFNs' interpretations can suggest applications that are particularly interesting in medical domains

Exploring variability in medical imaging

Although recent successes of deep learning and novel machine learning techniques improved the perfor- mance of classification and (anomaly) detection in computer vision problems, the application of these methods in medical imaging pipeline remains a very challenging task. One of the main reasons for this is the amount of variability that is encountered and encapsulated in human anatomy and subsequently reflected in medical images. This fundamental factor impacts most stages in modern medical imaging processing pipelines. Variability of human anatomy makes it virtually impossible to build large datasets for each disease with labels and annotation for fully supervised machine learning. An efficient way to cope with this is to try and learn only from normal samples. Such data is much easier to collect. A case study of such an automatic anomaly detection system based on normative learning is presented in this work. We present a framework for detecting fetal cardiac anomalies during ultrasound screening using generative models, which are trained only utilising normal/healthy subjects. However, despite the significant improvement in automatic abnormality detection systems, clinical routine continues to rely exclusively on the contribution of overburdened medical experts to diagnosis and localise abnormalities. Integrating human expert knowledge into the medical imaging processing pipeline entails uncertainty which is mainly correlated with inter-observer variability. From the per- spective of building an automated medical imaging system, it is still an open issue, to what extent this kind of variability and the resulting uncertainty are introduced during the training of a model and how it affects the final performance of the task. Consequently, it is very important to explore the effect of inter-observer variability both, on the reliable estimation of model’s uncertainty, as well as on the model’s performance in a specific machine learning task. A thorough investigation of this issue is presented in this work by leveraging automated estimates for machine learning model uncertainty, inter-observer variability and segmentation task performance in lung CT scan images. Finally, a presentation of an overview of the existing anomaly detection methods in medical imaging was attempted. This state-of-the-art survey includes both conventional pattern recognition methods and deep learning based methods. It is one of the first literature surveys attempted in the specific research area.Open Acces

A supervised texton based approach for automatic segmentation and measurement of the fetal head and femur in 2D ultrasound images

This paper presents a supervised texton based approach for the accurate segmentation and measurement of ultrasound fetal head (BPD, OFD, HC) and femur (FL). The method consists of several steps. First, a non-linear diffusion technique is utilized to reduce the speckle noise. Then, based on the assumption that cross sectional intensity profiles of skull and femur can be approximated by Gaussian-like curves, a multi-scale and multi-orientation filter bank is designed to extract texton features specific to ultrasound fetal anatomic structure. The extracted texton cues, together with multi-scale local brightness, are then built into a unified framework for boundary detection of ultrasound fetal head and femur. Finally, for fetal head, a direct least square ellipse fitting method is used to construct a closed head contour, whilst, for fetal femur a closed contour is produced by connecting the detected femur boundaries. The presented method is demonstrated to be promising for clinical applications. Overall the evaluation results of fetal head segmentation and measurement from our method are comparable with the inter-observer difference of experts, with the best average precision of 96.85%, the maximum symmetric contour distance (MSD) of 1.46 mm, average symmetric contour distance (ASD) of 0.53 mm; while for fetal femur, the overall performance of our method is better than the inter-observer difference of experts, with the average precision of 84.37%, MSD of 2.72 mm and ASD of 0.31 mm

Electrohysterography in the diagnosis of preterm birth: a review

This is an author-created, un-copyedited versíon of an article published in Physiological Measurement. IOP Publishing Ltd is not responsíble for any errors or omissíons in this versíon of the manuscript or any versíon derived from it. The Versíon of Record is available online at http://doi.org/10.1088/1361-6579/aaad56.[EN] Preterm birth (PTB) is one of the most common and serious complications in pregnancy. About 15 million preterm neonates are born every year, with ratios of 10-15% of total births. In industrialized countries, preterm delivery is responsible for 70% of mortality and 75% of morbidity in the neonatal period. Diagnostic means for its timely risk assessment are lacking and the underlying physiological mechanisms are unclear. Surface recording of the uterine myoelectrical activity (electrohysterogram, EHG) has emerged as a better uterine dynamics monitoring technique than traditional surface pressure recordings and provides information on the condition of uterine muscle in different obstetrical scenarios with emphasis on predicting preterm deliveries. Objective: A comprehensive review of the literature was performed on studies related to the use of the electrohysterogram in the PTB context. Approach: This review presents and discusses the results according to the different types of parameter (temporal and spectral, non-linear and bivariate) used for EHG characterization. Main results: Electrohysterogram analysis reveals that the uterine electrophysiological changes that precede spontaneous preterm labor are associated with contractions of more intensity, higher frequency content, faster and more organized propagated activity and stronger coupling of different uterine areas. Temporal, spectral, non-linear and bivariate EHG analyses therefore provide useful and complementary information. Classificatory techniques of different types and varying complexity have been developed to diagnose PTB. The information derived from these different types of EHG parameters, either individually or in combination, is able to provide more accurate predictions of PTB than current clinical methods. However, in order to extend EHG to clinical applications, the recording set-up should be simplified, be less intrusive and more robust-and signal analysis should be automated without requiring much supervision and yield physiologically interpretable results. Significance: This review provides a general background to PTB and describes how EHG can be used to better understand its underlying physiological mechanisms and improve its prediction. The findings will help future research workers to decide the most appropriate EHG features to be used in their analyses and facilitate future clinical EHG applications in order to improve PTB prediction.This work was supported by the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund under grant DPI2015-68397-R.Garcia-Casado, J.; Ye Lin, Y.; Prats-Boluda, G.; Mas-Cabo, J.; Alberola Rubio, J.; Perales Marin, AJ. (2018). Electrohysterography in the diagnosis of preterm birth: a review. Physiological Measurement. 39(2). https://doi.org/10.1088/1361-6579/aaad56S39

Predicting complex system behavior using hybrid modeling and computational intelligence

“Modeling and prediction of complex systems is a challenging problem due to the sub-system interactions and dependencies. This research examines combining various computational intelligence algorithms and modeling techniques to provide insights into these complex processes and allow for better decision making. This hybrid methodology provided additional capabilities to analyze and predict the overall system behavior where a single model cannot be used to understand the complex problem. The systems analyzed here are flooding events and fetal health care. The impact of floods on road infrastructure is investigated using graph theory, agent-based traffic simulation, and Long Short-Term Memory deep learning to predict water level rise from river gauge height. Combined with existing infrastructure models, these techniques provide a 15-minute interval for making closure decisions rather than the current 6-hour interval. The second system explored is fetal monitoring, which is essential to diagnose severe fetal conditions such as acidosis. Support Vector Machine and Random Forest were compared to identify the best model for classification of fetal state. This model provided a more accurate classification than existing research on the CTG. A deep learning forecasting model was developed to predict the future values for fetal heart rate and uterine contractions. The forecasting and classification algorithms are then integrated to evaluate the future condition of the fetus. The final model can predict the fetal state 4 minutes ahead to help the obstetricians to plan necessary interventions for preventing acidosis and asphyxiation. In both cases, time series predictions using hybrid modeling provided superior results to existing methods to predict complex behaviors”--Abstract, page iv

Machine learning algorithms combining slope deceleration and fetal heart rate features to predict acidemia

Electronic fetal monitoring (EFM) is widely used in intrapartum care as the standard method for monitoring fetal well-being. Our objective was to employ machine learning algorithms to predict acidemia by analyzing specific features extracted from the fetal heart signal within a 30 min window, with a focus on the last deceleration occurring closest to delivery. To achieve this, we conducted a case–control study involving 502 infants born at Miguel Servet University Hospital in Spain, maintaining a 1:1 ratio between cases and controls. Neonatal acidemia was defined as a pH level below 7.10 in the umbilical arterial blood. We constructed logistic regression, classification trees, random forest, and neural network models by combining EFM features to predict acidemia. Model validation included assessments of discrimination, calibration, and clinical utility. Our findings revealed that the random forest model achieved the highest area under the receiver characteristic curve (AUC) of 0.971, but logistic regression had the best specificity, 0.879, for a sensitivity of 0.95. In terms of clinical utility, implementing a cutoff point of 31% in the logistic regression model would prevent unnecessary cesarean sections in 51% of cases while missing only 5% of acidotic cases. By combining the extracted variables from EFM recordings, we provide a practical tool to assist in avoiding unnecessary cesarean sections