Early screening and diagnosis of diabetic retinopathy

Diabetic retinopathy (DR) is a chronic, progressive and possibly vision-threatening eye disease. Early detection and diagnosis of DR, prior to the development of any lesions, is paramount for more efficiently dealing with it and managing its consequences. This thesis investigates and proposes a number of candidate geometric and haemodynamic biomarkers, derived from fundus images of the retinal vasculature, which can be reliably utilised for identifying the progression from diabetes to DR. Numerous studies exist in literature that investigate only some of these biomarkers in independent normal, diabetic and DR cohorts. However, none exist, to the best of my knowledge, that investigates more than 100 biomarkers altogether, both geometric and haemodynamic ones, for identifying the progression to DR, by also using a novel experimental design, where the same exact matched junctions and subjects are evaluated in a four year period that includes the last three years pre-DR (still diabetic eye) and the onset of DR (progressors’ group). Multiple additional conventional experimental designs, such as non-matched junctions, non-progressors’ group, and a combination of them are also adopted in order to present the superiority of this type of analysis for retinal features. Therefore, this thesis aims to present a complete framework and some novel knowledge, based on statistical analysis, feature selection processes and classification models, so as to provide robust, rigorous and meaningful statistical inferences, alongside efficient feature subsets that can identify the stages of the progression. In addition, a new and improved method for more accurately summarising the calibres of the retinal vessel trunks is also presented. The first original contribution of this thesis is that a series of haemodynamic features (blood flow rate, blood flow velocity, etc.), which are estimated from the retinal vascular geometry based on some boundary conditions, are applied to studying the progression from diabetes to DR. These features are found to undoubtedly contribute to the inferences and the understanding of the progression, yielding significant results, mainly for the venular network. The second major contribution is the proposed framework and the experimental design for more accurately and efficiently studying and quantifying the vascular alterations that occur during the progression to DR and that can be safely attributed only to this progression. The combination of the framework and the experimental design lead to more sound and concrete inferences, providing a set of features, such as the central retinal artery and vein equivalent, fractal dimension, blood flow rate, etc., that are indeed biomarkers of progression to DR. The third major contribution of this work is the new and improved method for more accurately summarising the calibre of an arterial or venular trunk, with a direct application to estimating the central retinal artery equivalent (CRAE), the central retinal vein equivalent (CRVE) and their quotient, the arteriovenous ratio (AVR). Finally, the improved method is shown to truly make a notable difference in the estimations, when compared to the established alternative method in literature, with an improvement between 0.24% and 0.49% in terms of the mean absolute percentage error and 0.013 in the area under the curve. I have demonstrated that some thoroughly planned experimental studies based on a comprehensive framework, which combines image processing algorithms, statistical and classification models, feature selection processes, and robust haemodynamic and geometric features, extracted from the retinal vasculature (as a whole and from specific areas of interest), provide altogether succinct evidence that the early detection of the progression from diabetes to DR can be indeed achieved. The performance that the eight different classification combinations achieved in terms of the area under the curve varied from 0.745 to 0.968

When the machine does not know measuring uncertainty in deep learning models of medical images

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonRecently, Deep learning (DL), which involves powerful black box predictors, has outperformed human experts in several medical diagnostic problems. However, these methods focus exclusively on improving the accuracy of point predictions without assessing their outputs’ quality and ignore the asymmetric cost involved in different types of misclassification errors. Neural networks also do not deliver confidence in predictions and suffer from over and under confidence, i.e. are not well calibrated. Knowing how much confidence there is in a prediction is essential for gaining clinicians’ trust in the technology. Calibrated uncertainty quantification is a challenging problem as no ground truth is available. To address this, we make two observations: (i) cost-sensitive deep neural networks with Dropweights models better quantify calibrated predictive uncertainty, and (ii) estimated uncertainty with point predictions in Deep Ensembles Bayesian Neural Networks with DropWeights can lead to a more informed decision and improve prediction quality. This dissertation focuses on quantifying uncertainty using concepts from cost-sensitive neural networks, calibration of confidence, and Dropweights ensemble method. First, we show how to improve predictive uncertainty by deep ensembles of neural networks with Dropweights learning an approximate distribution over its weights in medical image segmentation and its application in active learning. Second, we use the Jackknife resampling technique to correct bias in quantified uncertainty in image classification and propose metrics to measure uncertainty performance. The third part of the thesis is motivated by the discrepancy between the model predictive error and the objective in quantified uncertainty when costs for misclassification errors or unbalanced datasets are asymmetric. We develop cost-sensitive modifications of the neural networks in disease detection and propose metrics to measure the quality of quantified uncertainty. Finally, we leverage an adaptive binning strategy to measure uncertainty calibration error that directly corresponds to estimated uncertainty performance and address problematic evaluation methods. We evaluate the effectiveness of the tools on nuclei images segmentation, multi-class Brain MRI image classification, multi-level cell type-specific protein expression prediction in ImmunoHistoChemistry (IHC) images and cost-sensitive classification for Covid-19 detection from X-Rays and CT image dataset. Our approach is thoroughly validated by measuring the quality of uncertainty. It produces an equally good or better result and paves the way for the future that addresses the practical problems at the intersection of deep learning and Bayesian decision theory. In conclusion, our study highlights the opportunities and challenges of the application of estimated uncertainty in deep learning models of medical images, representing the confidence of the model’s prediction, and the uncertainty quality metrics show a significant improvement when using Deep Ensembles Bayesian Neural Networks with DropWeights

Gaze-Based Human-Robot Interaction by the Brunswick Model

We present a new paradigm for human-robot interaction based on social signal processing, and in particular on the Brunswick model. Originally, the Brunswick model copes with face-to-face dyadic interaction, assuming that the interactants are communicating through a continuous exchange of non verbal social signals, in addition to the spoken messages. Social signals have to be interpreted, thanks to a proper recognition phase that considers visual and audio information. The Brunswick model allows to quantitatively evaluate the quality of the interaction using statistical tools which measure how effective is the recognition phase. In this paper we cast this theory when one of the interactants is a robot; in this case, the recognition phase performed by the robot and the human have to be revised w.r.t. the original model. The model is applied to Berrick, a recent open-source low-cost robotic head platform, where the gazing is the social signal to be considered

An effective supervised framework for retinal blood vessel segmentation using local standardisation and bagging

In this paper, we present a supervised framework for extracting blood vessels from retinal images. The local standardisation of the green channel of the retinal image and the Gabor filter responses at four different scales are used as features for pixel classification. The Bayesian classifier is used with a bagging framework to classify each image pixel as vessel or background. A post processing method is also proposed to correct central reflex artifacts and improve the segmentation accuracy.On the public DRIVE database, our method achieves an accuracy of 0.9491 which is higher than any existing methods. More importantly, visual inspection on the segmentation results shows that our method gives two important improvements on the segmentation quality: vessels are well separated and central reflex are effectively removed. These are important factors that affect to the accuracy of all subsequent vascular analysis

Embracing Machine Learning in Safety Assurance in Healthcare

Machine learning (ML) is becoming more widely used in many different sectors, including automotive, aviation and healthcare. ML has a great potential to change society and to improve peoples' lives. However, the prospect of ML also poses many challenges; one of the biggest challenges is safety. Thus, there are two important questions that require urgent answers: (1) Are well-established safety engineering methods still appropriate and effective in assuring the safety of ML in some representative healthcare scenarios? (2) Are there new opportunities for well-established safety engineering methods with the development of ML and why are they specifically good for safety in this domain? In this thesis, the first question is explored from the viewpoint of designing ML models. The second question is explored from two perspectives: explanaibility of ML models in support of safety assurance; and using ML to update safety analysis. Both these questions are addressed in the context of healthcare. In other words, this thesis investigates how ML can be embraced in the safety assurance of healthcare applications. Through exploration of three concrete clinical case studies, the thesis demonstrates that well-established safety engineering methods can be applied to ML systems to integrate safety into their design process in healthcare. It further identifies different ways in which ML can assist well-established safety engineering methods, and concludes that there are many opportunities for greater synergy between ML and safety engineering in healthcare and, potentially, in other domains

XXIV congreso anual de la sociedad española de ingeniería biomédica (CASEIB2016)

En la presente edición, más de 150 trabajos de alto nivel científico van a ser presentados en 18 sesiones paralelas y 3 sesiones de póster, que se centrarán en áreas relevantes de la Ingeniería Biomédica. Entre las sesiones paralelas se pueden destacar la sesión plenaria Premio José María Ferrero Corral y la sesión de Competición de alumnos de Grado en Ingeniería Biomédica, con la participación de 16 alumnos de los Grados en Ingeniería Biomédica a nivel nacional. El programa científico se complementa con dos ponencias invitadas de científicos reconocidos internacionalmente, dos mesas redondas con una importante participación de sociedades científicas médicas y de profesionales de la industria de tecnología médica, y dos actos sociales que permitirán a los participantes acercarse a la historia y cultura valenciana. Por primera vez, en colaboración con FENIN, seJane Campos, R. (2017). XXIV congreso anual de la sociedad española de ingeniería biomédica (CASEIB2016). Editorial Universitat Politècnica de València. http://hdl.handle.net/10251/79277EDITORIA