Robust Head Mounted Wearable Eye Tracking System for Dynamical Calibration

In this work, a new head mounted eye tracking system is presented. Based on computer vision techniques, the system integrates eye images and head movement, in real time, performing a robust gaze point tracking. Nystagmus movements due to vestibulo-ocular reflex are monitored and integrated. The system proposed here is a strongly improved version of a previous platform called HATCAM, which was robust against changes of illumination conditions. The new version, called HAT-Move, is equipped with accurate inertial motion unit to detect the head movement enabling eye gaze even in dynamical conditions. HAT-Move performance is investigated in a group of healthy subjects in both static and dynamic conditions, i.e. when head is kept still or free to move. Evaluation was performed in terms of amplitude of the angular error between the real coordinates of the fixed points and those computed by the system in two experimental setups, specifically, in laboratory settings and in a 3D virtual reality (VR) scenario. The achieved results showed that HAT-Move is able to achieve eye gaze angular error of about 1 degree along both horizontal and vertical direction

Pain detection with bioimpedance methodology from 3-dimensional exploration of nociception in a postoperative observational trial

Although the measurement of dielectric properties of the skin is a long-known tool for assessing the changes caused by nociception, the frequency modulated response has not been considered yet. However, for a rigorous characterization of the biological tissue during noxious stimulation, the bioimpedance needs to be analyzed over time as well as over frequency. The 3-dimensional analysis of nociception, including bioimpedance, time, and frequency changes, is provided by ANSPEC-PRO device. The objective of this observational trial is the validation of the new pain monitor, named as ANSPEC-PRO. After ethics committee approval and informed consent, 26 patients were monitored during the postoperative recovery period: 13 patients with the in-house developed prototype ANSPEC-PRO and 13 with the commercial device MEDSTORM. At every 7 min, the pain intensity was measured using the index of Anspec-pro or Medstorm and the 0-10 numeric rating scale (NRS), pre-surgery for 14 min and post-anesthesia for 140 min. Non-significant differences were reported for specificity-sensitivity analysis between ANSPEC-PRO (AUC = 0.49) and MEDSTORM (AUC = 0.52) measured indexes. A statistically significant positive linear relationship was observed between Anspec-pro index and NRS (r(2) = 0.15, p < 0.01). Hence, we have obtained a validation of the prototype Anspec-pro which performs equally well as the commercial device under similar conditions

HRMobile: A lightweight, local architecture for heart rate measurement

Heart rate and heart rate variability (HRV) are important metrics in the study of numerous physical and psychiatric conditions. Previously, measurement of heart rate was relegated to clinical settings, and was neither convenient nor captured a patient’s typical resting state. In effect, this made gathering heart rate data costly and introduced noise. The current prevalence of mobile phone technology and Internet access has increased the viability of remote health monitoring, thus presenting an opportunity to substantially improve the speed, convenience, and reliability of heart rate readings. Recent attention has focused on different methods for remote, non-contact heart rate measurement. Of these methods, video presents perhaps the best option for optimizing cost and convenience. This thesis introduces a lightweight architecture for estimating heart rate and HRV using a smartphone camera. The system presented here runs locally on a smartphone, requiring only a phone camera and 15s or more of continuous video of a subject’s face. No Internet connection or networking is necessary. Building the system to run locally in this manner means that this software confers benefits such as greater user privacy, offline availability, reliability, cost effectiveness, and speed. However, it also introduces added constraints on computational complexity. With these tradeoffs in mind, the system presented here is implemented within an Android mobile app. The performance of our approach fell short of that of existing state-of-the-art methods in terms of mean absolute error (MAE) of heart rate estimation, achieving MAE during validation that was over $17x$ greater than other existing approaches. There are a number of factors which may contribute to this performance discrepancy, including limitations in the diversity of the data used with respect to gender, age, skin tone, and heart rate intensity. Further, remote photoplethysmographic (rPPG) signal generated by this architecture contains a large number of noise artifacts which are difficult to consistently remove through signal processing. This noise is the primary reason for the underperformance of this architecture, and could potentially be explained by model and feature engineering decisions which were made to address the risk of overfitting on the limited dataset used in this work

Vessel segmentation for time resolved phase contrast MRI

Quantication of cardiovascular flow and blood volumes are useful tools in diagnosing cardiovascular disease such as congenital heart defects and different kinds of valve leakage. Medical imaging techniques enables non-invasive analysis of anatomy and physiology. In order to perform flow quantification from medical image sequences, the boundaries of the vessels of interest are usually delineated manually by medical professionals. This is a time consuming process and the result depends, to a high degree, on user experience. This thesis presents an automated vessel segmentation method for the main vessels around the heart from velocity encoded Magnetic Resonance Imaging sequences. The proposed method only require a manual delineation in one image. The algorithm is based on an active contour, using the Euler-Lagrange equation together with internal and external forces designed from a set of fundamental assumptions regarding vessel shape and behaviour. More specically, constraints were applied to the geometrical shape and elasticity of a vessel. Validation of the method was performed by comparing the detected stroke volume with manual delineation, and also by measuring the segmentation overlapping of the two methods. On a test set of 20 patients, 19 resulted in excellent segmentation agreement with manual delineations, with a mean Dice coefficient over 0.8. However, performance instability was observed when changing the values of two algorithm parameters, and one of the patients in the set constantly resulted in segmentation failure for all tested parameter combinations. The relative variability in stroke volume between the proposed algorithm and manual delineations was, at best, 6 +- 3.6%. This is comparable to the interobserver variability from a previous physiological study 1 of 3 +- 4%, which indicates the potential of the suggested method if improvements in robustness and stability is implemented

Unlocking cardiac motion: assessing software and machine learning for single-cell and cardioid kinematic insights

The heart coordinates its functional parameters for optimal beat-to-beat mechanical activity. Reliable detection and quantification of these parameters still represent a hot topic in cardiovascular research. Nowadays, computer vision allows the development of open-source algorithms to measure cellular kinematics. However, the analysis software can vary based on analyzed specimens. In this study, we compared different software performances in in-silico model, in-vitro mouse adult ventricular cardiomyocytes and cardioids. We acquired in-vitro high-resolution videos during suprathreshold stimulation at 0.5-1-2&nbsp;Hz, adapting the protocol for the cardioids. Moreover, we exposed the samples to inotropic and depolarizing substances. We analyzed in-silico and in-vitro videos by (i) MUSCLEMOTION, the gold standard among open-source software; (ii) CONTRACTIONWAVE, a recently developed tracking software; and (iii) ViKiE, an in-house customized video kinematic evaluation software. We enriched the study with three machine-learning algorithms to test the robustness of the motion-tracking approaches. Our results revealed that all software produced comparable estimations of cardiac mechanical parameters. For instance, in cardioids, beat duration measurements at 0.5&nbsp;Hz were 1053.58&nbsp;ms (MUSCLEMOTION), 1043.59&nbsp;ms (CONTRACTIONWAVE), and 937.11&nbsp;ms (ViKiE). ViKiE exhibited higher sensitivity in exposed samples due to its localized kinematic analysis, while MUSCLEMOTION and CONTRACTIONWAVE offered temporal correlation, combining global assessment with time-efficient analysis. Finally, machine learning reveals greater accuracy when trained with MUSCLEMOTION dataset in comparison with the other software (accuracy &gt; 83%). In conclusion, our findings provide valuable insights for the accurate selection and integration of software tools into the kinematic analysis pipeline, tailored to the experimental protocol

A Large-Scale Study of a Sleep Tracking and Improving Device with Closed-loop and Personalized Real-time Acoustic Stimulation

Various intervention therapies ranging from pharmaceutical to hi-tech tailored solutions have been available to treat difficulty in falling asleep commonly caused by insomnia in modern life. However, current techniques largely remain ill-suited, ineffective, and unreliable due to their lack of precise real-time sleep tracking, in-time feedback on the therapies, an ability to keep people asleep during the night, and a large-scale effectiveness evaluation. Here, we introduce a novel sleep aid system, called Earable, that can continuously sense multiple head-based physiological signals and simultaneously enable closed-loop auditory stimulation to entrain brain activities in time for effective sleep promotion. We develop the system in a lightweight, comfortable, and user-friendly headband with a comprehensive set of algorithms and dedicated own-designed audio stimuli. We conducted multiple protocols from 883 sleep studies on 377 subjects (241 women, 119 men) wearing either a gold-standard device (PSG), Earable, or both concurrently. We demonstrate that our system achieves (1) a strong correlation (0.89 +/- 0.03) between the physiological signals acquired by Earable and those from the gold-standard PSG, (2) an 87.8 +/- 5.3% agreement on sleep scoring using our automatic real-time sleep staging algorithm with the consensus scored by three sleep technicians, and (3) a successful non-pharmacological stimulation alternative to effectively shorten the duration of sleep falling by 24.1 +/- 0.1 minutes. These results show that the efficacy of Earable exceeds existing techniques in intentions to promote fast falling asleep, track sleep state accurately, and achieve high social acceptance for real-time closed-loop personalized neuromodulation-based home sleep care.Comment: 33 pages, 8 figure

Non-Invasive Data Acquisition and IoT Solution for Human Vital Signs Monitoring: Applications, Limitations and Future Prospects

The rapid development of technology has brought about a revolution in healthcare stimulating a wide range of smart and autonomous applications in homes, clinics, surgeries and hospitals. Smart healthcare opens the opportunity for a qualitative advance in the relations between healthcare providers and end-users for the provision of healthcare such as enabling doctors to diagnose remotely while optimizing the accuracy of the diagnosis and maximizing the benefits of treatment by enabling close patient monitoring. This paper presents a comprehensive review of non-invasive vital data acquisition and the Internet of Things in healthcare informatics and thus reports the challenges in healthcare informatics and suggests future work that would lead to solutions to address the open challenges in IoT and non-invasive vital data acquisition. In particular, the conducted review has revealed that there has been a daunting challenge in the development of multi-frequency vital IoT systems, and addressing this issue will help enable the vital IoT node to be reachable by the broker in multiple area ranges. Furthermore, the utilization of multi-camera systems has proven its high potential to increase the accuracy of vital data acquisition, but the implementation of such systems has not been fully developed with unfilled gaps to be bridged. Moreover, the application of deep learning to the real-time analysis of vital data on the node/edge side will enable optimal, instant offline decision making. Finally, the synergistic integration of reliable power management and energy harvesting systems into non-invasive data acquisition has been omitted so far, and the successful implementation of such systems will lead to a smart, robust, sustainable and self-powered healthcare system

Basic Science to Clinical Research: Segmentation of Ultrasound and Modelling in Clinical Informatics

The world of basic science is a world of minutia; it boils down to improving even a fraction of a percent over the baseline standard. It is a domain of peer reviewed fractions of seconds and the world of squeezing every last ounce of efficiency from a processor, a storage medium, or an algorithm. The field of health data is based on extracting knowledge from segments of data that may improve some clinical process or practice guideline to improve the time and quality of care. Clinical informatics and knowledge translation provide this information in order to reveal insights to the world of improving patient treatments, regimens, and overall outcomes. In my world of minutia, or basic science, the movement of blood served an integral role. The novel detection of sound reverberations map out the landscape for my research. I have applied my algorithms to the various anatomical structures of the heart and artery system. This serves as a basis for segmentation, active contouring, and shape priors. The algorithms presented, leverage novel applications in segmentation by using anatomical features of the heart for shape priors and the integration of optical flow models to improve tracking. The presented techniques show improvements over traditional methods in the estimation of left ventricular size and function, along with plaque estimation in the carotid artery. In my clinical world of data understanding, I have endeavoured to decipher trends in Alzheimer’s disease, Sepsis of hospital patients, and the burden of Melanoma using mathematical modelling methods. The use of decision trees, Markov models, and various clustering techniques provide insights into data sets that are otherwise hidden. Finally, I demonstrate how efficient data capture from providers can achieve rapid results and actionable information on patient medical records. This culminated in generating studies on the burden of illness and their associated costs. A selection of published works from my research in the world of basic sciences to clinical informatics has been included in this thesis to detail my transition. This is my journey from one contented realm to a turbulent one

Vision-enhanced Peg-in-Hole for automotive body parts using semantic image segmentation and object detection

Artificial Intelligence (AI) is an enabling technology in the context of Industry 4.0. In particular, the automotive sector is among those who can benefit most of the use of AI in conjunction with advanced vision techniques. The scope of this work is to integrate deep learning algorithms in an industrial scenario involving a robotic Peg-in-Hole task. More in detail, we focus on a scenario where a human operator manually positions a carbon fiber automotive part in the workspace of a 7 Degrees of Freedom (DOF) manipulator. To cope with the uncertainty on the relative position between the robot and the workpiece, we adopt a three stage strategy. The first stage concerns the Three-Dimensional (3D) reconstruction of the workpiece using a registration algorithm based on the Iterative Closest Point (ICP) paradigm. Such a procedure is integrated with a semantic image segmentation neural network, which is in charge of removing the background of the scene to improve the registration. The adoption of such network allows to reduce the registration time of about 28.8%. In the second stage, the reconstructed surface is compared with a Computer Aided Design (CAD) model of the workpiece to locate the holes and their axes. In this stage, the adoption of a Convolutional Neural Network (CNN) allows to improve the holes’ position estimation of about 57.3%. The third stage concerns the insertion of the peg by implementing a search phase to handle the remaining estimation errors. Also in this case, the use of the CNN reduces the search phase duration of about 71.3%. Quantitative experiments, including a comparison with a previous approach without both the segmentation network and the CNN, have been conducted in a realistic scenario. The results show the effectiveness of the proposed approach and how the integration of AI techniques improves the success rate from 84.5% to 99.0%