Machine Learning in Fetal Cardiology: What to Expect

In fetal cardiology, imaging (especially echocardiography) has demonstrated to help in the diagnosis and monitoring of fetuses with a compromised cardiovascular system potentially associated with several fetal conditions. Different ultrasound approaches are currently used to evaluate fetal cardiac structure and function, including conventional 2-D imaging and M-mode and tissue Doppler imaging among others. However, assessment of the fetal heart is still challenging mainly due to involuntary movements of the fetus, the small size of the heart, and the lack of expertise in fetal echocardiography of some sonographers. Therefore, the use of new technologies to improve the primary acquired images, to help extract measurements, or to aid in the diagnosis of cardiac abnormalities is of great importance for optimal assessment of the fetal heart. Machine leaning (ML) is a computer science discipline focused on teaching a computer to perform tasks with specific goals without explicitly programming the rules on how to perform this task. In this review we provide a brief overview on the potential of ML techniques to improve the evaluation of fetal cardiac function by optimizing image acquisition and quantification/segmentation, as well as aid in improving the prenatal diagnoses of fetal cardiac remodeling and abnormalities

Multi-task near-field perception for autonomous driving using surround-view fisheye cameras

Die Bildung der Augen führte zum Urknall der Evolution. Die Dynamik änderte sich von einem primitiven Organismus, der auf den Kontakt mit der Nahrung wartete, zu einem Organismus, der durch visuelle Sensoren gesucht wurde. Das menschliche Auge ist eine der raffiniertesten Entwicklungen der Evolution, aber es hat immer noch Mängel. Der Mensch hat über Millionen von Jahren einen biologischen Wahrnehmungsalgorithmus entwickelt, der in der Lage ist, Autos zu fahren, Maschinen zu bedienen, Flugzeuge zu steuern und Schiffe zu navigieren. Die Automatisierung dieser Fähigkeiten für Computer ist entscheidend für verschiedene Anwendungen, darunter selbstfahrende Autos, Augmented Realität und architektonische Vermessung. Die visuelle Nahfeldwahrnehmung im Kontext von selbstfahrenden Autos kann die Umgebung in einem Bereich von 0 - 10 Metern und 360° Abdeckung um das Fahrzeug herum wahrnehmen. Sie ist eine entscheidende Entscheidungskomponente bei der Entwicklung eines sichereren automatisierten Fahrens. Jüngste Fortschritte im Bereich Computer Vision und Deep Learning in Verbindung mit hochwertigen Sensoren wie Kameras und LiDARs haben ausgereifte Lösungen für die visuelle Wahrnehmung hervorgebracht. Bisher stand die Fernfeldwahrnehmung im Vordergrund. Ein weiteres wichtiges Problem ist die begrenzte Rechenleistung, die für die Entwicklung von Echtzeit-Anwendungen zur Verfügung steht. Aufgrund dieses Engpasses kommt es häufig zu einem Kompromiss zwischen Leistung und Laufzeiteffizienz. Wir konzentrieren uns auf die folgenden Themen, um diese anzugehen: 1) Entwicklung von Nahfeld-Wahrnehmungsalgorithmen mit hoher Leistung und geringer Rechenkomplexität für verschiedene visuelle Wahrnehmungsaufgaben wie geometrische und semantische Aufgaben unter Verwendung von faltbaren neuronalen Netzen. 2) Verwendung von Multi-Task-Learning zur Überwindung von Rechenengpässen durch die gemeinsame Nutzung von initialen Faltungsschichten zwischen den Aufgaben und die Entwicklung von Optimierungsstrategien, die die Aufgaben ausbalancieren.The formation of eyes led to the big bang of evolution. The dynamics changed from a primitive organism waiting for the food to come into contact for eating food being sought after by visual sensors. The human eye is one of the most sophisticated developments of evolution, but it still has defects. Humans have evolved a biological perception algorithm capable of driving cars, operating machinery, piloting aircraft, and navigating ships over millions of years. Automating these capabilities for computers is critical for various applications, including self-driving cars, augmented reality, and architectural surveying. Near-field visual perception in the context of self-driving cars can perceive the environment in a range of 0 - 10 meters and 360° coverage around the vehicle. It is a critical decision-making component in the development of safer automated driving. Recent advances in computer vision and deep learning, in conjunction with high-quality sensors such as cameras and LiDARs, have fueled mature visual perception solutions. Until now, far-field perception has been the primary focus. Another significant issue is the limited processing power available for developing real-time applications. Because of this bottleneck, there is frequently a trade-off between performance and run-time efficiency. We concentrate on the following issues in order to address them: 1) Developing near-field perception algorithms with high performance and low computational complexity for various visual perception tasks such as geometric and semantic tasks using convolutional neural networks. 2) Using Multi-Task Learning to overcome computational bottlenecks by sharing initial convolutional layers between tasks and developing optimization strategies that balance tasks

Methods for Doppler Radar Monitoring of Physiological Signals

Unobtrusive health monitoring includes advantages such as long-term monitoring of rarely occurring conditions or of slow changes in health, at reasonable costs. In addition, the preparation of electrodes or other sensors is not needed. Currently, the main limitation of remote patient monitoring is not in the existing communication infrastructure but the lack of reliable, easy-to-use, and well-studied sensors.The aim of this thesis was to develop methods for monitoring cardiac and respiratory activity with microwave continuous wave (CW) Doppler radar. When considering cardiac and respiration monitoring, the heart and respiration rates are often the first monitored parameters. The motivation of this thesis, however, is to measure not only rate-related parameters but also the cardiac and respiratory waveforms, including the chest wall displacement information.This dissertation thoroughly explores the signal processing methods for accurate chest wall displacement measurement with a radar sensor. The sensor prototype and measurement setup choices are reported. The contributions of this dissertation encompass an I/Q imbalance estimation method and a nonlinear demodulation method for a quadrature radar sensor. Unlike the previous imbalance estimation methods, the proposed method does not require the use of laboratory equipment. The proposed nonlinear demodulation method, on the other hand, is shown to be more accurate than other methods in low-noise cases. In addition, the separation of the cardiac and respiratory components with independent component analysis (ICA) is discussed. The developed methods were validated with simulations and with simplified measurement setups in an office environment. The performance of the nonlinear demodulation method was also studied with three patients for sleep-time respiration monitoring. This is the first time that whole-night measurements have been analyzed with the method in an uncontrolled environment. Data synchronization between the radar sensor and a commercial polysomnographic (PSG) device was assured with a developed infrared (IR) link, which is reported as a side result.The developed methods enable the extraction of more useful information from a radar sensor and extend its application. This brings Doppler radar sensors one step closer to large-scale commercial use for a wide range of applications, including home health monitoring, sleep-time respiration monitoring, and measuring gating signals for medical imaging

Bio-Radar: sistema de aquisição de sinais vitais sem contacto

The Bio-Radar system is capable to measure vital signs accurately, namely the respiratory and cardiac signal, using electromagnetic waves. In this way, it is possible to monitor subjects remotely and comfortably for long periods of time. This system is based on the micro-Doppler effect, which relates the received signal phase variation with the distance change between the subject chest-wall and the radar antennas, which occurs due to the cardiopulmonary function. Considering the variety of applications where this system can be used, it is required to evaluate its performance when applied to real context scenarios and thus demonstrate the advantages that bioradar systems can bring to the general population. In this work, a bio-radar prototype was developed in order to verify the viability to be integrated in specific applications, using robust and low profile solutions that equally guarantee the general system performance while addressing the market needs. Considering these two perspectives to be improved, different level solutions were developed. On the hardware side, textile antennas were developed to be embedded in a car seat upholstery, thus reaching a low profile solution and easy to include in the industrialization process. Real context scenarios imply long-term monitoring periods, where involuntary body motion can occur producing high amplitude signals that overshadow the vital signs. Non-controlled monitoring environments might also produce time varying parasitic reflections that have a direct impact in the signal. Additionally, the subject's physical stature and posture during the monitoring period can have a different impact in the signals quality. Therefore, signal processing algorithms were developed to be robust to low quality signals and non-static scenarios. On the other hand, the bio-radar potential can also be maximized if the acquired signals are used pertinently to help identify the subject's psychophysiological state enabling one to act accordingly. The random body motion until now has been seen as a noisy source, however it can also provide useful information regarding subject's state. In this sense, the acquired vital signs as well as other body motions were used in machine learning algorithms with the goal to identify the subject's emotions and thus verify if the remotely acquired vital signs can also provide useful information.O sistema Bio-Radar permite medir sinais vitais com precisão, nomeadamente o sinal respiratório e cardíaco, utilizando ondas eletromagnéticas para esse fim. Desta forma, é possível monitorizar sujeitos de forma remota e confortável durante longos períodos de tempo. Este sistema é baseado no efeito de micro-Doppler, que relaciona a variação de fase do sinal recebido com a alteração da distância entre as antenas do radar e a caixa torácica do sujeito, que ocorre durante a função cardiopulmonar. Considerando a variedade de aplicações onde este sistema pode ser utilizado, é necessário avaliar o seu desempenho quando aplicado em contextos reais e assim demonstrar as vantagens que os sistemas bio-radar podem trazer à população geral. Neste trabalho, foi desenvolvido um protótipo do bio radar com o objetivo de verificar a viabilidade de integrar estes sistemas em aplicações específicas, utilizando soluções robustas e discretas que garantam igualmente o seu bom desempenho, indo simultaneamente de encontro às necessidades do mercado. Considerando estas duas perspetivas em que o sistema pode ser melhorado, foram desenvolvidas soluções de diferentes níveis. Do ponto de vista de hardware, foram desenvolvidas antenas têxteis para serem integradas no estofo de um banco automóvel, alcançando uma solução discreta e fácil de incluir num processo de industrialização. Contextos reais de aplicação implicam períodos de monitorização longos, onde podem ocorrer movimentos corporais involuntários que produzem sinais de elevada amplitude que se sobrepõem aos sinais vitais. Ambientes de monitorização não controlados podem produzir reflexões parasitas variantes no tempo que têm impacto direto no sinal. Adicionalmente, a estrutura física do sujeito e a sua postura durante o período de monitorização podem ter impactos diferentes na qualidade dos sinais. Desta forma, foram desenvolvidos algoritmos de processamento de sinal robustos a sinais de baixa qualidade e a cenários não estáticos. Por outro lado, o potencial do bio radar pode também ser maximizado se os sinais adquiridos forem pertinentemente utilizados de forma a ajudar a identificar o estado psicofisiológico do sujeito, permitindo mais tarde agir em conformidade. O movimento corporal aleatório que foi até agora visto como uma fonte de ruído, pode no entanto também fornecer informação útil sobre o estado do sujeito. Neste sentido, os sinais vitais e outros movimentos corporais adquiridos foram utilizados em algoritmos de aprendizagem automática com o objetivo de identificar as emoções do sujeito e assim verificar que sinais vitais adquiridos remotamente podem também conter informação útil.Programa Doutoral em Engenharia Eletrotécnic

Data-Driven Classification Methods for Craniosynostosis Using 3D Surface Scans

Diese Arbeit befasst sich mit strahlungsfreier Klassifizierung von Kraniosynostose mit zusätzlichem Schwerpunkt auf Datenaugmentierung und auf die Verwendung synthetischer Daten als Ersatz für klinische Daten. Motivation: Kraniosynostose ist eine Erkrankung, die Säuglinge betrifft und zu Kopfdeformitäten führt. Diagnose mittels strahlungsfreier 3D Oberflächenscans ist eine vielversprechende Alternative zu traditioneller computertomographischer Bildgebung. Aufgrund der niedrigen Prävalenz und schwieriger Anonymisierbarkeit sind klinische Daten nur spärlich vorhanden. Diese Arbeit adressiert diese Herausforderungen, indem sie neue Klassifizierungsalgorithmen vorschlägt, synthetische Daten für die wissenschaftliche Gemeinschaft erstellt und zeigt, dass es möglich ist, klinische Daten vollständig durch synthetische Daten zu ersetzen, ohne die Klassifikationsleistung zu beeinträchtigen. Methoden: Ein Statistisches Shape Modell (SSM) von Kraniosynostosepatienten wird erstellt und öffentlich zugänglich gemacht. Es wird eine 3D-2D-Konvertierung von der 3D-Gittergeometrie in ein 2D-Bild vorgeschlagen, die die Verwendung von Convolutional Neural Networks (CNNs) und Datenaugmentierung im Bildbereich ermöglicht. Drei Klassifizierungsansätze (basierend auf cephalometrischen Messungen, basierend auf dem SSM, und basierend auf den 2D Bildern mit einem CNN) zur Unterscheidung zwischen drei Pathologien und einer Kontrollgruppe werden vorgeschlagen und bewertet. Schließlich werden die klinischen Trainingsdaten vollständig durch synthetische Daten aus einem SSM und einem generativen adversarialen Netz (GAN) ersetzt. Ergebnisse: Die vorgeschlagene CNN-Klassifikation übertraf konkurrierende Ansätze in einem klinischen Datensatz von 496 Probanden und erreichte einen F1-Score von 0,964. Datenaugmentierung erhöhte den F1-Score auf 0,975. Zuschreibungen der Klassifizierungsentscheidung zeigten hohe Amplituden an Teilen des Kopfes, die mit Kraniosynostose in Verbindung stehen. Das Ersetzen der klinischen Daten durch synthetische Daten, die mit einem SSM und einem GAN erstellt wurden, ergab noch immer einen F1-Score von über 0,95, ohne dass das Modell ein einziges klinisches Subjekt gesehen hatte. Schlussfolgerung: Die vorgeschlagene Umwandlung von 3D-Geometrie in ein 2D-kodiertes Bild verbesserte die Leistung bestehender Klassifikatoren und ermöglichte eine Datenaugmentierung während des Trainings. Unter Verwendung eines SSM und eines GANs konnten klinische Trainingsdaten durch synthetische Daten ersetzt werden. Diese Arbeit verbessert bestehende diagnostische Ansätze auf strahlungsfreien Aufnahmen und demonstriert die Verwendbarkeit von synthetischen Daten, was klinische Anwendungen objektiver, interpretierbarer, und weniger kostspielig machen

Visual and Camera Sensors

This book includes 13 papers published in Special Issue ("Visual and Camera Sensors") of the journal Sensors. The goal of this Special Issue was to invite high-quality, state-of-the-art research papers dealing with challenging issues in visual and camera sensors

Subjectivity and complexity of facial attractiveness

The origin and meaning of facial beauty represent a longstanding puzzle. Despite the profuse literature devoted to facial attractiveness, its very nature, its determinants and the nature of inter-person differences remain controversial issues. Here we tackle such questions proposing a novel experimental approach in which human subjects, instead of rating natural faces, are allowed to efficiently explore the face-space and 'sculpt' their favorite variation of a reference facial image. The results reveal that different subjects prefer distinguishable regions of the face-space, highlighting the essential subjectivity of the phenomenon.The different sculpted facial vectors exhibit strong correlations among pairs of facial distances, characterising the underlying universality and complexity of the cognitive processes, and the relative relevance and robustness of the different facial distances.Comment: 15 pages, 5 figures. Supplementary information: 26 pages, 13 figure