174 research outputs found
Robust Learning Enabled Intelligence for the Internet-of-Things: A Survey From the Perspectives of Noisy Data and Adversarial Examples
This is the author accepted manuscript. The final version is available from IEEE via the DOI in this recordThe Internet-of-Things (IoT) has been widely adopted in a range of verticals, e.g., automation, health, energy and manufacturing. Many of the applications in these sectors, such as self-driving cars and remote surgery, are critical and high stakes applications, calling for advanced machine learning (ML) models for data analytics. Essentially, the training and testing data that are collected by massive IoT devices may contain noise (e.g., abnormal data, incorrect labels and incomplete information) and adversarial examples. This requires high robustness of ML models to make reliable decisions for IoT applications. The research of robust ML has received tremendous attentions from both academia and industry in recent years. This paper will investigate the state-of-the-art and representative works of robust ML models that can enable high resilience and reliability of IoT intelligence. Two aspects of robustness will be focused on, i.e., when the training data of ML models contains noises and adversarial examples, which may typically happen in many real-world IoT scenarios. In addition, the reliability of both neural networks and reinforcement learning framework will be investigated. Both of these two machine learning paradigms have been widely used in handling data in IoT scenarios. The potential research challenges and open issues will be discussed to provide future research directions.Engineering and Physical Sciences Research Council (EPSRC
Joint Image Reconstruction and Motion Estimation for Spatiotemporal Imaging
International audienceWe propose a variational model for joint image reconstruction and motion estimation applicable to spatiotemporal imaging. This model consists of two parts, one that conducts image reconstruction in a static setting and another that estimates the motion by solving a sequence of coupled indirect image registration problems, each formulated within the large deformation diffeomorphic metric mapping framework. The proposed model is compared against alternative approaches (optical flow based model and diffeomorphic motion models). Next, we derive efficient algorithms for a time-discretized setting and show that the optimal solution of the time-discretized formulation is consistent with that of the time-continuous one. The complexity of the algorithm is characterized and we conclude by giving some numerical examples in 2D space + time tomography with very sparse and/or highly noisy dat
Recommended from our members
Variational Multi-Task Models for Image Analysis: Applications to Magnetic Resonance Imaging
This thesis deals with the study and development of several variational multi-task models for solving inverse problems in imaging, with a particular focus on Magnetic Resonance Imaging (MRI). In most image processing problems, one usually deals with the reconstruction task, i.e., the task of reconstructing an image from indirect measurements, and then performs various operations, one after the other (i.e. sequentially), to improve the quality of the reconstruction and to extract useful information.
However, recent developments in a variational context, have shown that performing those tasks jointly (i.e. in a multi-task framework) offers great benefits, and this is the perspective that we follow in this thesis. We go beyond traditional sequential approaches and set a new basis for variational multi-task methods for MRI analysis. We demonstrate that by sharing representation between tasks and carefully interconnecting them, one can create synergies across challenging problems and reduce error propagation.
More precisely, firstly we propose a multi-task variational model to tackle the problems of image reconstruction and image segmentation using non-convex Bregman iteration. We describe theoretical and numerical details of the problem and its optimisation scheme. Moreover, we show that our multi-task model achieves better results in several examples and MRI applications than existing approaches in the same context.
Secondly, we show that our approach can be extended to a multi-task reconstruction and segmentation model for the nonlinear inverse problem of velocity-encoded MRI. In this context, the aim is to estimate not only the magnitude from MRI data, but also the phase and its flow information, whilst simultaneously identify regions of interest through the segmentation task.
Finally, we go beyond two-task frameworks and introduce for the first time a variational multi-task model to handle three imaging tasks. To this end, we design a variational multi-task framework addressing reconstruction, super-resolution and registration for improving the quality of MRI reconstruction. We demonstrate that our model is theoretically well-motivated and it outperforms sequential models whilst requiring less computational cost. Furthermore, we show through experimental results the potential of this approach for clinical applications
Automatic Spatiotemporal Analysis of Cardiac Image Series
RĂSUMĂ
Ă ce jour, les maladies cardiovasculaires demeurent au premier rang des principales causes de
dĂ©cĂšs en AmĂ©rique du Nord. Chez lâadulte et au sein de populations de plus en plus jeunes,
la soi-disant Ă©pidĂ©mie dâobĂ©sitĂ© entraĂźnĂ©e par certaines habitudes de vie tels que la mauvaise
alimentation, le manque dâexercice et le tabagisme est lourde de consĂ©quences pour les personnes
affectées, mais aussi sur le systÚme de santé. La principale cause de morbidité et de
mortalitĂ© chez ces patients est lâathĂ©rosclĂ©rose, une accumulation de plaque Ă lâintĂ©rieur des
vaisseaux sanguins à hautes pressions telles que les artÚres coronaires. Les lésions athérosclérotiques
peuvent entraĂźner lâischĂ©mie en bloquant la circulation sanguine et/ou en provoquant
une thrombose. Cela mĂšne souvent Ă de graves consĂ©quences telles quâun infarctus. Outre les
problÚmes liés à la sténose, les parois artérielles des régions criblées de plaque augmentent la
rigidité des parois vasculaires, ce qui peut aggraver la condition du patient. Dans la population
pédiatrique, la pathologie cardiovasculaire acquise la plus fréquente est la maladie de
Kawasaki. Il sâagit dâune vasculite aigĂŒe pouvant affecter lâintĂ©gritĂ© structurale des parois des
artĂšres coronaires et mener Ă la formation dâanĂ©vrismes. Dans certains cas, ceux-ci entravent
lâhĂ©modynamie artĂ©rielle en engendrant une perfusion myocardique insuffisante et en activant
la formation de thromboses.
Le diagnostic de ces deux maladies coronariennes sont traditionnellement effectuĂ©s Ă lâaide
dâangiographies par fluoroscopie. Pendant ces examens paracliniques, plusieurs centaines de
projections radiographiques sont acquises en sĂ©ries suite Ă lâinfusion artĂ©rielle dâun agent de
contraste. Ces images révÚlent la lumiÚre des vaisseaux sanguins et la présence de lésions
potentiellement pathologiques, sâil y a lieu. Parce que les sĂ©ries acquises contiennent de lâinformation
trĂšs dynamique en termes de mouvement du patient volontaire et involontaire (ex.
battements cardiaques, respiration et dĂ©placement dâorganes), le clinicien base gĂ©nĂ©ralement
son interprĂ©tation sur une seule image angiographique oĂč des mesures gĂ©omĂ©triques sont effectuĂ©es
manuellement ou semi-automatiquement par un technicien en radiologie. Bien que
lâangiographie par fluoroscopie soit frĂ©quemment utilisĂ© partout dans le monde et souvent
considĂ©rĂ© comme lâoutil de diagnostic âgold-standardâ pour de nombreuses maladies vasculaires,
la nature bidimensionnelle de cette modalitĂ© dâimagerie est malheureusement trĂšs
limitante en termes de spécification géométrique des différentes régions pathologiques. En effet,
la structure tridimensionnelle des stĂ©noses et des anĂ©vrismes ne peut pas ĂȘtre pleinement
appréciée en 2D car les caractéristiques observées varient selon la configuration angulaire de
lâimageur. De plus, la prĂ©sence de lĂ©sions affectant les artĂšres coronaires peut ne pas reflĂ©ter
la véritable santé du myocarde, car des mécanismes compensatoires naturels (ex. vaisseaux----------ABSTRACT
Cardiovascular disease continues to be the leading cause of death in North America. In adult
and, alarmingly, ever younger populations, the so-called obesity epidemic largely driven by
lifestyle factors that include poor diet, lack of exercise and smoking, incurs enormous stresses
on the healthcare system. The primary cause of serious morbidity and mortality for these
patients is atherosclerosis, the build up of plaque inside high pressure vessels like the coronary
arteries. These lesions can lead to ischemic disease and may progress to precarious blood
flow blockage or thrombosis, often with infarction or other severe consequences. Besides
the stenosis-related outcomes, the arterial walls of plaque-ridden regions manifest increased
stiffness, which may exacerbate negative patient prognosis. In pediatric populations, the
most prevalent acquired cardiovascular pathology is Kawasaki disease. This acute vasculitis
may affect the structural integrity of coronary artery walls and progress to aneurysmal lesions.
These can hinder the blood flowâs hemodynamics, leading to inadequate downstream
perfusion, and may activate thrombus formation which may lead to precarious prognosis.
Diagnosing these two prominent coronary artery diseases is traditionally performed using
fluoroscopic angiography. Several hundred serial x-ray projections are acquired during selective
arterial infusion of a radiodense contrast agent, which reveals the vesselsâ luminal
area and possible pathological lesions. The acquired series contain highly dynamic information
on voluntary and involuntary patient movement: respiration, organ displacement and
heartbeat, for example. Current clinical analysis is largely limited to a single angiographic
image where geometrical measures will be performed manually or semi-automatically by a
radiological technician. Although widely used around the world and generally considered
the gold-standard diagnosis tool for many vascular diseases, the two-dimensional nature of
this imaging modality is limiting in terms of specifying the geometry of various pathological
regions. Indeed, the 3D structures of stenotic or aneurysmal lesions may not be fully appreciated
in 2D because their observable features are dependent on the angular configuration of
the imaging gantry. Furthermore, the presence of lesions in the coronary arteries may not
reflect the true health of the myocardium, as natural compensatory mechanisms may obviate
the need for further intervention. In light of this, cardiac magnetic resonance perfusion
imaging is increasingly gaining attention and clinical implementation, as it offers a direct
assessment of myocardial tissue viability following infarction or suspected coronary artery
disease. This type of modality is plagued, however, by motion similar to that present in fluoroscopic
imaging. This issue predisposes clinicians to laborious manual intervention in order
to align anatomical structures in sequential perfusion frames, thus hindering automation o
Automatic Spatiotemporal Analysis of Cardiac Image Series
RĂSUMĂ
Ă ce jour, les maladies cardiovasculaires demeurent au premier rang des principales causes de
dĂ©cĂšs en AmĂ©rique du Nord. Chez lâadulte et au sein de populations de plus en plus jeunes,
la soi-disant Ă©pidĂ©mie dâobĂ©sitĂ© entraĂźnĂ©e par certaines habitudes de vie tels que la mauvaise
alimentation, le manque dâexercice et le tabagisme est lourde de consĂ©quences pour les personnes
affectées, mais aussi sur le systÚme de santé. La principale cause de morbidité et de
mortalitĂ© chez ces patients est lâathĂ©rosclĂ©rose, une accumulation de plaque Ă lâintĂ©rieur des
vaisseaux sanguins à hautes pressions telles que les artÚres coronaires. Les lésions athérosclérotiques
peuvent entraĂźner lâischĂ©mie en bloquant la circulation sanguine et/ou en provoquant
une thrombose. Cela mĂšne souvent Ă de graves consĂ©quences telles quâun infarctus. Outre les
problÚmes liés à la sténose, les parois artérielles des régions criblées de plaque augmentent la
rigidité des parois vasculaires, ce qui peut aggraver la condition du patient. Dans la population
pédiatrique, la pathologie cardiovasculaire acquise la plus fréquente est la maladie de
Kawasaki. Il sâagit dâune vasculite aigĂŒe pouvant affecter lâintĂ©gritĂ© structurale des parois des
artĂšres coronaires et mener Ă la formation dâanĂ©vrismes. Dans certains cas, ceux-ci entravent
lâhĂ©modynamie artĂ©rielle en engendrant une perfusion myocardique insuffisante et en activant
la formation de thromboses.
Le diagnostic de ces deux maladies coronariennes sont traditionnellement effectuĂ©s Ă lâaide
dâangiographies par fluoroscopie. Pendant ces examens paracliniques, plusieurs centaines de
projections radiographiques sont acquises en sĂ©ries suite Ă lâinfusion artĂ©rielle dâun agent de
contraste. Ces images révÚlent la lumiÚre des vaisseaux sanguins et la présence de lésions
potentiellement pathologiques, sâil y a lieu. Parce que les sĂ©ries acquises contiennent de lâinformation
trĂšs dynamique en termes de mouvement du patient volontaire et involontaire (ex.
battements cardiaques, respiration et dĂ©placement dâorganes), le clinicien base gĂ©nĂ©ralement
son interprĂ©tation sur une seule image angiographique oĂč des mesures gĂ©omĂ©triques sont effectuĂ©es
manuellement ou semi-automatiquement par un technicien en radiologie. Bien que
lâangiographie par fluoroscopie soit frĂ©quemment utilisĂ© partout dans le monde et souvent
considĂ©rĂ© comme lâoutil de diagnostic âgold-standardâ pour de nombreuses maladies vasculaires,
la nature bidimensionnelle de cette modalitĂ© dâimagerie est malheureusement trĂšs
limitante en termes de spécification géométrique des différentes régions pathologiques. En effet,
la structure tridimensionnelle des stĂ©noses et des anĂ©vrismes ne peut pas ĂȘtre pleinement
appréciée en 2D car les caractéristiques observées varient selon la configuration angulaire de
lâimageur. De plus, la prĂ©sence de lĂ©sions affectant les artĂšres coronaires peut ne pas reflĂ©ter
la véritable santé du myocarde, car des mécanismes compensatoires naturels (ex. vaisseaux----------ABSTRACT
Cardiovascular disease continues to be the leading cause of death in North America. In adult
and, alarmingly, ever younger populations, the so-called obesity epidemic largely driven by
lifestyle factors that include poor diet, lack of exercise and smoking, incurs enormous stresses
on the healthcare system. The primary cause of serious morbidity and mortality for these
patients is atherosclerosis, the build up of plaque inside high pressure vessels like the coronary
arteries. These lesions can lead to ischemic disease and may progress to precarious blood
flow blockage or thrombosis, often with infarction or other severe consequences. Besides
the stenosis-related outcomes, the arterial walls of plaque-ridden regions manifest increased
stiffness, which may exacerbate negative patient prognosis. In pediatric populations, the
most prevalent acquired cardiovascular pathology is Kawasaki disease. This acute vasculitis
may affect the structural integrity of coronary artery walls and progress to aneurysmal lesions.
These can hinder the blood flowâs hemodynamics, leading to inadequate downstream
perfusion, and may activate thrombus formation which may lead to precarious prognosis.
Diagnosing these two prominent coronary artery diseases is traditionally performed using
fluoroscopic angiography. Several hundred serial x-ray projections are acquired during selective
arterial infusion of a radiodense contrast agent, which reveals the vesselsâ luminal
area and possible pathological lesions. The acquired series contain highly dynamic information
on voluntary and involuntary patient movement: respiration, organ displacement and
heartbeat, for example. Current clinical analysis is largely limited to a single angiographic
image where geometrical measures will be performed manually or semi-automatically by a
radiological technician. Although widely used around the world and generally considered
the gold-standard diagnosis tool for many vascular diseases, the two-dimensional nature of
this imaging modality is limiting in terms of specifying the geometry of various pathological
regions. Indeed, the 3D structures of stenotic or aneurysmal lesions may not be fully appreciated
in 2D because their observable features are dependent on the angular configuration of
the imaging gantry. Furthermore, the presence of lesions in the coronary arteries may not
reflect the true health of the myocardium, as natural compensatory mechanisms may obviate
the need for further intervention. In light of this, cardiac magnetic resonance perfusion
imaging is increasingly gaining attention and clinical implementation, as it offers a direct
assessment of myocardial tissue viability following infarction or suspected coronary artery
disease. This type of modality is plagued, however, by motion similar to that present in fluoroscopic
imaging. This issue predisposes clinicians to laborious manual intervention in order
to align anatomical structures in sequential perfusion frames, thus hindering automation o
Anwendung von maschinellem Lernen in der optischen NachrichtenĂŒbertragungstechnik
Aufgrund des zunehmenden Datenverkehrs wird erwartet, dass die optischen Netze zukĂŒnftig mit höheren SystemkapazitĂ€ten betrieben werden. Dazu wird bspw. die kohĂ€rente Ăbertragung eingesetzt, bei der das Modulationsformat erhöht werden kann, erforder jedoch ein gröĂeres SNR. Um dies zu erreichen, wird die optische Signalleistung erhöht, wodurch die DatenĂŒbertragung durch die nichtlinearen BeeintrĂ€chtigungen gestört wird. Der Schwerpunkt dieser Arbeit liegt auf der Entwicklung von Modellen des maschinellen Lernens, die auf diese nichtlineare Signalverschlechterung reagieren. Es wird die Support-Vector-Machine (SVM) implementiert und als klassifizierende Entscheidungsmaschine verwendet. Die Ergebnisse zeigen, dass die SVM eine verbesserte Kompensation sowohl der nichtlinearen Fasereffekte als auch der Verzerrungen der optischen Systemkomponenten ermöglicht. Das Prinzip von EONs bietet eine Technologie zur effizienten Nutzung der verfĂŒgbaren Ressourcen, die von der optischen Faser bereitgestellt werden. Ein SchlĂŒsselelement der Technologie ist der bandbreitenvariable Transponder, der bspw. die Anpassung des Modulationsformats oder des Codierungsschemas an die aktuellen Verbindungsbedingungen ermöglicht. Um eine optimale Ressourcenauslastung zu gewĂ€hrleisten wird der Einsatz von Algorithmen des Reinforcement Learnings untersucht. Die Ergebnisse zeigen, dass der RL-Algorithmus in der Lage ist, sich an unbekannte Link-Bedingungen anzupassen, wĂ€hrend vergleichbare heuristische AnsĂ€tze wie der genetische Algorithmus fĂŒr jedes Szenario neu trainiert werden mĂŒssen
Recommended from our members
A Variational Model for Joint Motion Estimation and Image Reconstruction
The aim of this paper is to derive and analyze a variational model for the joint estimation of motion and reconstruction of image sequences, which is based on a time-continuous Eulerian motion model. The model can be set up in terms of the continuity equation or the brightness constancy equation. The analysis in this paper focuses on the latter for robust motion estimation on sequences of twodimensional images. We rigorously prove the existence of a minimizer in a suitable function space setting. Moreover, we discuss the numerical solution of the model based on primal-dual algorithms and investigate several examples. Finally, the benefits of our model compared to existing techniques, such as sequential image reconstruction and motion estimation, are shown.The work of the first author was also supported by the German
Science Foundation DFG via EXC 1003 Cells in Motion Cluster of Excellence, Mšunster, German
- âŠ