Sliding to predict: vision-based beating heart motion estimation by modeling temporal interactions

Purpose: Technical advancements have been part of modern medical solutions as they promote better surgical alternatives that serve to the benefit of patients. Particularly with cardiovascular surgeries, robotic surgical systems enable surgeons to perform delicate procedures on a beating heart, avoiding the complications of cardiac arrest. This advantage comes with the price of having to deal with a dynamic target which presents technical challenges for the surgical system. In this work, we propose a solution for cardiac motion estimation. Methods: Our estimation approach uses a variational framework that guarantees preservation of the complex anatomy of the heart. An advantage of our approach is that it takes into account different disturbances, such as specular reflections and occlusion events. This is achieved by performing a preprocessing step that eliminates the specular highlights and a predicting step, based on a conditional restricted Boltzmann machine, that recovers missing information caused by partial occlusions. Results: We carried out exhaustive experimentations on two datasets, one from a phantom and the other from an in vivo procedure. The results show that our visual approach reaches an average minima in the order of magnitude of 10-7 while preserving the heart’s anatomical structure and providing stable values for the Jacobian determinant ranging from 0.917 to 1.015. We also show that our specular elimination approach reaches an accuracy of 99% compared to a ground truth. In terms of prediction, our approach compared favorably against two well-known predictors, NARX and EKF, giving the lowest average RMSE of 0.071. Conclusion: Our approach avoids the risks of using mechanical stabilizers and can also be effective for acquiring the motion of organs other than the heart, such as the lung or other deformable objects.Peer ReviewedPostprint (published version

Proceedings of the second "international Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST'14)

The implicit objective of the biennial "international - Traveling Workshop on Interactions between Sparse models and Technology" (iTWIST) is to foster collaboration between international scientific teams by disseminating ideas through both specific oral/poster presentations and free discussions. For its second edition, the iTWIST workshop took place in the medieval and picturesque town of Namur in Belgium, from Wednesday August 27th till Friday August 29th, 2014. The workshop was conveniently located in "The Arsenal" building within walking distance of both hotels and town center. iTWIST'14 has gathered about 70 international participants and has featured 9 invited talks, 10 oral presentations, and 14 posters on the following themes, all related to the theory, application and generalization of the "sparsity paradigm": Sparsity-driven data sensing and processing; Union of low dimensional subspaces; Beyond linear and convex inverse problem; Matrix/manifold/graph sensing/processing; Blind inverse problems and dictionary learning; Sparsity and computational neuroscience; Information theory, geometry and randomness; Complexity/accuracy tradeoffs in numerical methods; Sparsity? What's next?; Sparse machine learning and inference.Comment: 69 pages, 24 extended abstracts, iTWIST'14 website: http://sites.google.com/site/itwist1

Adaptive Signal Processing Techniques and Realistic Propagation Modeling for Multiantenna Vital Sign Estimation

Tämän työn keskeisimpänä tavoitteena on ihmisen elintoimintojen tarkkailu ja estimointi käyttäen radiotaajuisia mittauksia ja adaptiivisia signaalinkäsittelymenetelmiä monen vastaanottimen kantoaaltotutkalla. Työssä esitellään erilaisia adaptiivisia menetelmiä, joiden avulla hengityksen ja sydämen värähtelyn aiheuttamaa micro-Doppler vaihemodulaatiota sisältävät eri vastaanottimien signaalit voidaan yhdistää. Työssä johdetaan lisäksi realistinen malli radiosignaalien etenemiselle ja heijastushäviöille, jota käytettiin moniantennitutkan simuloinnissa esiteltyjen menetelmien vertailemiseksi. Saatujen tulosten perusteella voidaan osoittaa, että adaptiiviset menetelmät parantavat langattoman elintoimintojen estimoinnin luotettavuutta, ja mahdollistavat monitoroinnin myös pienillä signaali-kohinasuhteen arvoilla.This thesis addresses the problem of vital sign estimation through the use of adaptive signal enhancement techniques with multiantenna continuous wave radar. The use of different adaptive processing techniques is proposed in a novel approach to combine signals from multiple receivers carrying the information of the cardiopulmonary micro-Doppler effect caused by breathing and heartbeat. The results are based on extensive simulations using a realistic signal propagation model derived in the thesis. It is shown that these techniques provide a significant increase in vital sign rate estimation accuracy, and enable monitoring at lower SNR conditions

Preliminary study of video-based respiratory rate assessment

This paper presents the results of comparative study in physiological monitoring of human respiration rate between electrocardiography-based (ECG) method and video-based method of chest motion detection. The study involved 4 subjects aged from 30 to 70 years. During the study each subject lied on back. Total duration of the study conduct 1.5 hours. The results show that video-based and ECG-based respiration monitoring methods shows similar average respiration rate values. The outcome of the present work incites that video-based respiration assessment can be used as alternative or additional method of human respiration monitoring or diagnosingВ работе представлены результаты сравнительного анализа определения средней частоты дыхания человека полученной по данным сигнала электрокардиограммы (ЭКГ) и видеоизображений движений грудной клетки. В исследовании приняло участие 4 человека в возрасте от 30 до 70 лет. В ходе исследования испытуемые лежали на спине. Суммарная длительность исследований составила 1,5 часа. Показано, что оценки средней частоты дыхания по данным видеоизображений сопоставимы с оценками получаемыми по данным ЭКГ. Таким образом, метод определения дыхания по видеоизображениям может быть использован как альтернативный или дополнительный способ мониторинга или диагностики дыхания человека

Detection of human vital signs in hazardous environments by means of video magnification

In cases of natural disasters, epidemics or even in dangerous situations like an act of terrorism, battle fields, a shooting or a mountain accident, finding survivors is a challenge. In these kind of situations it is sometimes critical to know if a person has vital signs or not, without the need to be in contact with the victim, thus avoiding jeopardizing the lives of the rescue workers. In this work, we propose the use of video magnification techniques to detect small movements in human bodies due to breathing that are invisible to the naked eye. Two different video magnification techniques, intensity-based and phase-based, were tested. The utility of these techniques to detect people who are alive but injured in risk situations was verified by simulating a scene with three people involved in an accident. Several factors such as camera stability, distance to the object, light conditions, magnification factor or computing time were analyzed. The results obtained were quite positive for both techniques, intensity-based method proving more adequate if the interest is in almost instant results whereas the phase-based method is more appropriate if processing time is not so relevant but the degree of magnification without excessive image noise

Unified Quality-Aware Compression and Pulse-Respiration Rates Estimation Framework for Reducing Energy Consumption and False Alarms of Wearable PPG Monitoring Devices

Due to the high demands of tiny, compact, lightweight, and low-cost photoplethysmogram (PPG) monitoring devices, these devices are resource-constrained including limited battery power. Consequently, it highly demands frequent charge or battery replacement in the case of continuous PPG sensing and transmission. Further, PPG signals are often severely corrupted under ambulatory and exercise recording conditions, leading to frequent false alarms. In this paper, we propose a unified quality-aware compression and pulse-respiration rates estimation framework for reducing energy consumption and false alarms of wearable and edge PPG monitoring devices by exploring predictive coding techniques for jointly performing signal quality assessment (SQA), data compression and pulse rate (PR) and respiration rate (RR) estimation without the use of different domains of signal processing techniques that can be achieved by using the features extracted from the smoothed prediction error signal. By using the five standard PPG databases, the performance of the proposed unified framework is evaluated in terms of compression ratio (CR), mean absolute error (MAE), false alarm reduction rate (FARR), processing time (PT) and energy saving (ES). The compression, PR, RR estimation, and SQA results are compared with the existing methods and results of uncompressed PPG signals with sampling rates of 125 Hz and 25 Hz. The proposed unified qualityaware framework achieves an average CR of 4%, SQA (Se of 92.00%, FARR of 84.87%), PR (MAE: 0.46 ±1.20) and RR (MAE: 1.75 (0.65-4.45), PT (sec) of 15.34 ±0.01) and ES of 70.28% which outperforms the results of uncompressed PPG signal with a sampling rate of 125 Hz. Arduino Due computing platformbased implementation demonstrates the real-time feasibility of the proposed unified quality-aware PRRR estimation and data compression and transmission framework on the limited computational resources. Thus, it has great potential in improving energy-efficiency and trustworthiness of wearable and edge PPG monitoring devices.publishedVersio

PREDICTION OF RESPIRATORY MOTION

Radiation therapy is a cancer treatment method that employs high-energy radiation beams to destroy cancer cells by damaging the ability of these cells to reproduce. Thoracic and abdominal tumors may change their positions during respiration by as much as three centimeters during radiation treatment. The prediction of respiratory motion has become an important research area because respiratory motion severely affects precise radiation dose delivery. This study describes recent radiotherapy technologies including tools for measuring target position during radiotherapy and tracking-based delivery systems. In the first part of our study we review three prediction approaches of respiratory motion, i.e., model-based methods, model-free heuristic learning algorithms, and hybrid methods. In the second part of our work we propose respiratory motion estimation with hybrid implementation of extended Kalman filter. The proposed method uses the recurrent neural network as the role of the predictor and the extended Kalman filter as the role of the corrector. In the third part of our work we further extend our research work to present customized prediction of respiratory motion with clustering from multiple patient interactions. For the customized prediction we construct the clustering based on breathing patterns of multiple patients using the feature selection metrics that are composed of a variety of breathing features. In the fourth part of our work we retrospectively categorize breathing data into several classes and propose a new approach to detect irregular breathing patterns using neural networks. We have evaluated the proposed new algorithm by comparing the prediction overshoot and the tracking estimation value. The experimental results of 448 patients’ breathing patterns validated the proposed irregular breathing classifier