Chronic-Pain Protective Behavior Detection with Deep Learning

In chronic pain rehabilitation, physiotherapists adapt physical activity to patients' performance based on their expression of protective behavior, gradually exposing them to feared but harmless and essential everyday activities. As rehabilitation moves outside the clinic, technology should automatically detect such behavior to provide similar support. Previous works have shown the feasibility of automatic protective behavior detection (PBD) within a specific activity. In this paper, we investigate the use of deep learning for PBD across activity types, using wearable motion capture and surface electromyography data collected from healthy participants and people with chronic pain. We approach the problem by continuously detecting protective behavior within an activity rather than estimating its overall presence. The best performance reaches mean F1 score of 0.82 with leave-one-subject-out cross validation. When protective behavior is modelled per activity type, performance is mean F1 score of 0.77 for bend-down, 0.81 for one-leg-stand, 0.72 for sit-to-stand, 0.83 for stand-to-sit, and 0.67 for reach-forward. This performance reaches excellent level of agreement with the average experts' rating performance suggesting potential for personalized chronic pain management at home. We analyze various parameters characterizing our approach to understand how the results could generalize to other PBD datasets and different levels of ground truth granularity.Comment: 24 pages, 12 figures, 7 tables. Accepted by ACM Transactions on Computing for Healthcar

Accelerometry based detection of epileptic seizures

Epilepsy is one of the most common neurological disorders. Epileptic seizures are the manifestation of abnormal hypersynchronous discharges of cortical neurons that impair brain function. Most of the people affected can be treated successfully with drug therapy or neurosurgical procedures. But there is still a large group of epilepsy patients that continues to have frequent seizures. For these patients automated detection of epileptic seizures can be of great clinical importance. Seizure detection can influence daily care or can be used to evaluate treatment effect. Furthermore automated detection can be used to trigger an alarm system during seizures that might be harmful to the patient. This thesis focusses on accelerometry (ACM) based seizure detection. A detailed overview is provided, on the perspectives for long-term epilepsy monitoring and automated seizure detection. The value of accelerometry for seizure detection is shown by means of a clinical evaluation and the first steps are made towards automatic detection of epileptic seizures based on ACM. With accelerometers movements are recorded. A large group of epileptic seizures manifest in specific movement patterns, so called motor seizures. Chapter 2 of this thesis presents an overview of the published literature on available methods for epileptic seizure detection in a long-term monitoring context. Based on this overview recommendations are formulated that should be used in seizure detection research and development. It is shown that for seizure detection in home environments, other sensor modalities besides EEG become more important. The use of alternative sensor modalities (such as ACM) is relatively new and so is the algorithm development for seizure detection based on these measures. It was also found that for both the adaptation of existing techniques and the development of new algorithms, clinical information should be taken more into account. The value of ACM for seizure detection is shown by means of a clinical evaluation in chapter 3. Here 3-D ACM- and EEG/video-recordings of 18 patients with severe epilepsy are visually analyzed. A striking outcome presented in this chapter is the large number of visually detected seizures versus the number of seizures that was expected on forehand and the number of seizures that was observed by the nurses. These results underscore the need for an automatic seizure detection device even more, since in the current situation many seizures are missed and therefore it is possible that patients do not get the right (medical) treatment. It was also observed that 95% of the ACM-patterns during motor seizures are sequences of three elementary patterns: myoclonic, tonic and clonic patterns. These characteristic patterns are a starting point for the development of methods for automated seizure detection based on ACM. It was decided to use a modular approach for the detection methodology and develop algorithms separately for motor activity in general, myoclonic seizures and tonic seizures. Furthermore, clinical information is incorporated in the detection methodology. Therefore in this thesis features were used that are either based on the shape of the patterns of interest as described in clinical practice (chapter 4 and 7), or the features were based on a physiological model with parameters that are related to seizure duration and intensity (chapter 5 and 6). In chapter 4 an algorithm is developed to distinguish periods with and without movement from ACM-data. Hence, when there is no movement there is no motor seizure. The amount of data that needs further analysis for seizure detection is thus reduced. From 15 ACM-signals (measured on five positions on the body), two features are computed, the variance and the jerk. In the resulting 2-D feature space a linear threshold function is used for classification. For training and testing the algorithm ACM data along with video data are used from nocturnal recordings in mentally retarded patients with severe epilepsy. Using this algorithm the amount of data that needs further analysis is reduced considerably. The results also indicate that the algorithm is robust for fluctuations across patients and thus there is no need for training the algorithm for each new patient. For the remaining data it needs to be established whether the detected movement is seizure related or not. To this purpose a model is developed for the accelerometer pattern measured on the arm during a myoclonic seizure (chapter 5). The model consists of a mechanical and an electrophysiological part. This model is used as a matched wavelet filter to detect myoclonic seizures. In chapter 6 the model based wavelet is compared to three other time frequency measures: the short time Fourier transform, the Wigner distribution and the continuous wavelet transform using a Daubechies wavelet. All four time-frequency methods are evaluated in a linear classification setup. Data from mentally retarded patients with severe epilepsy are used for training and evaluation. The results show that both wavelets are useful for detection of myoclonic seizures. On top of that, our model based wavelet has the advantage that it consists of parameters that are related to seizure duration and intensity that are physiological meaningful. Besides myoclonic seizures, the model is also useful for the detection of clonic seizures; physiologically these are repetitive myoclonic seizures. Finally for the detection of tonic seizures, in chapter 7 a set of features is studied that incorporate the mean characteristics of ACM-patterns associated with tonic seizures. Linear discriminant analysis is used for classification in the multi-dimensional feature space. For training and testing the algorithm, again data are used from recordings in mentally retarded patients with severe epilepsy. The results show that our approach is useful for the automated detection of tonic seizures based on 3-D ACM and that it is a promising contribution in a complete multi-sensor seizure detection setup

Home detection of freezing of gait using Support Vector Machines through a single waist-worn triaxial accelerometer

Among Parkinson’s disease (PD) symptoms, freezing of gait (FoG) is one of the most debilitating. To assess FoG, current clinical practice mostly employs repeated evaluations over weeks and months based on questionnaires, which may not accurately map the severity of this symptom. The use of a non-invasive system to monitor the activities of daily living (ADL) and the PD symptoms experienced by patients throughout the day could provide a more accurate and objective evaluation of FoG in order to better understand the evolution of the disease and allow for a more informed decision-making process in making adjustments to the patient’s treatment plan. This paper presents a new algorithm to detect FoG with a machine learning approach based on Support Vector Machines (SVM) and a single tri-axial accelerometer worn at the waist. The method is evaluated through the acceleration signals in an outpatient setting gathered from 21 PD patients at their home and evaluated under two different conditions: first, a generic model is tested by using a leave-one-out approach and, second, a personalised model that also uses part of the dataset from each patient. Results show a significant improvement in the accuracy of the personalised model compared to the generic model, showing enhancement in the specificity and sensitivity geometric mean (GM) of 7.2%. Furthermore, the SVM approach adopted has been compared to the most comprehensive FoG detection method currently in use (referred to as MBFA in this paper). Results of our novel generic method provide an enhancement of 11.2% in the GM compared to the MBFA generic model and, in the case of the personalised model, a 10% of improvement with respect to the MBFA personalised model. Thus, our results show that a machine learning approach can be used to monitor FoG during the daily life of PD patients and, furthermore, personalised models for FoG detection can be used to improve monitoring accuracy.Peer ReviewedPostprint (published version

Accounting for the Specious Present: A Defense of Enactivism

I argue that conscious visual experience is essentially a non-representational demonstration of a skill. The explication and defense of this position depends on both phenomenological and empirical considerations. The central phenomenological claim is this: as a matter of human psychology, it is impossible to produce a conscious visual experience of a mind-independent object that is sufficiently like typical cases, without including concomitant proprioceptive sensations of the sort of extra-neural behavior that allows us to there and then competently detect such objects. I then argue that this view, which is a version of enactivism, best explains the temporality of conscious experience—what is often called the specious present

Computer vision tools for the non-invasive assessment of autism-related behavioral markers

The early detection of developmental disorders is key to child outcome, allowing interventions to be initiated that promote development and improve prognosis. Research on autism spectrum disorder (ASD) suggests behavioral markers can be observed late in the first year of life. Many of these studies involved extensive frame-by-frame video observation and analysis of a child's natural behavior. Although non-intrusive, these methods are extremely time-intensive and require a high level of observer training; thus, they are impractical for clinical and large population research purposes. Diagnostic measures for ASD are available for infants but are only accurate when used by specialists experienced in early diagnosis. This work is a first milestone in a long-term multidisciplinary project that aims at helping clinicians and general practitioners accomplish this early detection/measurement task automatically. We focus on providing computer vision tools to measure and identify ASD behavioral markers based on components of the Autism Observation Scale for Infants (AOSI). In particular, we develop algorithms to measure three critical AOSI activities that assess visual attention. We augment these AOSI activities with an additional test that analyzes asymmetrical patterns in unsupported gait. The first set of algorithms involves assessing head motion by tracking facial features, while the gait analysis relies on joint foreground segmentation and 2D body pose estimation in video. We show results that provide insightful knowledge to augment the clinician's behavioral observations obtained from real in-clinic assessments