Unsupervised Pre-trained Models from Healthy ADLs Improve Parkinson's Disease Classification of Gait Patterns

Application and use of deep learning algorithms for different healthcare applications is gaining interest at a steady pace. However, use of such algorithms can prove to be challenging as they require large amounts of training data that capture different possible variations. This makes it difficult to use them in a clinical setting since in most health applications researchers often have to work with limited data. Less data can cause the deep learning model to over-fit. In this paper, we ask how can we use data from a different environment, different use-case, with widely differing data distributions. We exemplify this use case by using single-sensor accelerometer data from healthy subjects performing activities of daily living - ADLs (source dataset), to extract features relevant to multi-sensor accelerometer gait data (target dataset) for Parkinson's disease classification. We train the pre-trained model using the source dataset and use it as a feature extractor. We show that the features extracted for the target dataset can be used to train an effective classification model. Our pre-trained source model consists of a convolutional autoencoder, and the target classification model is a simple multi-layer perceptron model. We explore two different pre-trained source models, trained using different activity groups, and analyze the influence the choice of pre-trained model has over the task of Parkinson's disease classification.Comment: Accepted in the 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society (EMBC 2020

Remote timed up and go evaluation from activities of daily living reveals changing mobility after surgery

Background: Mobility impairment is common in older adults and negatively influences the quality of life. Mobility level may change rapidly following surgery or hospitalization in the elderly. The timed up and go (TUG) is a simple, frequently used clinical test for functional mobility; however, TUG requires supervision from a trained clinician, resulting in infrequent assessments. Additionally, assessment by TUG in clinic settings may not be completely representative of the individual's mobility in their home environment. Objective: In this paper, we introduce a method to estimate TUG from activities detected in free-living, enabling continuous remote mobility monitoring without expert supervision. The method is used to monitor changes in mobility following total hip arthroplasty (THA). Methods: Community-living elderly (n = 239, 65-91 years) performed a standardized TUG in a laboratory and wore a wearable pendant device that recorded accelerometer and barometric sensor data for at least three days. Activities of daily living (ADLs), including walks and sit-to-stand transitions, and their related mobility features were extracted and used to develop a regularized linear model for remote TUG test estimation. Changes in the remote TUG were evaluated in orthopaedic patients (n = 15, 55-75 years), during 12-weeks period following THA. Main results: In leave-one-out-cross-validation (LOOCV), a strong correlation (p = 0.70) was observed between the new remote TUG and standardized TUG times. Test-retest reliability of 3-days estimates was high (ICC = 0.94). Compared to week 2 post-THA, remote TUG was significantly improved at week 6 (11.7 +/- 3.9 s versus 8.0 +/- 1.8 s,p &lt;0.001), with no further change at 12-weeks (8.1 +/- 3.9s, p = 0.37). Significance: Remote TUG can be estimated in older adults using 3-days of ADLs data recorded using a wearable pendant. Remote TUG has discriminatory potential for identifying frail elderly and may provide a convenient way to monitor changes in mobility in unsupervised settings.</p

Wearable sensor technologies applied for post-stroke rehabilitation

Stroke is a common cerebrovascular disease that is recognized as one of the leading causes of death and ongoing disability around the globe. Stroke can lead to losses of various body functions depending on the affected area of the brain and leave significant impacts to the victim&amp;rsquo;s daily life. Post-stroke rehabilitation plays an important role in improving the life quality of stroke survivors. Properly designed rehabilitation training programs can not only prevent further functional deterioration, but also helps patients gradually regain their body functionalities. However, the delivery of rehabilitation service can be a complex and labour intensive task. In conventional rehabilitation systems, the chart-based ordinal scales are considered the dominant tools for impairment assessment and the administration of the scales primarily relies on the doctor&amp;rsquo;s manual observation. Measuring instruments such as strain gauge and force platforms can sometimes be used to collect quantitative evidence for some of the body functions such as grip strength and balance. However, the evaluation of the patients&amp;rsquo; impairment level using ordinal scales still depend on the human interpretation of the data which can be both subjective and inefficient. The preferred scale and evaluation standard also vary among institutions across different regions which make the comparison of data difficult and sometimes unreliable. Furthermore, the intensive manual supervision and support required in rehabilitation training session limits the accessibility of the service as the regular visit to qualified hospital can be onerous for many patients and the associated cost can impose an enormous financial burden on both the government and the households. The situation can be even more challenging in developing countries due to higher growing rate of stroke population and more limited medical resources. The works presented in this thesis are focused on exploring the possibilities of integrating wearable sensor and pattern recognition techniques to improve the efficiency and the effectiveness of post-stroke rehabilitation by addressing the abovementioned issues. The study was initiated by a comprehensive literature review on the latest motion tracking technologies and non-visual based Inertia Measurement Unit (IMU) had been selected as the most suitable candidate for motion sensing in unsupervised training environment due to its low-cost and easy-to-operate characteristics. Following the design and construction of the 6-axis IMU based Body Area Network (BAN), a series of stroke patient motion data collection experiments had been conducted in conjunction with the Jiaxing 2nd Hospital Rehabilitation Centre in Zhejiang province, China. The collected motion samples were then investigated using various signal processing algorithms and pattern recognition techniques to achieve the three major objectives: automatic impairment level classification for reducing human effort involved in regular clinical assessment, single-index based limb mobility evaluation for providing objective evidence to support unified body function assessment standards, and training motion classification for enabling home or community based rehabilitation training with reduced supervision. At last, the study has been further expanded by incorporating surface Electromyography (sEMG) signal sampled during rehabilitation exercises as an alternative input to enhance accurate impairment level classification. The outcome of the investigations demonstrate that the wearable technology can play an important role within a tele-rehabilitation system by providing objective, accurate and often realtime indications of the recovery process as well as the assistance for training management

A pervasive body sensor network for monitoring post-operative recovery

Over the past decade, miniaturisation and cost reduction brought about by the semiconductor industry has led to computers smaller in size than a pin head, powerful enough to carry out the processing required, and affordable enough to be disposable. Similar technological advances in wireless communication, sensor design, and energy storage have resulted in the development of wireless “Body Sensor Network (BSN) platforms comprising of tiny integrated micro sensors with onboard processing and wireless data transfer capability, offering the prospect of pervasive and continuous home health monitoring. In surgery, the reduced trauma of minimally invasive interventions combined with initiatives to reduce length of hospital stay and a socioeconomic drive to reduce hospitalisation costs, have all resulted in a trend towards earlier discharge from hospital. There is now a real need for objective, pervasive, and continuous post-operative home recovery monitoring systems. Surgical recovery is a multi-faceted and dynamic process involving biological, physiological, functional, and psychological components. Functional recovery (physical independence, activities of daily living, and mobility) is recognised as a good global indicator of a patient’s post-operative course, but has traditionally been difficult to objectively quantify. This thesis outlines the development of a pervasive wireless BSN system to objectively monitor the functional recovery of post-operative patients at home. Biomechanical markers were identified as surrogate measures for activities of daily living and mobility impairment, and an ear-worn activity recognition (e-AR) sensor containing a three-axis accelerometer and a pulse oximeter was used to collect this data. A simulated home environment was created to test a Bayesian classifier framework with multivariate Gaussians to model activity classes. A real-time activity index was used to provide information on the intensity of activity being performed. Mobility impairment was simulated with bracing systems and a multiresolution wavelet analysis and margin-based feature selection framework was used to detect impaired mobility. The e-AR sensor was tested in a home environment before its clinical use in monitoring post-operative home recovery of real patients who have undergone surgery. Such a system may eventually form part of an objective pervasive home recovery monitoring system tailored to the needs of today’s post-operative patient.Open acces

The effectiveness of a community-based exercise and educational programme on depression in Greek population with Parkinson’s disease

Depression is among the most common symptoms of Parkinson’s disease (PD); and its estimated prevalence is 35%. A systematic review revealed that there is insufficient evidence to draw strong conclusions about the antidepressant effects of exercise in PD. Hence, in order to address this important question, a randomised controlled trial (RCT) was conducted in Greece. To aid the design of the RCT, a patient survey was performed which indicated that PD affects both physical function and mental health, even from the first stages of the disease; and the most prevalent responses were considered for the design of the RCT. The RCT, examined whether a community-based exercise and educational programme could produce short- and longer-term antidepressant effects in depressed patients with PD. Eligible participants were allocated either to a supervised group-based exercise and educational programme (intervention group) or an unsupervised individualised home-based training (comparison group). The findings revealed no significant differences between the two groups at the end of the treatment and three-month follow-up period. However, one-way repeated measures of ANOVA showed that the depressive scores were significantly improved in the intervention group over time (p= .00; t1-t2: p= .00; t1-t3: p= .01), and the magnitude of the effect was medium (t1-t2: r= .40; t1-t3: r= .31). Improvements in mood were also reported by the participants. The intervention also had positive effects on anxiety levels, motor function and quality of life. The findings of this thesis showed that the treatment potential is high; and a simple community-based exercise and educational programme, without the use of expensive and sophisticated equipment, can be prescribed for depression in patients with PD

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Effectiveness of intensive physiotherapy for gait improvement in stroke: systematic review

Introduction: Stroke is one of the leading causes of functional disability worldwide. Approximately 80% of post-stroke subjects have motor changes. Improvement of gait pattern is one of the main objectives of physiotherapists intervention in these cases. The real challenge in the recovery of gait after stroke is to understand how the remaining neural networks can be modified, to be able to provide response strategies that compensate for the function of the affected structures. There is evidence that intensive training, including physiotherapy, positively influences neuroplasticity, improving mobility, pattern and gait velocity in post-stroke recovery. Objectives: Review and analyze in a systematic way the experimental studies (RCT) that evaluate the effects of Intensive Physiotherapy on gait improvement in poststroke subjects. Methodology: Were only included all RCT performed in humans, without any specific age, that had a clinical diagnosis of stroke at any stage of evolution, with sensorimotor deficits and functional gait changes. The databases used were: Pubmed, PEDro (Physiotherapy Evidence Database) and CENTRAL (Cochrane Center Register of Controlled Trials). Results: After the application of the criteria, there were 4 final studies that were included in the systematic review. 3 of the studies obtained a score of 8 on the PEDro scale and 1 obtained a score of 4. The fact that there is clinical and methodological heterogeneity in the studies evaluated, supports the realization of the current systematic narrative review, without meta-analysis. Discussion: Although the results obtained in the 4 studies are promising, it is important to note that the significant improvements that have been found, should be carefully considered since pilot studies with small samples, such as these, are not designed to test differences between groups, in terms of the effectiveness of the intervention applied. Conclusion: Intensive Physiotherapy seems to be safe and applicable in post-stroke subjects and there are indications that it is effective in improving gait, namely speed, travelled distance and spatiotemporal parameters. However, there is a need to develop more RCTs with larger samples and that evaluate the longterm resultsN/

State of the Art of Audio- and Video-Based Solutions for AAL

It is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters. Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals. Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely lifelogging and self-monitoring, remote monitoring of vital signs, emotional state recognition, food intake monitoring, activity and behaviour recognition, activity and personal assistance, gesture recognition, fall detection and prevention, mobility assessment and frailty recognition, and cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed