Monitoring and detection of agitation in dementia: towards real-time and big-data solutions

The changing demographic profile of the population has potentially challenging social, geopolitical, and financial consequences for individuals, families, the wider society, and governments globally. The demographic change will result in a rapidly growing elderly population with healthcare implications which importantly include Alzheimer type conditions (a leading cause of dementia). Dementia requires long term care to manage the negative behavioral symptoms which are primarily exhibited in terms of agitation and aggression as the condition develops. This paper considers the nature of dementia along with the issues and challenges implicit in its management. The Behavioral and Psychological Symptoms of Dementia (BPSD) are introduced with factors (precursors) to the onset of agitation and aggression. Independent living is considered, health monitoring and implementation in context-aware decision-support systems is discussed with consideration of data analytics. Implicit in health monitoring are technical and ethical constraints, we briefly consider these constraints with the ability to generalize to a range of medical conditions. We postulate that health monitoring offers exciting potential opportunities however the challenges lie in the effective realization of independent assisted living while meeting the ethical challenges, achieving this remains an open research question remains.Peer ReviewedPostprint (author's final draft

Future bathroom: A study of user-centred design principles affecting usability, safety and satisfaction in bathrooms for people living with disabilities

Research and development work relating to assistive technology 2010-11 (Department of Health) Presented to Parliament pursuant to Section 22 of the Chronically Sick and Disabled Persons Act 197

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Utilising Emotion Monitoring for Developing Music Interventions for People with Dementia:A State-of-the-Art Review

The demand for smart solutions to support people with dementia (PwD) is increasing. These solutions are expected to assist PwD with their emotional, physical, and social well-being. At the moment, state-of-the-art works allow for the monitoring of physical well-being; however, not much attention is delineated for monitoring the emotional and social well-being of PwD. Research on emotion monitoring can be combined with research on the effects of music on PwD given its promising effects. More specifically, knowledge of the emotional state allows for music intervention to alleviate negative emotions by eliciting positive emotions in PwD. In this direction, the paper conducts a state-of-the-art review on two aspects: (i) the effect of music on PwD and (ii) both wearable and non-wearable sensing systems for emotional state monitoring. After outlining the application of musical interventions for PwD, including emotion monitoring sensors and algorithms, multiple challenges are identified. The main findings include a need for rigorous research approaches for the development of adaptable solutions that can tackle dynamic changes caused by the diminishing cognitive abilities of PwD with a focus on privacy and adoption aspects. By addressing these requirements, advancements can be made in harnessing music and emotion monitoring for PwD, thereby facilitating the creation of more resilient and scalable solutions to aid caregivers and PwD

AI and Non AI Assessments for Dementia

Current progress in the artificial intelligence domain has led to the development of various types of AI-powered dementia assessments, which can be employed to identify patients at the early stage of dementia. It can revolutionize the dementia care settings. It is essential that the medical community be aware of various AI assessments and choose them considering their degrees of validity, efficiency, practicality, reliability, and accuracy concerning the early identification of patients with dementia (PwD). On the other hand, AI developers should be informed about various non-AI assessments as well as recently developed AI assessments. Thus, this paper, which can be readable by both clinicians and AI engineers, fills the gap in the literature in explaining the existing solutions for the recognition of dementia to clinicians, as well as the techniques used and the most widespread dementia datasets to AI engineers. It follows a review of papers on AI and non-AI assessments for dementia to provide valuable information about various dementia assessments for both the AI and medical communities. The discussion and conclusion highlight the most prominent research directions and the maturity of existing solutions.Comment: 49 page

Mobile psychiatry: Personalised Ambient Monitoring for the mentally ill

Mental health has long been a neglected problem in global healthcare. The social and economic impacts of conditions affecting the mind are still underestimated. However, in recent years it is becoming more apparent that mental disorders are a growing global concern that is not to be trivialised. Considering the rising burden of psychiatric illnesses, there is a necessity of developing novel services and researching effective means of providing interventions to sufferers. Such novel services could include technology-based solutions already used in other healthcare applications but are yet to make their way into standard psychiatric practice. This thesis presents a study on how pervasive technology can be utilised to devise an “early warning” system for patients with bipolar disorder. The system, containing wearable and environmental sensors, would collect behavioural data and use it to inform the user about subtle changes that might indicate an upcoming episode. To test the feasibility of the concept a prototype system was devised, which was followed by trials including four healthy volunteers as well as a bipolar patient. The system included a number of sensory inputs including: accelerometer, light sensors, microphones, GPS tracking and motion detectors. The experiences from the trials led to a conclusion that a large number of sensors may result in incompliance from the users. Therefore, a separate investigation was launched into developing a methodology for detecting behavioural patterns in inputs possible to collect from a mobile phone alone. The premise being that a phone is an everyday use appliance and is likely to be carried and accepted by the patient. The trial revealed that monitoring GPS tracks and Bluetooth encounters has the potential of gaining an insight into a person’s social and behavioural patterns, which usually are strongly influenced by the course of bipolar disorder. Lessons learned during these proceedings amounted to a clearer concept of how a future personalised ambient monitoring system could improve the outcome of treatment of bipolar disorder as well as other psychiatric conditions

Wearable, Environmental, and Smartphone-Based Passive Sensing for Mental Health Monitoring

Collecting and analyzing data from sensors embedded in the context of daily life has been widely employed for the monitoring of mental health. Variations in parameters such as movement, sleep duration, heart rate, electrocardiogram, skin temperature, etc., are often associated with psychiatric disorders. Namely, accelerometer data, microphone, and call logs can be utilized to identify voice features and social activities indicative of depressive symptoms, and physiological factors such as heart rate and skin conductance can be used to detect stress and anxiety disorders. Therefore, a wide range of devices comprising a variety of sensors have been developed to capture these physiological and behavioral data and translate them into phenotypes and states related to mental health. Such systems aim to identify behaviors that are the consequence of an underlying physiological alteration, and hence, the raw sensor data are captured and converted into features that are used to define behavioral markers, often through machine learning. However, due to the complexity of passive data, these relationships are not simple and need to be well-established. Furthermore, parameters such as intrapersonal and interpersonal differences need to be considered when interpreting the data. Altogether, combining practical mobile and wearable systems with the right data analysis algorithms can provide a useful tool for the monitoring and management of mental disorders. The current review aims to comprehensively present and critically discuss all available smartphone-based, wearable, and environmental sensors for detecting such parameters in relation to the treatment and/or management of the most common mental health conditions

Mobile psychiatry: Personalised Ambient Monitoring for the mentally ill

Mental health has long been a neglected problem in global healthcare. The social and economic impacts of conditions affecting the mind are still underestimated. However, in recent years it is becoming more apparent that mental disorders are a growing global concern that is not to be trivialised. Considering the rising burden of psychiatric illnesses, there is a necessity of developing novel services and researching effective means of providing interventions to sufferers. Such novel services could include technology-based solutions already used in other healthcare applications but are yet to make their way into standard psychiatric practice. This thesis presents a study on how pervasive technology can be utilised to devise an “early warning” system for patients with bipolar disorder. The system, containing wearable and environmental sensors, would collect behavioural data and use it to inform the user about subtle changes that might indicate an upcoming episode. To test the feasibility of the concept a prototype system was devised, which was followed by trials including four healthy volunteers as well as a bipolar patient. The system included a number of sensory inputs including: accelerometer, light sensors, microphones, GPS tracking and motion detectors. The experiences from the trials led to a conclusion that a large number of sensors may result in incompliance from the users. Therefore, a separate investigation was launched into developing a methodology for detecting behavioural patterns in inputs possible to collect from a mobile phone alone. The premise being that a phone is an everyday use appliance and is likely to be carried and accepted by the patient. The trial revealed that monitoring GPS tracks and Bluetooth encounters has the potential of gaining an insight into a person’s social and behavioural patterns, which usually are strongly influenced by the course of bipolar disorder. Lessons learned during these proceedings amounted to a clearer concept of how a future personalised ambient monitoring system could improve the outcome of treatment of bipolar disorder as well as other psychiatric conditions