Sensing the care:Advancing unobtrusive sensing solutions to support informal caregivers of older adults with cognitive impairment

Older adults (65 years and above) make up a growing proportion of the world's population which is anticipated to increase further in the coming decades. As individuals age, they often become more vulnerable to cognitive impairments, necessitating a diverse array of care and support services from their caregivers to uphold their quality of life. However, the scarcity of professional caregivers and care facilities, compounded by the preference of many older adults to remain in their own homes, places a significant burden on informal caregivers, adversely affecting their physical, mental, and social well-being. To assist informal caregivers, numerous sensing solutions have been developed. However, many of these solutions are not optimally suited for older adult care, particularly in cases of cognitive impairments. In that regard, the overarching aim of this thesis was to develop and evaluate the Unobtrusive Sensing Solution (USS) for in-home monitoring of older adults with cognitive impairment (OwCI) who live alone in their own houses to ease the support of their informal caregivers. In the 'Explore and Scope' part, a scoping review was conducted to identify available unobtrusive sensing technology that can be implemented in older adult care. Subsequently, in the 'Develop and Test' part, Wi-Fi CSI technology was utilized to collect a dataset illustrating physical agitation activities (Wi-Gitation). However, upon evaluation of the Wi-Gitation dataset, a challenge of generalization across different domains (or environments) was identified. To address this, the Inter-data Selected Sequential Transfer Learning framework was proposed and implemented. Lastly, in the 'Design to Communicate' part, the thesis focused on identifying the needs and requirements of informal caregivers of OwCI towards USSs. These needs and requirements were gathered through interviews and surveys, informing the development of a Lo-Fi prototype for an interaction platform. Overall, the results obtained in this thesis not only enhance the development of Wi-Fi CSI (specifically for OwCI care) but also provide valuable insights into the informational and design requirements of informal caregivers, thereby promoting the context-aware development of USSs

Interwoven Waves:Enhancing the Scalability and Robustness of Wi-Fi Channel State Information for Human Activity Recognition

This PhD dissertation investigates the future of unobtrusive radio wave-based sensing, specifically focusing on Wi-Fi sensing in realistic healthcare scenarios. Wi-Fi sensing leverages the analysis of multi-path reflections of radio waves to monitor human activities and physiological states, providing a scalable solution without intruding on daily life.Wi-Fi-based sensing, particularly through channel state information, fits well in healthcare due to its ubiquitous presence and unobtrusiveness. As our society ages and populations grow, continuous health monitoring becomes increasingly critical. Existing solutions like wearable devices, audiovisual technologies, and expensive infrastructure modifications each have limitations, such as forgetting to wear devices, privacy invasions, and high costs. Channel state information-based sensing offers a promising alternative, enabling remote monitoring without the need for additional infrastructure changes.Nevertheless, implementing channel state information-based sensing in already congested Wi-Fi bands could present challenges in the future. Current solutions often exacerbate congestion by adding random noise, which can degrade network performance. These solutions also tend to address niche problems in idealistic settings, making it difficult to justify their use in everyday environments due to potential impacts on network latency and overall user experience.To realise the potential of Wi-Fi sensing, future solutions must integrate seamlessly with wireless communication networks, ensuring that sensing and communication processes coexist and collaborate effectively. This dissertation categorises the relationship between sensing and communication into three models: parasitic, opportunistic, and mutualistic. In the parasitic model, sensing operates independently of the wireless infrastructure, potentially adding noise and congestion. The opportunistic model leverages existing traffic flows, avoiding adverse effects on communication. The mutualistic model aims for a balance, enhancing both sensing and communication without compromising either function.The primary research objective is to enhance the robustness and scalability of channel state information-based sensing for human activity recognition, facilitating seamless integration into home environments with minimal impact on existing infrastructure. Overall, this dissertation provides an exploration of the challenges and solutions for unobtrusive Wi-Fi sensing in healthcare, paving the way for future advancements in the field

Sensing and Signal Processing in Smart Healthcare

In the last decade, we have witnessed the rapid development of electronic technologies that are transforming our daily lives. Such technologies are often integrated with various sensors that facilitate the collection of human motion and physiological data and are equipped with wireless communication modules such as Bluetooth, radio frequency identification, and near-field communication. In smart healthcare applications, designing ergonomic and intuitive human–computer interfaces is crucial because a system that is not easy to use will create a huge obstacle to adoption and may significantly reduce the efficacy of the solution. Signal and data processing is another important consideration in smart healthcare applications because it must ensure high accuracy with a high level of confidence in order for the applications to be useful for clinicians in making diagnosis and treatment decisions. This Special Issue is a collection of 10 articles selected from a total of 26 contributions. These contributions span the areas of signal processing and smart healthcare systems mostly contributed by authors from Europe, including Italy, Spain, France, Portugal, Romania, Sweden, and Netherlands. Authors from China, Korea, Taiwan, Indonesia, and Ecuador are also included

Sensing Systems for Respiration Monitoring: A Technical Systematic Review

Respiratory monitoring is essential in sleep studies, sport training, patient monitoring, or health at work, among other applications. This paper presents a comprehensive systematic review of respiration sensing systems. After several systematic searches in scientific repositories, the 198 most relevant papers in this field were analyzed in detail. Different items were examined: sensing technique and sensor, respiration parameter, sensor location and size, general system setup, communication protocol, processing station, energy autonomy and power consumption, sensor validation, processing algorithm, performance evaluation, and analysis software. As a result, several trends and the remaining research challenges of respiration sensors were identified. Long-term evaluations and usability tests should be performed. Researchers designed custom experiments to validate the sensing systems, making it difficult to compare results. Therefore, another challenge is to have a common validation framework to fairly compare sensor performance. The implementation of energy-saving strategies, the incorporation of energy harvesting techniques, the calculation of volume parameters of breathing, or the effective integration of respiration sensors into clothing are other remaining research efforts. Addressing these and other challenges outlined in the paper is a required step to obtain a feasible, robust, affordable, and unobtrusive respiration sensing system

A Federated Filtering Framework for Internet of Medical Things

Based on the dominant paradigm, all the wearable IoT devices used in the healthcare sector also known as the internet of medical things (IoMT) are resource constrained in power and computational capabilities. The IoMT devices are continuously pushing their readings to the remote cloud servers for real-time data analytics, that causes faster drainage of the device battery. Moreover, other demerits of continuous centralizing of data include exposed privacy and high latency. This paper presents a novel Federated Filtering Framework for IoMT devices which is based on the prediction of data at the central fog server using shared models provided by the local IoMT devices. The fog server performs model averaging to predict the aggregated data matrix and also computes filter parameters for local IoMT devices. Two significant theoretical contributions of this paper are the global tolerable perturbation error (${To{l_F}}$) and the local filtering parameter ($\delta$); where the former controls the decision-making accuracy due to eigenvalue perturbation and the later balances the tradeoff between the communication overhead and perturbation error of the aggregated data matrix (predicted matrix) at the fog server. Experimental evaluation based on real healthcare data demonstrates that the proposed scheme saves upto 95\% of the communication cost while maintaining reasonable data privacy and low latency.Comment: 6 pages, 6 Figures, accepted for oral presentation in IEEE ICC 2019, Internet of Things, Federated Learning and Perturbation theor

Contactless WiFi Sensing and Monitoring for Future Healthcare:Emerging Trends, Challenges and Opportunities

WiFi sensing has recently received significant interest from academics, industry, healthcare professionals and other caregivers (including family members) as a potential mechanism to monitor our aging population at distance, without deploying devices on users bodies. In particular, these methods have gained significant interest to efficiently detect critical events such as falls, sleep disturbances, wandering behavior, respiratory disorders, and abnormal cardiac activity experienced by vulnerable people. The interest in such WiFi-based sensing systems stems from its practical deployments in indoor settings and compliance from monitored persons, unlike other sensors such as wearables, camera-based, and acoustic-based solutions. This paper reviews state-of-the-art research on collecting and analysing channel state information, extracted using ubiquitous WiFi signals, describing a range of healthcare applications and identifying a series of open research challenges, untapped areas, and related trends.This work aims to provide an overarching view in understanding the technology and discusses its uses-cases from a perspective that considers hardware, advanced signal processing, and data acquisition

Comparison of Collaborative and Cooperative Schemes in Sensor Networks for Non-Invasive Monitoring of People at Home

This paper looks at wireless sensor networks (WSNs) in healthcare, where they can monitor patients remotely. WSNs are considered one of the most promising technologies due to their flexibility and autonomy in communication. However, routing protocols in WSNs must be energy-efficient, with a minimal quality of service, so as not to compromise patient care. The main objective of this work is to compare two work schemes in the routing protocol algorithm in WSNs (cooperative and collaborative) in a home environment for monitoring the conditions of the elderly. The study aims to optimize the performance of the algorithm and the ease of use for people while analyzing the impact of the sensor network on the analysis of vital signs daily using medical equipment. We found relationships between vital sign metrics that have a more significant impact in the presence of a monitoring system. Finally, we conduct a performance analysis of both schemes proposed for the home tracking application and study their usability from the user’s point of view

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Continuous monitoring of vital parameters for clinically valid assessment of human health status

Tese de mestrado integrado, Engenharia Biomédica e Biofísica (Sinais e Imagens Médicas) Universidade de Lisboa, Faculdade de Ciências, 2019The lack of devices suitable for acquiring accurate and reliable measures of patients' physiolog-ical signals in a remote and continuous manner together with the advances in data acquisition technol-ogies during the last decades, have led to the emergence of wearable devices for healthcare. Wearable devices enable remote, continuous and long-term health monitoring in unattended setting. In this con-text, the Swiss Federal Laboratories for Material Science and Technology (Empa) developed a wearable system for long-term electrocardiogram measurements, referred to as textile belt. It consists of a chest strap with two embroidered textile electrodes. The validity of Empa’s system for electrocardiogram monitoring has been proven in a clinical setting. This work aimed to assess the validity of the textile belt for electrocardiogram monitoring in a home setting and to supplement the existing system with sensors for respiratory monitoring. Another objective was to evaluate the suitability of the same weara-ble, as a multi-sensor system, for activity monitoring. A study involving 12 patients (10 males and 2 females, interquartile range for age of 48–59 years and for body mass indexes of 28.0–35.5 kg.m-2) with suspected sleep apnoea was carried out. Overnight electrocardiogram was measured in a total of 28 nights. The quality of recorded signals was assessed using signal-to-noise ratio, artefacts detection and Poincaré plots. Study data were compared to data from the same subjects, acquired in the clinical setting. For respiratory monitoring, optical fibre-based sensors of different geometries were integrated into the textile belt. Signal processing algorithms for breathing rate and tidal volume estimation based on respiratory signals acquired by the sensors were developed. Pilot studies were conducted to compare the different approaches for respiratory monitoring. The quality of respiratory signals was determined based on signal segments “sinusoidality”, evaluated through the calculation of the cross-correlation between signal segments and segment-specific reference waves. A method for accelerometry-based lying position recognition was proposed, and the proof of concept of activity intensity classification through the combination of subjects’ inertial acceleration, heart rate and breathing rate data, was presented. Finally, a study with three participants (1 male and 2 females, aged 21 ± 2 years, body mass index of 20.3 ± 1.5 kg.m-2) was conducted to assess the validity of the textile belt for respiratory and activity monitoring. Electrocardiogram signals acquired by the textile belt in the home setting were found to have better quality than the data acquired by the same device in the clinical setting. Although a higher artefact percentage was found for the textile belt, signal-to-noise ratio of electrocardiogram signals recorded by the textile belt in the home setting was similar to that of signals acquired by the gel electrodes in the clinical setting. A good agreement was found between the RR-intervals derived from signals recorded in home and clinical settings. Besides, for artefact percentages greater than 3%, visual assessment of Poincaré plots proved to be effective for the determination of the primary source of artefacts (noise or ectopic beats). Acceleration data allowed posture recognition (i.e. lying or standing/sitting, lying position) with an accuracy of 91% and positive predictive value of 80%. Lastly, preliminary results of physical activity intensity classification yielded high accuracy, showing the potential of the proposed method. The textile belt proved to be appropriate for long-term, remote and continuous monitoring of subjects’ physical and physiological parameters. It can monitor not only electrocardiogram, but also breathing rate, body posture and physical activity intensity, having the potential to be used as tool for disease prediction and diagnose support.Contexto: A falta de dispositivos adequados para a monitorização de sinais fisiológicos de um modo remoto e contínuo, juntamente com avanços tecnológicos na área de aquisição de dados nas últimas décadas, levaram ao surgimento de wearable devices, i.e. dispositivos vestíveis, no sector da saúde. Wearable devices possibilitam a monitorização do estado de saúde, de uma forma remota, contínua e de longa duração. Quando feito em ambiente domiciliar, este tipo de monitorização (i.e. contínua, remota e de longa duração) tem várias vantagens: diminui a pressão posta sobre o sistema de saúde, reduz despesas associadas ao internamento e acelera a resposta a emergências, permitindo deteção precoce e prevenção de condições crónicas. Neste contexto, a Empa, Laboratórios Federais Suíços de Ciência e Tecnologia de Materiais, desenvolveu um sistema vestível para a monitorização de eletrocardiograma de longa duração. Este sistema consiste num cinto peitoral com dois elétrodos têxteis integrados. Os elétrodos têxteis são feitos de fio de polietileno tereftalato revestido com prata e uma ultrafina camada de titânio no topo. De modo a garantir a aquisição de sinais de alta qualidade, o cinto tem nele integrado um reservatório de água que liberta vapor de água para humidificar os elétrodos. Este reservatório per-mite a monitorização contínua de eletrocardiograma por 5 a 10 dias, sem necessitar de recarga. A vali-dade do cinto para a monitorização de eletrocardiograma em ambiente clínico já foi provada. Objetivo: Este trabalho teve por objetivo avaliar a validade do cinto para a monitorização de eletrocar-diograma em ambiente domiciliar e complementar o sistema existente com sensores para monitorização respiratória. Um outro objetivo foi analisar a adequação do cinto, como um sistema multisensor, para monitorização da atividade física. Métodos: Um estudo com 12 pacientes com suspeita de apneia do sono (10 homens e 2 mulheres, am-plitude interquartil de 48–59 anos para a idade e de 28.0–35.5 kg.m-2 para o índice de massa corporal) foi conduzido para avaliar a qualidade do sinal de eletrocardiograma medido em ambiente domiciliar. O sinal de eletrocardiograma dos pacientes foi monitorizado continuamente, num total de 28 noites. A qualidade dos sinais adquiridos foi analisada através do cálculo da razão sinal-ruído; da deteção de ar-tefactos, i.e., intervalos RR com um valor inviável de um ponto de vista fisiológico; e de gráficos de Poincaré, um método de análise não linear da distribuição dos intervalos RR registados. Os dados ad-quiridos neste estudo foram comparados com dados dos mesmos pacientes, adquiridos em ambiente hospitalar. Para a monitorização respiratória, sensores feitos de fibra óptica foram integrados no cinto. Al-gorítmicos para a estimar a frequência respiratória e o volume corrente dos sujeitos tendo por base o sinal medido pelas fibras ópticas foram desenvolvidos neste trabalho. As diferentes abordagens foram comparadas através de estudos piloto. Diferentes métodos para avaliação da qualidade do sinal adquirido foram sugeridos. Um método de reconhecimento da postura corporal através do cálculo de ângulos de orientação com base na aceleração medida foi proposto. A prova de conceito da determinação da intensidade da atividade física pela combinação de informações relativas á aceleração inercial e frequências cardíaca e respiratória dos sujeitos, é também apresentada neste trabalho. Um estudo foi conduzido para avaliar a validade do cinto para monitorização da respiração e da atividade física. O estudo contou com 10 parti-cipantes, dos quais 3 vestiram o cinto para monitorização da respiração (1 homem e 2 mulheres, idade 21 ± 2 anos, índice de massa corporal 20.3 ± 1.5 kg.m-2). Resultados: O estudo feito com pacientes com suspeita de apneia do sono revelou que os sinais eletro-cardiográficos adquiridos pelo cinto em ambiente domiciliar foram de melhor qualidade que os sinais adquiridos pelo mesmo dispositivo em ambiente hospitalar. Uma percentagem de artefacto de 2.87% ±4.14% foi observada para os dados adquiridos pelos elétrodos comummente usados em ambiente hospi-talar, 7.49% ± 10.76% para os dados adquiridos pelo cinto em ambiente domiciliar e 9.66% ± 14.65% para os dados adquiridos pelo cinto em ambiente hospitalar. Embora tenham tido uma maior percenta-gem de artefacto, a razão sinal-ruído dos sinais eletrocardiográficos adquiridos pelo cinto em ambiente domiciliar foi semelhante á dos sinais adquiridos pelos elétrodos de gel em ambiente hospitalar. Resul-tados sugerem uma boa concordância entre os intervalos RR calculados com base nos eletrocardiogra-mas registados em ambientes hospitalar e domiciliar. Além disso, para sinais com percentagem de arte-facto superior a 3%, a avaliação visual dos gráficos de Poincaré provou ser um bom método para a determinação da fonte primária de artefactos (batimentos irregulares ou ruído). A monitorização da aceleração dos sujeitos permitiu o reconhecimento da postura corporal (isto é, deitado ou sentado/em pé) com uma exatidão de 91% e valor preditivo positivo de 80%. Por fim, a classificação da intensidade da atividade física baseado na aceleração inercial e frequências cardíaca e respiratória revelou elevada exatidão, mostrando o potencial desta técnica. Conclusão: O cinto desenvolvido pela Empa provou ser apropriado para monitorização de longa-dura-ção de variáveis físicas e fisiológicos, de uma forma remota e contínua. O cinto permite não só monito-rizar eletrocardiograma, mas também frequência respiratória, postura corporal e intensidade da atividade física. Outros estudos devem ser conduzidos para corroborar os resultados e conclusões deste trabalho. Outros sensores poderão ser integrados no cinto de modo a possibilitar a monitorização de outras vari-áveis fisiológicas de relevância clínica. Este sistema tem o potencial de ser usado como uma ferramenta para predição de doenças e apoio ao diagnóstico