Multimodal and ubiquitous computing systems: supporting independent-living older users

We document the rationale and design of a multimodal interface to a pervasive/ubiquitous computing system that supports independent living by older people in their own homes. The Millennium Home system involves fitting a resident’s home with sensors – these sensors can be used to trigger sequences of interaction with the resident to warn them about dangerous events, or to check if they need external help. We draw lessons from the design process and conclude the paper with implications for the design of multimodal interfaces to ubiquitous systems developed for the elderly and in healthcare, as well as for more general ubiquitous computing applications

Affective Medicine: a review of Affective Computing efforts in Medical Informatics

Background: Affective computing (AC) is concerned with emotional interactions performed with and through computers. It is defined as “computing that relates to, arises from, or deliberately influences emotions”. AC enables investigation and understanding of the relation between human emotions and health as well as application of assistive and useful technologies in the medical domain. Objectives: 1) To review the general state of the art in AC and its applications in medicine, and 2) to establish synergies between the research communities of AC and medical informatics. Methods: Aspects related to the human affective state as a determinant of the human health are discussed, coupled with an illustration of significant AC research and related literature output. Moreover, affective communication channels are described and their range of application fields is explored through illustrative examples. Results: The presented conferences, European research projects and research publications illustrate the recent increase of interest in the AC area by the medical community. Tele-home healthcare, AmI, ubiquitous monitoring, e-learning and virtual communities with emotionally expressive characters for elderly or impaired people are few areas where the potential of AC has been realized and applications have emerged. Conclusions: A number of gaps can potentially be overcome through the synergy of AC and medical informatics. The application of AC technologies parallels the advancement of the existing state of the art and the introduction of new methods. The amount of work and projects reviewed in this paper witness an ambitious and optimistic synergetic future of the affective medicine field

Review of technology‐supported multimodal solutions for people with dementia

Funding Information: This research was partially funded by FAITH project (H2020?SC1?DTH?2019?875358), CARELINK project (AAL?CALL?2016?049), and Funda??o para a Ci?ncia e Tecnologia through the program UIDB/00066/2020 (CTS?Center of Technology and Systems).Acknowledgments: The authors acknowledge the European Commission for its support and partial funding; the partners of the research project FAITH project (H2020?SC1?DTH?2019?875358); and CARELINK, AAL?CALL?2016?049 funded by AAL JP and co?funded by the European Commission and National Funding Authorities of Ireland, Belgium, Portugal, and Switzerland. Partial support also comes from Funda??o para a Ci?ncia e Tecnologia through the program UIDB/00066/2020 (CTS?Center of Technology and Systems). Funding Information: Acknowledgments: The authors acknowledge the European Commission for its support and partial funding; the partners of the research project FAITH project (H2020‐SC1‐DTH‐2019‐875358); and CARELINK, AAL‐CALL‐2016‐049 funded by AAL JP and co‐funded by the European Commission and National Funding Authorities of Ireland, Belgium, Portugal, and Switzerland. Partial support also comes from Fundação para a Ciência e Tecnologia through the program UIDB/00066/2020 (CTS—Center of Technology and Systems). Funding Information: Funding: This research was partially funded by FAITH project (H2020‐SC1‐DTH‐2019‐875358), CARELINK project (AAL‐CALL‐2016‐049), and Fundação para a Ciência e Tecnologia through the program UIDB/00066/2020 (CTS—Center of Technology and Systems). Publisher Copyright: © 2021 by the authors. Licensee MDPI, Basel, Switzerland.The number of people living with dementia in the world is rising at an unprecedented rate, and no country will be spared. Furthermore, neither decisive treatment nor effective medicines have yet become effective. One potential alternative to this emerging challenge is utilizing supportive technologies and services that not only assist people with dementia to do their daily activities safely and independently, but also reduce the overwhelming pressure on their caregivers. Thus, for this study, a systematic literature review is conducted in an attempt to gain an overview of the latest findings in this field of study and to address some commercially available supportive technologies and services that have potential application for people living with dementia. To this end, 30 potential supportive technologies and 15 active supportive services are identified from the literature and related websites. The technologies and services are classified into different classes and subclasses (according to their functionalities, capabilities, and features) aiming to facilitate their understanding and evaluation. The results of this work are aimed as a base for designing, integrating, developing, adapting, and customizing potential multimodal solutions for the specific needs of vulnerable people of our societies, such as those who suffer from different degrees of dementia.publishersversionpublishe

An Overview of Self-Adaptive Technologies Within Virtual Reality Training

This overview presents the current state-of-the-art of self-adaptive technologies within virtual reality (VR) training. Virtual reality training and assessment is increasingly used for five key areas: medical, industrial & commercial training, serious games, rehabilitation and remote training such as Massive Open Online Courses (MOOCs). Adaptation can be applied to five core technologies of VR including haptic devices, stereo graphics, adaptive content, assessment and autonomous agents. Automation of VR training can contribute to automation of actual procedures including remote and robotic assisted surgery which reduces injury and improves accuracy of the procedure. Automated haptic interaction can enable tele-presence and virtual artefact tactile interaction from either remote or simulated environments. Automation, machine learning and data driven features play an important role in providing trainee-specific individual adaptive training content. Data from trainee assessment can form an input to autonomous systems for customised training and automated difficulty levels to match individual requirements. Self-adaptive technology has been developed previously within individual technologies of VR training. One of the conclusions of this research is that while it does not exist, an enhanced portable framework is needed and it would be beneficial to combine automation of core technologies, producing a reusable automation framework for VR training

UPPERCARE: a community aware environment for post-surgical musculoskeletal recovery of elderly patients

Trabalho apresentado na Conferência Internacional realizada em Wellington, Nova Zelândia, de 26-28 de abril de 2017Disability from musculoskeletal diseases and comorbidities may lead to the worsening of social and economic well-being through a multitude of paths. Moreover since in European Union (EU) Member States it is projected that those aged 65 and over will become a much larger share (rising from 17% to 30% of the population), and those aged 80 and over (rising from 5% to 12%) will almost become as numerous as the young population in 2060, there is a great potential for Information and Communication Technologies (ICT) solutions for addressing the present and future living arrangements in older people. The UPPERCARE system is meant to affect positively both the intergenerational and partners care since it contributes to decrease usability barriers and promote collaborative environments for informal and self-care. UPPERCARE is a new approach for integrated care supported by ICT systems and services, focusing on post-operative rehabilitation of musculoskeletal pathologies, having as a case study the knee post-operative scenarios of prosthetic care. This paper presents the UPPERCARE system, that provides an integrated care solution, supported ICT, for empowering self-care and adherence to rehabilitation plans through natural interfaces, gamification and cross-modal paths for community care collaboration. The system addresses current barriers from technological, clinical, social and organisational perspectives in a multidisciplinary environment. Special attention is given to the patients’ needs and behaviours entailing the participation of a wide care community, including clinical and non-clinical people, associations, institutions and authorities) through an user driven interaction within the system.This work was supported by Project ”NanoSTIMA: Macroto-Nano Human Sensing: Towards Integrated Multimodal Health Monitoring and Analytics/NORTE-01-0145-FEDER- 000016” financed by the North Portugal Regional Operational Programme (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, and through the European Regional Development Fund (ERDF).info:eu-repo/semantics/publishedVersio

Co-creation of an ICT-supported cancer rehabilitation application for resected lung cancer survivors: design and evaluation

Background Lung cancer (LC) patients experience high symptom burden and significant decline of physical fitness and quality of life following lung resection. Good quality of survivorship care post-surgery is essential to optimize recovery and prevent unscheduled healthcare use. The use of Information and Communication Technology (ICT) can improve post-surgery care, as it enables frequent monitoring of health status in daily life, provides timely and personalized feedback to patients and professionals, and improves accessibility to rehabilitation programs. Despite its promises, implementation of telehealthcare applications is challenging, often hampered by non-acceptance of the developed service by its end-users. A promising approach is to involve the end-users early and continuously during the developmental process through a so-called user-centred design approach. The aim of this article is to report on this process of co-creation and evaluation of a multimodal ICT-supported cancer rehabilitation program with and for lung cancer patients treated with lung resection and their healthcare professionals (HCPs). Methods A user-centered design approach was used. Through semi-structured interviews (n = 10 LC patients and 6 HCPs), focus groups (n = 5 HCPs), and scenarios (n = 5 HCPs), user needs and requirements were elicited. Semi-structured interviews and the System Usability Scale (SUS) were used to evaluate usability of the telehealthcare application with 7 LC patients and 10 HCPs. Results The developed application consists of: 1) self-monitoring of symptoms and physical activity using on-body sensors and a smartphone, and 2) a web based physical exercise program. 71 % of LC patients and 78 % of HCPs were willing to use the application as part of lung cancer treatment. Accessibility of data via electronic patient records was essential for HCPs. LC patients regarded a positive attitude of the HCP towards the application essential. Overall, the usability (SUS median score = 70, range 35–95) was rated acceptable. Conclusions A telehealthcare application that facilitates symptom monitoring and physical fitness training is considered a useful tool to further improve recovery following surgery of resected lung cancer (LC) patients. Involvement of end users in the design process appears to be necessary to optimize chances of adoption, compliance and implementation of telemedicine

Visualization of Data for Ambient Assisted Living Services

Ambient assisted living (AAL) services that provide support for people to remain in their homes are increasingly being used in healthcare systems around the world. Typically, these ambient assisted living services provide additional information though location-awareness, presence-awareness, and context-awareness capabilities, arising from the prolific use of telecommunications devices including sensors and actuators in the home of the person receiving care. In addition there is a need to provide abstract information, in context, to local and remote stakeholders. There are many different viewing options utilizing converged networks and the resulting explosion in data and information has resulted in a new problem, as these new ambient assisted living services struggle to convey meaningful information to different groups of end users. The article discusses visualization of data from the perspective of the needs of the differing end user groups, and discusses how algorithms are required to contextualize and convey information across location and time. In order to illustrate the issues, current work on nighttime AAL services for people with dementia is described