Software architecture for smart emotion recognition and regulation of the ageing adult

This paper introduces the architecture of an emotion-aware ambient intelligent and gerontechnological project named “Improvement of the Elderly Quality of Life and Care through Smart Emotion Regulation”. The objective of the proposal is to find solutions for improving the quality of life and care of the elderly who can or want to continue living at home by using emotion regulation techniques. A series of sensors is used for monitoring the elderlies’ facial and gestural expression, activity and behaviour, as well as relevant physiological data. This way the older people’s emotions are inferred and recognized. Music, colour and light are the stimulating means to regulate their emotions towards a positive and pleasant mood. Then, the paper proposes a gerontechnological software architecture that enables real-time, continuous monitoring of the elderly and provides the best-tailored reactions of the ambience in order to regulate the older person’s emotions towards a positive mood. After describing the benefits of the approach for emotion recognition and regulation in the elderly, the eight levels that compose the architecture are described.This work was partially supported by Spanish Ministerio de Economía y Competitividad/FEDER under TIN2013-47074-C2-1-R grant. José Carlos Castillo was partially supported by a grant from Iceland, Liechtenstein and Norway through the EEA Financial Mechanism, operated by Universidad Complutense de Madrid.Publicad

Emotions detection on an ambient intelligent system using wearable devices

This paper presents the Emotional Smart Wristband and its integration with the iGenda. The aim is to detect emotional states of a group of entities through the wristband and send the social emotion value to the iGenda so it may change the home environment and notify the caregivers. This project is advantageous to communities of elderly people, like retirement homes, where a harmonious environment is imperative and where the number of inhabitants keeps increasing. The iGenda provides the visual interface and the information center, receiving the information from the Emotional Smart Wristband and tries achieve a specific emotion (such as calm or excitement). Thus, the goal is to provide an affective system that directly interacts with humans by discreetly improving their lifestyle. In this paper, it is described the wristband in depth and the data models, and is provided an evaluation of them performed by real individuals and the validation of this evaluation.- This work is supported by COMPETE, Portugal: POCI-01-0145-FEDER-007043 and FCT - Fundacao para a Ciencia e Tecnologi, Portugal a within the projects UID/CEC/00319/2013 and Post-Doc scholarship SFRH/BPD/102696/2014 (Angelo Costa) This work is partially supported by the MINECO/FEDER, Spain TIN2015-65515-C4-1-R and AP2013-01276 awarded to Jaime-Andres Rincon

Include 2011 : The role of inclusive design in making social innovation happen.

Include is the biennial conference held at the RCA and hosted by the Helen Hamlyn Centre for Design. The event is directed by Jo-Anne Bichard and attracts an international delegation

Trajectory planning of a quadrotor to monitor dependent people

This article introduces a framework for assisting dependent people at home through a vision-based autonomous unmanned aerial vehicle (UAV). Such an aircraft equipped with onboard cameras can be useful for monitoring and recognizing a dependent's activity. This work is focused on the problem of planning the flight path of a quadrotor to perform monitoring tasks. The objective is to design a trajectory planning algorithm that allows the UAV to position itself for the sake of capturing images of the dependent person's face. These images will be later treated by a base station to evaluate the persons emotional state, together with his/her behavior, this way determining the assistance needed in each situation. Numerical simulations have been carried out to validate the proposed algorithms. The results show the effectiveness of the trajectory planner to generate smooth references to our previously designed GPI (generalized proportional integral) controller. This demonstrates that a quadrotor is able to perform monitoring flights with a high motion precision.- This work has been partially supported by Spanish Ministerio de Ciencia, Innovacion y Universidades, Agencia Estatal de Investigacion (AEI)/European Regional Development Fund (FEDER, UE) under DPI2016-80894-R grant. Lidia M. Belmonte holds FPU014/05283 scholarship from Spanish Ministerio de Educacion y Formacion Profesional

ENLACE: A Combination of Layer-Based Architecture and Wireless Communication for Emotion Monitoring in Healthcare

Owing to the increase in the number of people with disabilities, as a result of either accidents or old age, there has been an increase in research studies in the area of ubiquitous computing and the Internet of Things. They are aimed at monitoring health, in an efficient and easily accessible way, as a means of managing and improving the quality of life of this section of the public. It also involves adopting a Health Homes policy based on the Internet of Things and applied in smart home environments. This is aimed at providing connectivity between the patients and their surroundings and includes mechanisms for helping the diagnosis and prevention of accidents and/or diseases. Monitoring gives rise to an opportunity to exploit the way computational systems can help to determine the real-time emotional state of patients. This is necessary because there are some limitations to traditional methods of health monitoring, for example, establishing the behavior of the user’s routine and issuing alerts and warnings to family members and/or medical staff about any abnormal event or signs of the onset of depression. This article discusses how a layer-based architecture can be used to detect emotional factors to assist in healthcare and the prevention of accidents within the context of Smart Home Health. The results show that this process-based architecture allows a load distribution with a better service that takes into account the complexity of each algorithm and the processing power of each layer of the architecture to provide a prompt response when there is a need for some intervention in the emotional state of the user

Assisting dependent people at home through autonomous unmanned aerial vehicles

This work describes a proposal of autonomous unmanned aerial vehicles (AUAVs) for home assistance of dependent people. AUAVs will monitor and recognize human activities during flight to improve their quality of life. However, before bringing such AUAV assistance to real homes, several challenges must be faced to make them viable and practical. Some challenges are technical and some others are related to human factors. In particular, several technical aspects are described for AUAV assistance: (1) flight control, based on our active disturbance rejection control algorithm, (2) flight planning (navigation in obstacle environments), and, (3) processing signals, acquired both from flight-control and monitoring sensors. From the assisted person’s viewpoint, our research focuses on three cues: (1) the user’s perception about AUAV assistance, (2) the influence on human acceptance of AUAV appearance and behavior at home, and (3) the human-robot interaction between assistant AUAV and assisted person. Finally, virtual reality environments are proposed to carry out preliminary tests and user acceptance evaluations.This work has been partially supported by Spanish Ministerio de Ciencia, Innovación y Universidades, Agencia Estatal de Investigaci´on (AEI) / European Regional Development Fund (FEDER, UE) under DPI2016-80894-R grant, and by CIBERSAM of the Instituto de Salud Carlos III. Lidia M. Belmonte holds FPU014/05283 scholarship from Spanish Ministerio de Educaci´on y Formación Profesional

State of the art of audio- and video based solutions for AAL

Working Group 3. Audio- and Video-based AAL ApplicationsIt is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living (AAL) technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters (e.g., heart rate, respiratory rate). Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals (e.g., speech recordings). Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary 4 debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely (i) lifelogging and self-monitoring, (ii) remote monitoring of vital signs, (iii) emotional state recognition, (iv) food intake monitoring, activity and behaviour recognition, (v) activity and personal assistance, (vi) gesture recognition, (vii) fall detection and prevention, (viii) mobility assessment and frailty recognition, and (ix) cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed.publishedVersio

Workingage: providing occupational safety through pervasive Sensing and data driven behavior modeling

The aging of the working population calls for innovative approaches to monitor and support the changes of physical,physiological and psycho-social capabilities of workers over time, as well as to promote habits aimed at improving both health and productivity. This paper presents the WorkingAge (Smart Working Environments for All Ages - WA)project, which focuses on innovative Human Computer Interaction methods (such as augmented and/or virtual reality or gesture/voice/noise recognition or gaze tracking) to improve the users’ psychological/emotional/health state at workplaces. Based on Internet of Things (IoT) technologies and on data driven models of the users’ characteristics and behaviors, the WA Tool will monitor the state of users to automatically provide a set of suggestions promoting healthy habits in their working environment as well as in their daily living activities. The paper presents at the basis of the WA project, its hardware-software sensor architecture, and the elements of the ontology capturing the key concepts of the data collected to profile the users

Enhanced Living Environments

This open access book was prepared as a Final Publication of the COST Action IC1303 “Algorithms, Architectures and Platforms for Enhanced Living Environments (AAPELE)”. The concept of Enhanced Living Environments (ELE) refers to the area of Ambient Assisted Living (AAL) that is more related with Information and Communication Technologies (ICT). Effective ELE solutions require appropriate ICT algorithms, architectures, platforms, and systems, having in view the advance of science and technology in this area and the development of new and innovative solutions that can provide improvements in the quality of life for people in their homes and can reduce the financial burden on the budgets of the healthcare providers. The aim of this book is to become a state-of-the-art reference, discussing progress made, as well as prompting future directions on theories, practices, standards, and strategies related to the ELE area. The book contains 12 chapters and can serve as a valuable reference for undergraduate students, post-graduate students, educators, faculty members, researchers, engineers, medical doctors, healthcare organizations, insurance companies, and research strategists working in this area