From the Inside Out: A Literature Review on Possibilities of Mobile Emotion Measurement and Recognition

Information systems are becoming increasingly intelligent and emotion artificial intelligence is an important component for the future. Therefore, the measurement and recognition of emotions is necessary and crucial. This paper presents a state of the art in the research field of mobile emotion measurement and recognition. The aim of this structured literature analysis using the PRISMA statement is to collect and classify the relevant literature and to provide an overview of the current status of mobile emotion recording and its future trends. A total of 59 articles were identified in the relevant literature databases, which can be divided into four main categories of emotion measurement. There was an increase of publications over the years in all four categories, but with a particularly strong increase in the areas of optical and vital-data-based recording. Over time, both the speed as well as the accuracy of the measurement has improved considerably in all four categories

Ambient Intelligence in Healthcare: A State-of-the-Art

Information technology advancement leads to an innovative paradigm called Ambient Intelligence (AmI). A digital environment is employed along with AmI to enable individuals to be aware to their behaviors, needs, emotions and gestures. Several applications of the AmI systems in healthcare environment attract several researchers. AmI is considered one of the recent technologies that support hospitals, patients, and specialists for personal healthcare with the aid of artificial intelligence techniques and wireless sensor networks. The improvement in the wearable devices, mobile devices, embedded software and wireless technologies open the doors to advanced applications in the AmI paradigm. The WSN and the BAN collect medical data to be used for the progress of the intelligent systems adapted inevitably. The current study outlines the AmI role in healthcare concerning with its relational and technological nature. Health

MsWH: A multi-sensory hardware platform for capturing and analyzing physiological emotional signals

This paper presents a new physiological signal acquisition multi-sensory platform for emotion detection: Multi-sensor Wearable Headband (MsWH). The system is capable of recording and analyzing five different physiological signals: skin temperature, blood oxygen saturation, heart rate (and its variation), movement/position of the user (more specifically of his/her head) and electrodermal activity/bioimpedance. The measurement system is complemented by a porthole camera positioned in such a way that the viewing area remains constant. Thus, the user''s face will remain centered regardless of its position and movement, increasing the accuracy of facial expression recognition algorithms. This work specifies the technical characteristics of the developed device, paying special attention to both the hardware used (sensors, conditioning, microprocessors, connections) and the software, which is optimized for accurate and massive data acquisition. Although the information can be partially processed inside the device itself, the system is capable of sending information via Wi-Fi, with a very high data transfer rate, in case external processing is required. The most important features of the developed platform have been compared with those of a proven wearable device, namely the Empatica E4 wristband, in those measurements in which this is possible

Enhanced Living Environments

This open access book was prepared as a Final Publication of the COST Action IC1303 “Algorithms, Architectures and Platforms for Enhanced Living Environments (AAPELE)”. The concept of Enhanced Living Environments (ELE) refers to the area of Ambient Assisted Living (AAL) that is more related with Information and Communication Technologies (ICT). Effective ELE solutions require appropriate ICT algorithms, architectures, platforms, and systems, having in view the advance of science and technology in this area and the development of new and innovative solutions that can provide improvements in the quality of life for people in their homes and can reduce the financial burden on the budgets of the healthcare providers. The aim of this book is to become a state-of-the-art reference, discussing progress made, as well as prompting future directions on theories, practices, standards, and strategies related to the ELE area. The book contains 12 chapters and can serve as a valuable reference for undergraduate students, post-graduate students, educators, faculty members, researchers, engineers, medical doctors, healthcare organizations, insurance companies, and research strategists working in this area

Non-invasive wearable sensing systems for continuous health monitoring and long-term behavior modeling

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 2006.Includes bibliographical references (p. 212-228).Deploying new healthcare technologies for proactive health and elder care will become a major priority over the next decade, as medical care systems worldwide become strained by the aging populations. This thesis presents LiveNet, a distributed mobile system based on low-cost commodity hardware that can be deployed for a variety of healthcare applications. LiveNet embodies a flexible infrastructure platform intended for long-term ambulatory health monitoring with real-time data streaming and context classification capabilities. Using LiveNet, we are able to continuously monitor a wide range of physiological signals together with the user's activity and context, to develop a personalized, data-rich health profile of a user over time. Most clinical sensing technologies that exist have focused on accuracy and reliability, at the expense of cost-effectiveness, burden on the patient, and portability. Future proactive health technologies, on the other hand, must be affordable, unobtrusive, and non-invasive if the general population is going to adopt them.(cont.) In this thesis, we focus on the potential of using features derived from minimally invasive physiological and contextual sensors such as motion, speech, heart rate, skin conductance, and temperature/heat flux that can be used in combination with mobile technology to create powerful context-aware systems that are transparent to the user. In many cases, these non-invasive sensing technologies can completely replace more invasive diagnostic sensing for applications in long-term monitoring, behavior and physiology trending, and real-time proactive feedback and alert systems. Non-invasive sensing technologies are particularly important in ambulatory and continuous monitoring applications, where more cumbersome sensing equipment that is typically found in medical and clinical research settings is not usable. The research in this thesis demonstrates that it is possible to use simple non-invasive physiological and contextual sensing using the LiveNet system to accurately classify a variety of physiological conditions. We demonstrate that non-invasive sensing can be correlated to a variety of important physiological and behavioral phenomenon, and thus can serve as substitutes to more invasive and unwieldy forms of medical monitoring devices while still providing a high level of diagnostic power.(cont.) From this foundation, the LiveNet system is deployed in a number of studies to quantify physiological and contextual state. First, a number of classifiers for important health and general contextual cues such as activity state and stress level are developed from basic non-invasive physiological sensing. We then demonstrate that the LiveNet system can be used to develop systems that can classify clinically significant physiological and pathological conditions and that are robust in the presence of noise, motion artifacts, and other adverse conditions found in real-world situations. This is highlighted in a cold exposure and core body temperature study in collaboration with the U.S. Army Research Institute of Environmental Medicine. In this study, we show that it is possible to develop real-time implementations of these classifiers for proactive health monitors that can provide instantaneous feedback relevant in soldier monitoring applications. This thesis also demonstrates that the LiveNet platform can be used for long-term continuous monitoring applications to study physiological trends that vary slowly with time.(cont.) In a clinical study with the Psychiatry Department at the Massachusetts General Hospital, the LiveNet platform is used to continuously monitor clinically depressed patients during their stays on an in-patient ward for treatment. We show that we can accurately correlate physiology and behavior to depression state, as well as to track changes in depression state over time through the course of treatment. This study demonstrates how long-term physiology and behavioral changes can be captured to objectively measure medical treatment and medication efficacy. In another long-term monitoring study, the LiveNet platform is used to collect data on people's everyday behavior as they go through daily life. By collecting long-term behavioral data, we demonstrate the possibility of modeling and predicting high-level behavior using simple physiologic and contextual information derived solely from ambulatory mobile sensing technology.by Michael Sung.Ph.D

Recent Developments in Smart Healthcare

Medicine is undergoing a sector-wide transformation thanks to the advances in computing and networking technologies. Healthcare is changing from reactive and hospital-centered to preventive and personalized, from disease focused to well-being centered. In essence, the healthcare systems, as well as fundamental medicine research, are becoming smarter. We anticipate significant improvements in areas ranging from molecular genomics and proteomics to decision support for healthcare professionals through big data analytics, to support behavior changes through technology-enabled self-management, and social and motivational support. Furthermore, with smart technologies, healthcare delivery could also be made more efficient, higher quality, and lower cost. In this special issue, we received a total 45 submissions and accepted 19 outstanding papers that roughly span across several interesting topics on smart healthcare, including public health, health information technology (Health IT), and smart medicine

InMyFace: Inertial and Mechanomyography-Based Sensor Fusion for Wearable Facial Activity Recognition

Recognizing facial activity is a well-understood (but non-trivial) computer vision problem. However, reliable solutions require a camera with a good view of the face, which is often unavailable in wearable settings. Furthermore, in wearable applications, where systems accompany users throughout their daily activities, a permanently running camera can be problematic for privacy (and legal) reasons. This work presents an alternative solution based on the fusion of wearable inertial sensors, planar pressure sensors, and acoustic mechanomyography (muscle sounds). The sensors were placed unobtrusively in a sports cap to monitor facial muscle activities related to facial expressions. We present our integrated wearable sensor system, describe data fusion and analysis methods, and evaluate the system in an experiment with thirteen subjects from different cultural backgrounds (eight countries) and both sexes (six women and seven men). In a one-model-per-user scheme and using a late fusion approach, the system yielded an average F1 score of 85.00% for the case where all sensing modalities are combined. With a cross-user validation and a one-model-for-all-user scheme, an F1 score of 79.00% was obtained for thirteen participants (six females and seven males). Moreover, in a hybrid fusion (cross-user) approach and six classes, an average F1 score of 82.00% was obtained for eight users. The results are competitive with state-of-the-art non-camera-based solutions for a cross-user study. In addition, our unique set of participants demonstrates the inclusiveness and generalizability of the approach.Comment: Submitted to Information Fusion, Elsevie

Review of Safety Evaluation of Thermal Wearable Power Harvesting Device

Thermal wearable power harvesting device is developing fast nowadays. The increasing demand on simple and easily handled devices forcing researches to find a better on improving the performance and safety of the devices. Thermal power harvesting is using the heat from the surrounding and human body to generate power. So, the safety precaution needs to be taken in order to keep it safe to use. This paper reviews the use of wearable technology, the basic concept, methods and future of power harvesting technology, ideas of thermoelectric power generators and its related work as well the safety evaluation for international standard of wearable devices