Wize Mirror - a smart, multisensory cardio-metabolic risk monitoring system

In the recent years personal health monitoring systems have been gaining popularity, both as a result of the pull from the general population, keen to improve well-being and early detection of possibly serious health conditions and the push from the industry eager to translate the current significant progress in computer vision and machine learning into commercial products. One of such systems is the Wize Mirror, built as a result of the FP7 funded SEMEOTICONS (SEMEiotic Oriented Technology for Individuals CardiOmetabolic risk self-assessmeNt and Self-monitoring) project. The project aims to translate the semeiotic code of the human face into computational descriptors and measures, automatically extracted from videos, multispectral images, and 3D scans of the face. The multisensory platform, being developed as the result of that project, in the form of a smart mirror, looks for signs related to cardio-metabolic risks. The goal is to enable users to self-monitor their well-being status over time and improve their life-style via tailored user guidance. This paper is focused on the description of the part of that system, utilising computer vision and machine learning techniques to perform 3D morphological analysis of the face and recognition of psycho-somatic status both linked with cardio-metabolic risks. The paper describes the concepts, methods and the developed implementations as well as reports on the results obtained on both real and synthetic datasets

Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization

A person’s well-being status is reflected by their face through a combination of facial expressions and physical signs. The SEMEOTICONS project translates the semeiotic code of the human face into measurements and computational descriptors that are automatically extracted from images, videos and 3D scans of the face. SEMEOTICONS developed a multisensory platform in the form of a smart mirror to identify signs related to cardio-metabolic risk. The aim was to enable users to self-monitor their well-being status over time and guide them to improve their lifestyle. Significant scientific and technological challenges have been addressed to build the multisensory mirror, from touchless data acquisition, to real-time processing and integration of multimodal data

Face morphology: Can it tell us something about body weight and fat?

This paper proposes a method for an automatic extraction of geometric features, related to weight parameters, from 3D facial data acquired with low-cost depth scanners. The novelty of the method relies both on the processing of the 3D facial data and on the definition of the geometric features which are conceptually simple, robust against noise and pose estimation errors, computationally efficient, invariant with respect to rotation, translation, and scale changes. Experimental results show that these measurements are highly correlated with weight, BMI, and neck circumference, and well correlated with waist and hip circumference, which are markers of central obesity. Therefore the proposed method strongly supports the development of interactive, non-obtrusive systems able to provide a support for the detection of weight-related problems

Smart information desk system with voice assistant for universities

This article aims to develop a smart information desk system through a smart mirror for universities. It is a mirror with extra capabilities of displaying answers for academic inquiries such as asking about the lecturers’ office numbers and hours, exams dates and times on the mirror surface. In addition, the voice recognition feature was used to answer spoken inquiries in audio responds to serve all types of users including disabled ones. Furthermore, the system showed general information such as date, weather, time and the university map. The smart mirror was connected to an outdoor camera to monitor the traffics at the university entrance gate. The system was implemented on a Raspberry Pi 4 model B connected to a two-way mirror and an infrared (IR) touch frame. The results of this study helped to overcome the problem of the information desk absence in the university. Therefore, it helped users to save their time and effort in making requests for important academic information

A comparative analysis of pose estimation models as enablers for a smart-mirror physical rehabilitation system

Smart mirrors are gaining attention as a smart device that could integrate a set of functionalities intended to assist older adults in their day-to-day life. These devices are seamlessly integrated in the environment, providing a user-friendly interface and naturally fitting into the daily-care routines. People face a mirror several times a day, thus ensuring that any application running on a smart mirror will have several guaranteed interactions per day. It is therefore essential to detect when the user is in front of the mirror and also to interpret what he or she is doing. Very powerful and accurate libraries are currently available, but the limited computational resources and the need to work in real time limit the valid options for smart mirror devices. This paper therefore analyses and evaluates several body pose estimation models in order to determine which one can be deployed in a smart mirror-like device dedicated to supporting older adults in their physical rehabilitation routines.Los espejos inteligentes están ganando atención como un dispositivo inteligente que podría integrar un conjunto de funcionalidades destinadas a ayudar a los adultos mayores en su día a día. Estos dispositivos se integran a la perfección en el entorno, brindan una interfaz fácil de usar y se adaptan naturalmente a las rutinas de cuidado diario. Las personas se enfrentan a un espejo varias veces al día, lo que garantiza que cualquier aplicación que se ejecute en un espejo inteligente tendrá varias interacciones garantizadas por día. Por lo tanto, es fundamental detectar cuándo el usuario está frente al espejo y también interpretar lo que está haciendo. Actualmente se encuentran disponibles bibliotecas muy potentes y precisas, pero los recursos computacionales limitados y la necesidad de trabajar en tiempo real limitan las opciones válidas para los dispositivos espejo inteligentes

E-health-IoT Universe: A Review

The Internet of Things (IoT) devices are able to collect and share data directly with other devices through the cloud environment, providing a huge amount of information to be gathered, stored and analyzed for data-analytics processes. The scenarios in which the IoT devices may be useful are amazing varying, from automotive, to industrial automation or remote monitoring of domestic environment. Furthermore, has been proved that healthcare applications represent an important field of interest for IoT devices, due to the capability of improving the access to care, reducing the cost of healthcare and most importantly increasing the quality of life of the patients. In this paper, we analyze the state-of-art of IoT in medical environment, illustrating an extended range of IoT-driven healthcare applications that, however, still need innovative and high technology-based solutions to be considered ready to market. In particular, problems regarding characteristics of response-time and precision will be examined.  Furthermore, wearable and energy saving properties will be investigated in this paper and also the IT architectures able to ensure security and privacy during the all data-transmission process. Finally, considerations about data mining applications, such as risks prediction, classification and clustering will be provided, that are considered fundamental issues to ensure the accuracy of the care processes

Transforming Personal Healthcare through Technology - A Systematic Literature Review of Wearable Sensors for Medical Application

Wearable Sensor Health Technology (WSHT) captures, analyzes and aggregates physiological data to improve personal well-being. Recently the technology market is flooded with wearable sensors that measure health-related data and have a high user adoption. Nevertheless, these devices are almost exclusively used for fitness purposes and the healthcare sector still faces the challenge of constantly increasing costs. To respond to the necessary but rare use of WSHT in professional healthcare, we aim to identify the most promising areas for future medical implementation. Therefore, we performed a systematic literature search and reviewed 97 papers with regard to disease treatment, application area, vital parameter measurement and target patient. As a result, we could identify five potential areas for further research: (RA1) concentration on widespread diseases, (RA2) expansion of WSHT’s functionality, (RA3) diversity of vital parameter measurements, (RA4) proactive analysis of sensor data for preventive purposes and (RA5) promoting patient adoption through enhanced usability

e health iot universe a review

The Internet of Things (IoT) devices are able to collect and share data directly with other devices through the cloud environment, providing a huge amount of information to be gathered, stored and analyzed for data-analytics processes. The scenarios in which the IoT devices may be useful are amazing varying, from automotive, to industrial automation or remote monitoring of domestic environment. Furthermore, has been proved that healthcare applications represent an important field of interest for IoT devices, due to the capability of improving the access to care, reducing the cost of healthcare and most importantly increasing the quality of life of the patients. In this paper, we analyze the state-of-art of IoT in medical environment, illustrating an extended range of IoT-driven healthcare applications that, however, still need innovative and high technology-based solutions to be considered ready to market. In particular, problems regarding characteristics of response-time and precision will be examined. Furthermore, wearable and energy saving properties will be investigated in this paper and also the IT architectures able to ensure security and privacy during the all data-transmission process. Finally, considerations about data mining applications, such as risks prediction, classification and clustering will be provided, that are considered fundamental issues to ensure the accuracy of the care processes