Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization

A person’s well-being status is reflected by their face through a combination of facial expressions and physical signs. The SEMEOTICONS project translates the semeiotic code of the human face into measurements and computational descriptors that are automatically extracted from images, videos and 3D scans of the face. SEMEOTICONS developed a multisensory platform in the form of a smart mirror to identify signs related to cardio-metabolic risk. The aim was to enable users to self-monitor their well-being status over time and guide them to improve their lifestyle. Significant scientific and technological challenges have been addressed to build the multisensory mirror, from touchless data acquisition, to real-time processing and integration of multimodal data

Semeoticons -Reading the face code of cardio-metabolic risk

What if you could discover your health status by looking at yourself in the mirror? Since November 2013, the EU FP7 Project SEMEOTICONS is working to make this possible. The Project is building a multi-sensory device, having the form of a conventional mirror, able to read the semeiotic code of the face and detect possible evidence of the onset of cardio-metabolic diseases. The device, called Wize Mirror, integrates unobtrusive imaging sensors used to capture videos, images and 3D scans of the face. These are processed to assess the risk of a cardio-metabolic disease and thereby suggest possible strategies to prevent its onset