Prediction model of alcohol intoxication from facial temperature dynamics based on K-means clustering driven by evolutionary computing

Alcohol intoxication is a significant phenomenon, affecting many social areas, including work procedures or car driving. Alcohol causes certain side effects including changing the facial thermal distribution, which may enable the contactless identification and classification of alcohol-intoxicated people. We adopted a multiregional segmentation procedure to identify and classify symmetrical facial features, which reliably reflects the facial-temperature variations while subjects are drinking alcohol. Such a model can objectively track alcohol intoxication in the form of a facial temperature map. In our paper, we propose the segmentation model based on the clustering algorithm, which is driven by the modified version of the Artificial Bee Colony (ABC) evolutionary optimization with the goal of facial temperature features extraction from the IR (infrared radiation) images. This model allows for a definition of symmetric clusters, identifying facial temperature structures corresponding with intoxication. The ABC algorithm serves as an optimization process for an optimal cluster's distribution to the clustering method the best approximate individual areas linked with gradual alcohol intoxication. In our analysis, we analyzed a set of twenty volunteers, who had IR images taken to reflect the process of alcohol intoxication. The proposed method was represented by multiregional segmentation, allowing for classification of the individual spatial temperature areas into segmentation classes. The proposed method, besides single IR image modelling, allows for dynamical tracking of the alcohol-temperature features within a process of intoxication, from the sober state up to the maximum observed intoxication level.Web of Science118art. no. 99

Intoxication Identification Using Thermal Imaging

In this chapter, seven different approaches are presented for identifying persons who have consumed alcohol. The main concept is to identify a drunk person based on the thermal signature of his face. The thermal map of the face changes as the person consumes alcohol due to the increased activity of the blood vessels. The methods are mathematically supported and present high rate of identification success. The experimental material was based on a systematically created database which includes the thermal images of the drunk persons as well as the thermal images of the face of the corresponding sober persons. This database is freely available on the web and can be used by the scientific community. In each method, different features are extracted for intoxication identification. The advantage of the majority of the methods is that drunk identification can be achieved without employing the image of the sober person for comparisons. Accordingly, a commercial system incorporating some of the presented methods does not require the existence of a database with thermal images of sober faces, thus it will be capable to operate on unknown persons. The achieved identification success for each separate method is over 80%

Marijuana Intoxication Detection Using Convolutional Neural Network

Machine learning is a broad study of computer science, widely used for data analysis and algorithms that has the ability to learn and improve by experience through training. Supervised learning, Unsupervised learning, Dimensionality Reduction, Deep Learning, etc are the methods offered by Machine learning. These techniques are applied in fields like medical, automotive finance, and many more. In this thesis, Convolutional neural network (CNN) which is a part of deep learning techniques is applied to identify if a person is under influence of Marijuana or sober, using facial feature changes like redness in eyes, watery eyes, and drowsiness caused after smoking Marijuana. CNN is a state-of-the-art method in tasks like image classification and pattern recognition. CNN’s ability to learn from training the model using image dataset is a suitable method to be used in the problem of identifying a person’s sobriety based on facial features. The proposed methodology is divided into three components. Which are dataset creation, face detection to extract input image from real-time video, and finally, tuning and training CNN model for making a prediction. The purpose of this thesis is to develop a CNN model that may be helpful if implemented in vehicles in the future to reduce impaired driving incidents. Impaired driving is a major criminal cause of vehicle accidents in Canada. Impaired driving is a serious problem that puts the lives of pedestrians on the road and drivers involved in impaired driving themselves in danger. This thesis presents how Machine Learning can be applied to predict driver’s sobriety that may be helpful in reducing impaired driving incidents in the future by implementing in vehicles

Drunk Selfie Detection

The goal of this project was to extract key features from photographs of faces and use machine learning to classify subjects as either sober or drunk. To do this we analyzed photographs of 53 subjects after drinking wine and extracted key features which we used to classify drunkenness. We used random forest machine learning to achieve 81% accuracy. We built an android application that using our classifiers to estimate the subjects drunkenness from a selfie

Construction of Facial Skin Temperature-Based Anomaly Detection Model for Daily Fluctuations in Health Conditions

A method for estimating health conditions is required to monitor daily health conditions. Various types of data have been used in healthcare studies; however, imaging data are superior because they allow quick and remote measurements. Thermal face images can be measured safely and economically using infrared thermography. Many physiological and psychological states have been evaluated based on the data from these images. A previous study, using short-term experiments, confirmed that an anomaly detection model constructed using a variational autoencoder enables the detection of anomalous states of thermal face images. A long-term experiment is essential to estimate long-term fluctuating human states, such as health conditions. The purpose of this study is to construct a facial skin temperature-based anomaly detection model for human health conditions. The authors obtained thermal face images with health condition questionnaires for approximately a year. Based on the questionnaire responses, the thermal images in good and poor health conditions were labeled “normal state” and “anomaly state,” respectively. The facial skin temperature-based anomaly detection model for health conditions was constructed using a variational autoencoder with only thermal face images in the normal state. The AUC, which represents anomaly detection performance, was 0.70. In addition, an increasing trend of the performance of the model by learning a wider area of skin temperature was confirmed

Classification and Decision Making of Medical Infrared Thermal Images

Medical infrared thermal imaging (MITI) is a technique that allows safe and non-invasive recording of skin surface temperature distribution. The images gained provide underlining physiological information on the blood flow, vasoconstriction/vasodilatation, inflammation, transpiration or other processes that can contribute to skin temperature. This medical imaging modality has been available for nearly six decades and has proved to be useful for vascular, neurological and musculoskeletal conditions. Since the recordings are digital, in the form of a matrix of numbers (image), it can be computationally analyzed by a specialist mainly performing processing and analysis operations manually supported by proprietary software solutions. This limits the number of images that can be processed, making difficult for knowledge to evolve, expertise to develop and information to be shared. This chapter aims to disclose the medical imaging method, along with its particularities, principles, applications, advantages and disadvantages. The chapter introduces all available classification and decision making methods that can be employed using digital information, together with a literature review of their operation in the biomedical applications of infrared thermal imaging.info:eu-repo/semantics/publishedVersio

Facial Thermal and Blood Perfusion Patterns of Human Emotions: Proof-of-Concept

In this work, a preliminary study of proof-of-concept was conducted to evaluate the performance of the thermographic and blood perfusion data when emotions of positive and negative valence are applied, where the blood perfusion data are obtained from the thermographic data. The images were obtained for baseline, positive, and negative valence according to the protocol of the Geneva Affective Picture Database. Absolute and percentage differences of average values of the data between the valences and the baseline were calculated for different regions of interest (forehead, periorbital eyes, cheeks, nose and upper lips). For negative valence, a decrease in temperature and blood perfusion was observed in the regions of interest, and the effect was greater on the left side than on the right side. In positive valence, the temperature and blood perfusion increased in some cases, showing a complex pattern. The temperature and perfusion of the nose was reduced for both valences, which is indicative of the arousal dimension. The blood perfusion images were found to be greater contrast; the percentage differences in the blood perfusion images are greater than those obtained in thermographic images. Moreover, the blood perfusion images, and vasomotor answer are consistent, therefore, they can be a better biomarker than thermographic analysis in identifying emotions.Comment: 22 pages, 9 figure

A model for inebriation recognition in humans using computer vision

Abstract: Inebriation is a situational impairment caused by the consumption of alcohol affecting the consumer's interaction with the environment around them...M.Sc. (Information Technology