A review of chewing detection for automated dietary monitoring

A healthy dietary lifestyle prevents diseases and leads to good physical conditions. Poor dietary habits, such as eating disorders, emotional eating and excessive unhealthy food consumption, may cause health complications. People’s eating habits are monitored through automated dietary monitoring (ADM), which is considered a part of our daily life. In this study, the Google Scholar database from the last 5 years was considered. Articles that reported chewing activity characteristics and various wearable sensors used to detect chewing activities automatically were reviewed. Key challenges, including chew count, various food types, food classification and a large number of samples, were identified for further chewing data analysis. The chewing signal’s highest reported classification accuracy value was 99.85%, which was obtained using a piezoelectric contactless sensor and multistage linear SVM with a decision tree classifier. The decision tree approach was more robust and its classification accuracy (75%–93.3%) was higher than those of the Viterbi algorithm-based finite-state grammar approach, which yielded 26%–97% classification accuracy. This review served as a comparative study and basis for developing efficient ADM systems

Feature Selection Analysis of Chewing Activity Based on Contactless Food Intake Detection

This paper presents the feature selection methods for chewing activity detection. Chewing detection typically used for food intake monitoring applications. The work aims to analyze the effect of implementing optimum feature selection that can improve the accuracy of the chewing detection.  The raw chewing data is collected using a proximity sensor. Pre-process procedures are implemented on the data using normalization and bandpass filters. The searching of a suitable combination of bandpass filter parameters such as lower cut-off frequency (Fc1) and steepness targeted for best accuracy was also included. The Fc1 was 0,5Hz, 1.0Hz and 1.2H, while the steepness varied from 0.75 to 0.9 with an interval of 0.5. By using the bandpass filter with the value of [1Hz, 5Hz] with a steepness of 0.8, the system’s accuracy improves by 1.2% compared to the previous work, which uses [0.5Hz, 5Hz] with a steepness of 0.85. The accuracy of using all 40 extracted features is 98.5%. Two feature selection methods based on feature domain and feature ranking are analyzed. The features domain gives an accuracy of 95.8% using 10 features of the time domain, while the combination of time domain and frequency domain gives an accuracy of 98% with 13 features. Three feature ranking methods were used in this paper: minimum redundancy maximum relevance (MRMR), t-Test, and receiver operating characteristic (ROC). The analysis of the feature ranking method has the accuracy of 98.2%, 85.8%, and 98% for MRMR, t-Test, and ROC with 10 features, respectively. While the accuracy of using 20 features is 98.3%, 97.9%, and 98.3% for MRMR, t-Test, and ROC, respectively. It can be concluded that the feature selection method helps to reduce the number of features while giving a good accuracy

Early diagnosis of frailty: Technological and non-intrusive devices for clinical detection

This work analyses different concepts for frailty diagnosis based on affordable standard technology such as smartphones or wearable devices. The goal is to provide ideas that go beyond classical diagnostic tools such as magnetic resonance imaging or tomography, thus changing the paradigm; enabling the detection of frailty without expensive facilities, in an ecological way for both patients and medical staff and even with continuous monitoring. Fried's five-point phenotype model of frailty along with a model based on trials and several classical physical tests were used for device classification. This work provides a starting point for future researchers who will have to try to bridge the gap separating elderly people from technology and medical tests in order to provide feasible, accurate and affordable tools for frailty monitoring for a wide range of users.This work was sponsored by the Spanish Ministry of Science, Innovation and Universities and the European Regional Development Fund (ERDF) across projects RTC-2017-6321-1 AEI/FEDER, UE, TEC2016-76021-C2-2-R AEI/FEDER, UE and PID2019-107270RB-C21/AEI/10.13039/501100011033, UE

Detecting Eating Episodes with an Ear-mounted Sensor

In this paper, we propose Auracle, a wearable earpiece that can automatically recognize eating behavior. More specifically, in free-living conditions, we can recognize when and for how long a person is eating. Using an off-the-shelf contact microphone placed behind the ear, Auracle captures the sound of a person chewing as it passes through the bone and tissue of the head. This audio data is then processed by a custom analog/digital circuit board. To ensure reliable (yet comfortable) contact between microphone and skin, all hardware components are incorporated into a 3D-printed behind-the-head framework. We collected field data with 14 participants for 32 hours in free-living conditions and additional eating data with 10 participants for 2 hours in a laboratory setting. We achieved accuracy exceeding 92.8% and F1 score exceeding 77.5% for eating detection. Moreover, Auracle successfully detected 20-24 eating episodes (depending on the metrics) out of 26 in free-living conditions. We demonstrate that our custom device could sense, process, and classify audio data in real time. Additionally, we estimateAuracle can last 28.1 hours with a 110 mAh battery while communicating its observations of eating behavior to a smartphone over Bluetooth

Thought on Food: A Systematic Review of Current Approaches and Challenges for Food Intake Detection

Nowadays, individuals have very stressful lifestyles, affecting their nutritional habits. In the early stages of life, teenagers begin to exhibit bad habits and inadequate nutrition. Likewise, other people with dementia, Alzheimer’s disease, or other conditions may not take food or medicine regularly. Therefore, the ability to monitor could be beneficial for them and for the doctors that can analyze the patterns of eating habits and their correlation with overall health. Many sensors help accurately detect food intake episodes, including electrogastrography, cameras, microphones, and inertial sensors. Accurate detection may provide better control to enable healthy nutrition habits. This paper presents a systematic review of the use of technology for food intake detection, focusing on the different sensors and methodologies used. The search was performed with a Natural Language Processing (NLP) framework that helps screen irrelevant studies while following the PRISMA methodology. It automatically searched and filtered the research studies in different databases, including PubMed, Springer, ACM, IEEE Xplore, MDPI, and Elsevier. Then, the manual analysis selected 30 papers based on the results of the framework for further analysis, which support the interest in using sensors for food intake detection and nutrition assessment. The mainly used sensors are cameras, inertial, and acoustic sensors that handle the recognition of food intake episodes with artificial intelligence techniques. This research identifies the most used sensors and data processing methodologies to detect food intake.info:eu-repo/semantics/publishedVersio

안경에서 기계적으로 증폭된 힘 측정을 통한 측두근 활동의 감지

학위논문 (박사)-- 서울대학교 대학원 공과대학 기계항공공학부, 2017. 8. 이건우.Recently, the form of a pair of glasses is broadly utilized as a wearable device that provides the virtual and augmented reality in addition to its natural functionality as a visual aid. These approaches, however, have lacked the use of its inherent kinematic structure, which is composed of both the temple and the hinge. When we equip the glasses, the force is concentrated at the hinge, which connects the head piece and the temple, from the law of the lever. In addition, since the temple passes through a temporalis muscle, chewing and wink activity, anatomically activated by the contraction and relaxation of the temporalis muscle, can be detected from the mechanically amplified force measurement at the hinge. This study presents a new and effective method for automatic and objective measurement of the temporalis muscle activity through the natural-born lever mechanism of the glasses. From the implementation of the load cell-integrated wireless circuit module inserted into the both hinges of a 3D printed glasses frame, we developed the system that responds to the temporalis muscle activity persistently regardless of various form factor different from each person. This offers the potential to improve previous studies by avoiding the morphological, behavioral, and environmental constraints of using skin-attached, proximity, and sound sensors. In this study, we collected data featured as sedentary rest, chewing, walking, chewing while walking, talking and wink from 10-subject user study. The collected data were transferred to a series of 84-dimentional feature vectors, each of which was composed of the statistical features of both temporal and spectral domain. These feature vectors, then, were used to define a classifier model implemented by the support vector machine (SVM) algorithm. The model classified the featured activities (chewing, wink, and physical activity) as the average F1 score of 93.7%. This study provides a novel approach on the monitoring of ingestive behavior (MIB) in a non-intrusive and un-obtrusive manner. It supplies the possibility to apply the MIB into daily life by distinguishing the food intake from the other physical activities such as walking, talking, and wink with higher accuracy and wearability. Furthermore, through applying this approach to a sensor-integrated hair band, it can be potentially used for the medical monitoring of the sleep bruxism or temporomandibular dysfunction.Abstract Chapter 1. Introduction 1.1. Motivation 1.1.1. Law of the Lever 1.1.2. Lever Mechanism in Human Body 1.1.3. Mechanical Advantage in Auditory Ossicle 1.1.4. Mechanical Advantage in Glasses 1.2. Background 1.2.1. Biological Information from Temporalis Muscle 1.2.2. Detection of Temporalis Muscle Activity 1.2.3. Monitoring of Ingestive Behavior 1.3. Research Scope and Objectives Chapter 2. Proof-of-Concept Validation 2.1. Experimental Apparatus 2.2. Measurement Results 2.3. Discussion Chapter 3. Implementation of GlasSense 3.1. Hardware Prototyping 3.1.1. Preparation 3.1.2. Load Cell-Integrated Circuit Module 3.1.3. 3D Printed Frame of Glasses 3.1.4. Hardware Integration 3.2. Data Acquisition System 3.2.1. Wireless Data Transmission 3.2.2. Data Collecting Module Chapter 4. Data Collection through User Study 4.1. Preparation for Experiment 4.2. Activity Recording Chapter 5. Feature Extraction 5.1. Signal Preprocessing and Segmentation 5.1.1. Temporal Frame 5.1.2. Spectral Frame 5.2. Feature Extraction 5.2.1. Temporal Features 5.2.2. Spectral Features 5.2.3. Feature Vector Generation Chapter 6. Classification of Featured Activity 6.1. Support Vector Machine (SVM) 6.2. Design of Classifier Model 6.2.1. Grid-Search 6.2.2. Cross-Validation 6.3. Classification Result 6.4. Performance Improvement 6.5. Discussion Chapter 7. Conclusions Bibliography 초록Docto

DETECTION OF HEALTH-RELATED BEHAVIOURS USING HEAD-MOUNTED DEVICES

The detection of health-related behaviors is the basis of many mobile-sensing applications for healthcare and can trigger other inquiries or interventions. Wearable sensors have been widely used for mobile sensing due to their ever-decreasing cost, ease of deployment, and ability to provide continuous monitoring. In this dissertation, we develop a generalizable approach to sensing eating-related behavior. First, we developed Auracle, a wearable earpiece that can automatically detect eating episodes. Using an off-the-shelf contact microphone placed behind the ear, Auracle captures the sound of a person chewing as it passes through the head. This audio data is then processed by a custom circuit board. We collected data with 14 participants for 32 hours in free-living conditions and achieved accuracy exceeding 92.8% and F1 score exceeding77.5% for eating detection with 1-minute resolution. Second, we adapted Auracle for measuring children’s eating behavior, and improved the accuracy and robustness of the eating-activity detection algorithms. We used this improved prototype in a laboratory study with a sample of 10 children for 60 total sessions and collected 22.3 hours of data in both meal and snack scenarios. Overall, we achieved 95.5% accuracy and 95.7% F1 score for eating detection with 1-minute resolution. Third, we developed a computer-vision approach for eating detection in free-living scenarios. Using a miniature head-mounted camera, we collected data with 10 participants for about 55 hours. The camera was fixed under the brim of a cap, pointing to the mouth of the wearer and continuously recording video (but not audio) throughout their normal daily activity. We evaluated performance for eating detection using four different Convolutional Neural Network (CNN) models. The best model achieved 90.9% accuracy and 78.7%F1 score for eating detection with 1-minute resolution. Finally, we validated the feasibility of deploying the 3D CNN model in wearable or mobile platforms when considering computation, memory, and power constraints