Enhancing Activity Recognition by Fusing Inertial and Biometric Information

Activity recognition is an active research field nowadays, as it enables the development of highly adaptive applications, e.g. in the field of personal health. In this paper, a light high-level fusion algorithm to detect the activity that an individual is performing is presented. The algorithm relies on data gathered from accelerometers placed on different parts of the body, and on biometric sensors. Inertial sensors allow detecting activity by analyzing signal features such as amplitude or peaks. In addition, there is a relationship between the activity intensity and biometric response, which can be considered together with acceleration data to improve the accuracy of activity detection. The proposed algorithm is designed to work with minimum computational cost, being ready to run in a mobile device as part of a context-aware application. In order to enable different user scenarios, the algorithm offers best-effort activity estimation: its quality of estimation depends on the position and number of the available inertial sensors, and also on the presence of biometric information

Real-time human ambulation, activity, and physiological monitoring:taxonomy of issues, techniques, applications, challenges and limitations

Automated methods of real-time, unobtrusive, human ambulation, activity, and wellness monitoring and data analysis using various algorithmic techniques have been subjects of intense research. The general aim is to devise effective means of addressing the demands of assisted living, rehabilitation, and clinical observation and assessment through sensor-based monitoring. The research studies have resulted in a large amount of literature. This paper presents a holistic articulation of the research studies and offers comprehensive insights along four main axes: distribution of existing studies; monitoring device framework and sensor types; data collection, processing and analysis; and applications, limitations and challenges. The aim is to present a systematic and most complete study of literature in the area in order to identify research gaps and prioritize future research directions

Physical activity assessment under free-living conditions using pattern-recognition monitors

Extensive literature has documented the health benefits of physical activity. Valid, reliable and feasible physical activity assessment tools are necessary to assess the complexity and multidimensionality of physical activity behavior. Pattern-recognition activity monitors that integrate information from multiple sensors appear to be the most promising approach for assessing physical activity under free-living conditions. Previous studies have provided support to the validity of pattern-recognition monitors for assessing the energy cost of activity under-free living conditions in young adults. However, children and older adults present unique measurement challenges for the assessment of physical activity under free-living conditions. The series of studies in this dissertation extends previous research by assessing the accuracy of a pattern-recognition monitor (SenseWear Armband) in children and older adults under free-living conditions. Consistent with previous findings in young adults, results indicate that the SenseWear Armband monitors provide valid estimates of total energy expenditure and activity energy expenditure in older adults and children, under free-living conditions. Collectively, the findings of this research support the validity of the SenseWear Armband for assessing physical activity under free-living conditions in children and older adults

Automatic identification of physical activity intensity and modality from the fusion of accelerometry and heart rate data

Background: Physical activity (PA) is essential to prevent and to treat a variety of chronic diseases. The automated detection and quantification of PA over time empowers lifestyle interventions, facilitating reliable exercise tracking and data-driven counseling. Methods: We propose and compare various combinations of machine learning (ML) schemes for the automatic classification of PA from multi-modal data, simultaneously captured by a biaxial accelerometer and a heart rate (HR) monitor. Intensity levels (low/moderate/vigorous) were recognized, as well as for vigorous exercise, its modality (sustained aerobic/resistance/mixed). In total, 178.63 h of data about PA intensity (65.55% low/18.96% moderate/15.49% vigorous) and 17.00 h about modality were collected in two experiments: one in free-living conditions, another in a fitness center under controlled protocols. The structure used for automatic classification comprised: a) definition of 42 time-domain signal features, b) dimensionality reduction, c) data clustering, and d) temporal filtering to exploit time redundancy by means of a Hidden Markov Model (HMM). Four dimensionality reduction techniques and four clustering algorithms were studied. In order to cope with class imbalance in the dataset, a custom performance metric was defined to aggregate recognition accuracy, precision and recall. Results: The best scheme, which comprised a projection through Linear Discriminant Analysis (LDA) and k-means clustering, was evaluated in leave-one-subject-out cross-validation; notably outperforming the standard industry procedures for PA intensity classification: score 84.65%, versus up to 63.60%. Errors tended to be brief and to appear around transients. Conclusions: The application of ML techniques for pattern identification and temporal filtering allowed to merge accelerometry and HR data in a solid manner, and achieved markedly better recognition performances than the standard methods for PA intensity estimation

The Estimation of Caloric Expenditure Using Three Triaxial Accelerometers

Accelerometer-based activity monitors are commonly used to measure physical activity energy expenditure (PAEE). Newly designed wrist and hip-worn triaxial accelerometers claim to accurately predict PAEE across a range of activities. Purpose: To determine if the Nike FuelBand (NFB), Fitbit (FB) and ActiGraph GT3X+ (AG) estimate PAEE in various activities. Methods: 21 healthy, college-aged adults wore a NFB on the right wrist, a FB on the left hip, and AG on the right hip, while performing 17 activities. AG data were analyzed using Freedson’s kcal regression equation. PAEE was measured using the Cosmed K4b2 (K4). Repeated measures ANOVAs were used to compare mean differences in PAEE (kcal/min). Paired sample t-tests with Bonferroni adjustments were used to locate significant differences. Results: For each device, the mean difference in PAEE was significantly different from the K4 (NFB, -0.45 + 2.8, FB, 0.48 + 2.27, AG, 0.64 + 2.59 kcal/min, p = 0.01). The NFB significantly overestimated most walking activities (e.g., regular walking; K4, 3.1 + 0.2 vs. NFB, 4.6 + 0.2 kcal/min) and activities with arm movements (e.g., sweeping; K4, 3.0 + 0.8 vs. NFB, 4.7 + 0.4 kcal/min, p \u3c 0.05). The NFB trended towards overestimating sport activities (basketball; K4, 10.8 + 0.8 vs. NFB, 12.2 + 0.5 kcal/min) (racquetball; K4, 9.6 + 0.8 vs. NFB 11.1 + 0.5 kcal/min). The FB and the AG significantly overestimated walking (K4, 3.1 + 0.2; FB, 5.4 + 0.3, AG, 5.8 + 0.4 kcal/min, p = 0.01) and underestimated PAEE of most activities with arm movements (e.g., Air Dyne, K4 5.6 + 0.2; Fitbit, 0.3 + 0.2; AG, 0.2 + 0.1 kcal/min, p \u3c 0.05) (racquetball, K4, 9.6 + 0.8 kcal/minute vs. FB, 7.4 + 0.6 kcal/minute, vs. AG, 6.5 + 0.4 kcal/minute, p \u3c 0.05). Conclusion: The NFB overestimated PAEE during most activities with arm movements and tended to overestimate sport activities, while the AG and FB overestimated walking and underestimated activities with arm movements. Overall, the wrist-worn NFB had similar accuracy to the waist-worn triaxial accelerometers; however, none of the devices were able to estimate PAEE across a range of activities