Towards Knowledge Uncertainty Estimation for Open Set Recognition

POCI-01-0247-FEDER-033479Uncertainty is ubiquitous and happens in every single prediction of Machine Learning models. The ability to estimate and quantify the uncertainty of individual predictions is arguably relevant, all the more in safety-critical applications. Real-world recognition poses multiple challenges since a model's knowledge about physical phenomenon is not complete, and observations are incomplete by definition. However, Machine Learning algorithms often assume that train and test data distributions are the same and that all testing classes are present during training. A more realistic scenario is the Open Set Recognition, where unknown classes can be submitted to an algorithm during testing. In this paper, we propose a Knowledge Uncertainty Estimation (KUE) method to quantify knowledge uncertainty and reject out-of-distribution inputs. Additionally, we quantify and distinguish aleatoric and epistemic uncertainty with the classical information-theoretical measures of entropy by means of ensemble techniques. We performed experiments on four datasets with different data modalities and compared our results with distance-based classifiers, SVM-based approaches and ensemble techniques using entropy measures. Overall, the effectiveness of KUE in distinguishing in- and out-distribution inputs obtained better results in most cases and was at least comparable in others. Furthermore, a classification with rejection option based on a proposed combination strategy between different measures of uncertainty is an application of uncertainty with proven results.publishersversionpublishe

Posture Risk Assessment in an Automotive Assembly Line using Inertial Sensors

Publisher Copyright: AuthorMusculoskeletal disorders (MSD) are a highly prevalent work-related health problem. Biomechanical exposure to hazardous postures during work is a risk factor for the development of MSD. This study focused on developing an inertial sensor-based approach to evaluate posture in industrial contexts, particularly in automotive assembly lines. The analysis was divided into two stages: 1) a comparative study of joint angles calculated during movements of the upper body segments using the proposed motion tracking framework and the ones provided by a state-of-the-art inertial motion capture system and 2) a work-related posture risk evaluation of operators working in an automative assembly line. For the comparative study, we selected data collected in laboratory (N = 8 participants) and assembly line settings (N = 9 participants), while for the work-related posture risk evaluation, we only considered data acquired within the automotive assembly line. The results revealed that the proposed framework could be applied to track industrial tasks movements performed on the sagittal plane, and the posture evaluation uncovered posture risk differences among different operators that are not considered in traditional posture risk assessment instruments.publishersversionepub_ahead_of_prin

A Novel Approach for User Equipment Indoor/Outdoor Classification in Mobile Networks

POCI-01-0247-FEDER-033479The ability to locate users and estimate traffic in mobile networks is still one of the major challenges when it comes to planning and optimizing the networks. Since indoor location is not always possible or precise, having the ability to distinguish indoor from outdoor traffic can be a valuable alternative and/or improvement. In this paper, two different machine learning algorithms are presented to classify a user's environment, whether indoor or outdoor, using only data from a Long Term Evolution (LTE) network. To test both algorithms, two different measurement campaigns were done. Both campaigns used a smartphone to gather data from the user's side. The first measurement campaign was done across 6 different cities, ranging from small rural areas to large urban environments, while the second was only done on a large urban city. On the second campaign, Network Traces (NT) data was also collected from the network side. The first algorithm consists on a Random Forest (RF) and the second relies on a Long Short Term Memory (LSTM), thus covering both more traditional machine learning and deep learning approaches. The results varied from 0.75 to 0.91 on the F1-Score, depending on the validation strategy, showing promising results.publishersversionpublishe