Estimating 2D Upper Body Poses from Monocular Images

Automatic estimation and recognition of poses from video allows for a whole range of applications. The research described here is an important step towards automatic extraction of 3D poses. We describe our research to extract the 2D joint locations of the people in meeting videos. The key point of the research described here is that we generalize over variations in appearance of both people and scene. This results in a robust detection of 2D joint locations. For the detection of different limbs, we employ a number of limb locators. Each of these uses a different set of image features. We evaluate our work on two videos that have been recorded in the meeting context. Our results are promising, yielding an average error of approximately 3-5 cm per joint

TNO at TRECVID 2013 : multimedia event detection and instance search

We describe the TNO system and the evaluation results for TRECVID 2013 Multimedia Event Detection (MED) and instance search (INS) tasks. The MED system consists of a bag-of-word (BOW) approach with spatial tiling that uses low-level static and dynamic visual features, an audio feature and high-level concepts. Automatic speech recognition (ASR) and optical character recognition (OCR) are not used in the system. In the MED case with 100 example training videos, support-vector machines (SVM) are trained and fused to detect an event in the test set. In the case with 0 example videos, positive and negative concepts are extracted as keywords from the textual event description and events are detected with the high-level concepts. The MED results show that the SIFT keypoint descriptor is the one which contributes best to the results, fusion of multiple low-level features helps to improve the performance, and the textual event-description chain currently performs poorly. The TNO INS system presents a baseline open-source approach using standard SIFT keypoint detection and exhaustive matching. In order to speed up search times for queries a basic map-reduce scheme is presented to be used on a multi-node cluster. Our INS results show above-median results with acceptable search times.This research for the MED submission was performed in the GOOSE project, which is jointly funded by the enabling technology program Adaptive Multi Sensor Networks (AMSN) and the MIST research program of the Dutch Ministry of Defense. The INS submission was partly supported by the MIME project of the creative industries knowledge and innovation network CLICKNL.peer-reviewe

Machine Learning for Digital Twins to Predict Responsiveness of Cyber-Physical Energy Systems

Cyber-Physical Systems are becoming more autonomous, interconnected, complex and adaptive, and are expected to operate in highly dynamic environments. This is especially challenging for energy ecosystems that are increasingly difficult to control and maintain as the number of participating manufacturers and users grows. Digital Twins help analyze and predict these systems in the form of digital reflections that operate in parallel with the physical system. In this paper, we use Machine Learning to improve the predictive power of Digital Twins for Cyber-Physical Energy Systems. Specifically, we use a Temporal Convolutional Neural Network model to learn the temporal patterns in the system and predict its responsiveness to specific power setpoint instructions. Real-life data from ten batteries were used to predict the behavior over time. Compared to the baseline model that uses the prior probability of response and the average response rate within the configured time window, the model predicts the batteries' responsiveness more accurately. The more temporal information is used as input for prediction, the better the model performs in both precision and recall. The results show that this compensates for the lack of information when fewer metrics are used. The use of Machine Learning for Digital Twins can help maintain a heterogeneous energy ecosystem, while minimizing the need to acquire or disclose detailed information

Digital twins : dynamic model-data fusion for ecology

Digital twins (DTs) are an emerging phenomenon in the public and private sectors as a new tool to monitor and understand systems and processes. DTs have the potential to change the status quo in ecology as part of its digital transformation. However, it is important to avoid misguided developments by managing expectations about DTs. We stress that DTs are not just big models of everything, containing big data and machine learning. Rather, the strength of DTs is in combining data, models, and domain knowledge, and their continuous alignment with the real world. We suggest that researchers and stakeholders exercise caution in DT development, keeping in mind that many of the strengths and challenges of computational modelling in ecology also apply to DTs.peerReviewe