Combining inertial and visual sensing for human action recognition in tennis

In this paper, we present a framework for both the automatic extraction of the temporal location of tennis strokes within a match and the subsequent classification of these as being either a serve, forehand or backhand. We employ the use of low-cost visual sensing and low-cost inertial sensing to achieve these aims, whereby a single modality can be used or a fusion of both classification strategies can be adopted if both modalities are available within a given capture scenario. This flexibility allows the framework to be applicable to a variety of user scenarios and hardware infrastructures. Our proposed approach is quantitatively evaluated using data captured from elite tennis players. Results point to the extremely accurate performance of the proposed approach irrespective of input modality configuration

Analysis and Forecasting of Trending Topics in Online Media Streams

Among the vast information available on the web, social media streams capture what people currently pay attention to and how they feel about certain topics. Awareness of such trending topics plays a crucial role in multimedia systems such as trend aware recommendation and automatic vocabulary selection for video concept detection systems. Correctly utilizing trending topics requires a better understanding of their various characteristics in different social media streams. To this end, we present the first comprehensive study across three major online and social media streams, Twitter, Google, and Wikipedia, covering thousands of trending topics during an observation period of an entire year. Our results indicate that depending on one's requirements one does not necessarily have to turn to Twitter for information about current events and that some media streams strongly emphasize content of specific categories. As our second key contribution, we further present a novel approach for the challenging task of forecasting the life cycle of trending topics in the very moment they emerge. Our fully automated approach is based on a nearest neighbor forecasting technique exploiting our assumption that semantically similar topics exhibit similar behavior. We demonstrate on a large-scale dataset of Wikipedia page view statistics that forecasts by the proposed approach are about 9-48k views closer to the actual viewing statistics compared to baseline methods and achieve a mean average percentage error of 45-19% for time periods of up to 14 days.Comment: ACM Multimedia 201

Key-Pose Prediction in Cyclic Human Motion

In this paper we study the problem of estimating innercyclic time intervals within repetitive motion sequences of top-class swimmers in a swimming channel. Interval limits are given by temporal occurrences of key-poses, i.e. distinctive postures of the body. A key-pose is defined by means of only one or two specific features of the complete posture. It is often difficult to detect such subtle features directly. We therefore propose the following method: Given that we observe the swimmer from the side, we build a pictorial structure of poselets to robustly identify random support poses within the regular motion of a swimmer. We formulate a maximum likelihood model which predicts a key-pose given the occurrences of multiple support poses within one stroke. The maximum likelihood can be extended with prior knowledge about the temporal location of a key-pose in order to improve the prediction recall. We experimentally show that our models reliably and robustly detect key-poses with a high precision and that their performance can be improved by extending the framework with additional camera views.Comment: Accepted at WACV 2015, 8 pages, 3 figure

The multi-modality cardiac imaging approach to the Athlete's heart: an expert consensus of the European Association of Cardiovascular Imaging

The term 'athlete's heart' refers to a clinical picture characterized by a slow heart rate and enlargement of the heart. A multi-modality imaging approach to the athlete's heart aims to differentiate physiological changes due to intensive training in the athlete's heart from serious cardiac diseases with similar morphological features. Imaging assessment of the athlete's heart should begin with a thorough echocardiographic examination. Left ventricular (LV) wall thickness by echocardiography can contribute to the distinction between athlete's LV hypertrophy and hypertrophic cardiomyopathy (HCM). LV end-diastolic diameter becomes larger (>55 mm) than the normal limits only in end-stage HCM patients when the LV ejection fraction is <50%. Patients with HCM also show early impairment of LV diastolic function, whereas athletes have normal diastolic function. When echocardiography cannot provide a clear differential diagnosis, cardiac magnetic resonance (CMR) imaging should be performed. With CMR, accurate morphological and functional assessment can be made. Tissue characterization by late gadolinium enhancement may show a distinctive, non-ischaemic pattern in HCM and a variety of other myocardial conditions such as idiopathic dilated cardiomyopathy or myocarditis. The work-up of athletes with suspected coronary artery disease should start with an exercise ECG. In athletes with inconclusive exercise ECG results, exercise stress echocardiography should be considered. Nuclear cardiology techniques, coronary cardiac tomography (CCT) and/or CMR may be performed in selected cases. Owing to radiation exposure and the young age of most athletes, the use of CCT and nuclear cardiology techniques should be restricted to athletes with unclear stress echocardiography or CMR

A sensing platform for physiological and contextual feedback to tennis athletes

In this paper we describe our work on creating a multi-modal sensing platform for providing feedback to tennis coaches and players. The platform includes a fixed installation around a tennis court consisting of a video camera network and a localisation system as well as wearable sensing technology deployed to individual athletes. We describe the various components of this platform and explain how we can capture synchronised multi-modal sensor data streams for games or training sessions. We then describe the content-based retrieval system we are building to facilitate the development of novel coaching tools. We provide some examples of the queries that the system can support, where these queries are chosen to be suitably expressive so as to reflect a coach's complex information needs regarding tennis-related performance factors

SportsTrack: An Innovative Method for Tracking Athletes in Sports Scenes

The SportsMOT dataset aims to solve multiple object tracking of athletes in different sports scenes such as basketball or soccer. The dataset is challenging because of the unstable camera view, athletes' complex trajectory, and complicated background. Previous MOT methods can not match enough high-quality tracks of athletes. To pursue higher performance of MOT in sports scenes, we introduce an innovative tracker named SportsTrack, we utilize tracking by detection as our detection paradigm. Then we will introduce a three-stage matching process to solve the motion blur and body overlapping in sports scenes. Meanwhile, we present another innovation point: one-to-many correspondence between detection bboxes and crowded tracks to handle the overlap of athletes' bodies during sports competitions. Compared to other trackers such as BOT-SORT and ByteTrack, We carefully restored edge-lost tracks that were ignored by other trackers. Finally, we reached the SOTA result in the SportsMOT dataset.Comment: 7 pages,9 figure