Towards Structured Analysis of Broadcast Badminton Videos

Sports video data is recorded for nearly every major tournament but remains archived and inaccessible to large scale data mining and analytics. It can only be viewed sequentially or manually tagged with higher-level labels which is time consuming and prone to errors. In this work, we propose an end-to-end framework for automatic attributes tagging and analysis of sport videos. We use commonly available broadcast videos of matches and, unlike previous approaches, does not rely on special camera setups or additional sensors. Our focus is on Badminton as the sport of interest. We propose a method to analyze a large corpus of badminton broadcast videos by segmenting the points played, tracking and recognizing the players in each point and annotating their respective badminton strokes. We evaluate the performance on 10 Olympic matches with 20 players and achieved 95.44% point segmentation accuracy, 97.38% player detection score ([email protected]), 97.98% player identification accuracy, and stroke segmentation edit scores of 80.48%. We further show that the automatically annotated videos alone could enable the gameplay analysis and inference by computing understandable metrics such as player's reaction time, speed, and footwork around the court, etc.Comment: 9 page

Tracking of a Basketball Using Multiple Cameras

Projecte final de carrera fet en copl.laboració amb École Polytechnique Fédérale de LaussanneThis master thesis presents a method for tracking a basketball during a basketball match recorded with a multi-camera system. We first developed methods to detect a ball in images based on its appearance. Color was used through a color histogram of the ball, manually initialized with ball samples. Then the shape of the ball was used in two different ways: by analyzing the circularity of the ball contour and by using the Hough transform to find circles in the image. In a second step, we attempted to track the ball in three dimensions using the cameras calibration, as well as the image methods previously developed. Using a recursive tracking procedure, we define a 3-dimensional search volume around the previously known position of the ball and evaluate the presence of a ball in all candidate positions inside this volume. This is performed by projecting the candidate positions in all camera views and checking the ball presence using color and shape cues. Extrapolating the future position of the ball based on its movements in the past frames was also tested to make our method more robust to motion blur and occlusions. Evaluation of the proposed algorithm has been done on a set of synchronized multi-camera sequences. The results have shown that the algorithm can track the ball and find its 3D position during several consecutive frames

A Survey of Deep Learning in Sports Applications: Perception, Comprehension, and Decision

Deep learning has the potential to revolutionize sports performance, with applications ranging from perception and comprehension to decision. This paper presents a comprehensive survey of deep learning in sports performance, focusing on three main aspects: algorithms, datasets and virtual environments, and challenges. Firstly, we discuss the hierarchical structure of deep learning algorithms in sports performance which includes perception, comprehension and decision while comparing their strengths and weaknesses. Secondly, we list widely used existing datasets in sports and highlight their characteristics and limitations. Finally, we summarize current challenges and point out future trends of deep learning in sports. Our survey provides valuable reference material for researchers interested in deep learning in sports applications

Survey on Vision-based Path Prediction

Path prediction is a fundamental task for estimating how pedestrians or vehicles are going to move in a scene. Because path prediction as a task of computer vision uses video as input, various information used for prediction, such as the environment surrounding the target and the internal state of the target, need to be estimated from the video in addition to predicting paths. Many prediction approaches that include understanding the environment and the internal state have been proposed. In this survey, we systematically summarize methods of path prediction that take video as input and and extract features from the video. Moreover, we introduce datasets used to evaluate path prediction methods quantitatively.Comment: DAPI 201