Image analysis of sports events

Tese de mestrado integrado. Engenharia Electrotécnica e de Computadores (Major de Automação). Faculdade de Engenharia. Universidade do Porto. 200

A video-based framework for automatic 3d localization of multiple basketball players : a combinatorial optimization approach

Sports complexity must be investigated at competitions; therefore, non-invasive methods are essential. In this context, computer vision, image processing, and machine learning techniques can be useful in designing a non-invasive system for data acquisition that identifies players’ positions in official basketball matches. Here, we propose and evaluate a novel video-based framework to perform automatic 3D localization of multiple basketball players. The introduced framework comprises two parts. The first stage is player detection, which aims to identify players’ heads at the camera image level. This stage is based on background segmentation and on classification performed by an artificial neural network. The second stage is related to 3D reconstruction of the player positions from the images provided by the different cameras used in the acquisition. This task is tackled by formulating a constrained combinatorial optimization problem that minimizes the re-projection error while maximizing the number of detections in the formulated 3D localization problem8286CONSELHO NACIONAL DE DESENVOLVIMENTO CIENTÍFICO E TECNOLÓGICO - CNPQCOORDENAÇÃO DE APERFEIÇOAMENTO DE PESSOAL DE NÍVEL SUPERIOR - CAPESFUNDAÇÃO DE AMPARO À PESQUISA DO ESTADO DE SÃO PAULO - FAPESPNão temNão temNão temWe would like to thank the CAPES, FAEPEX, FAPESP, and CNPq for funding their research. This paper has content from master degree’s dissertation previously published (Monezi, 2016) and available onlin

Reconfigurable Vision Processing for Player Tracking in Indoor Sports

Ibraheem OW. Reconfigurable Vision Processing for Player Tracking in Indoor Sports. Bielefeld: Universität Bielefeld; 2018.Over the past decade, there has been an increasing growth of using vision-based systems for tracking players in sports. The tracking results are used to evaluate and enhance the performance of the players as well as to provide detailed information (e.g., on the players and team performance) to viewers. Player tracking using vision systems is a very challenging task due to the nature of sports games, which includes severe and frequent interactions (e.g., occlusions) between the players. Additionally, these vision systems have high computational demands since they require processing of a huge amount of video data based on the utilization of multiple cameras with high resolution and high frame rate. As a result, most of the existing systems based on general-purpose computers are not able to perform online real-time player tracking, but track the players offline using pre-recorded video files, limiting, e.g., direct feedback on the player performance during the game. In this thesis, a reconfigurable vision-based system for automatically tracking the players in indoor sports is presented. The proposed system targets player tracking for basketball and handball games. It processes the incoming video streams from GigE Vision cameras, achieving online real-time player tracking. The teams are identified and the players are detected based on the colors of their jerseys, using background subtraction, color thresholding, and graph clustering techniques. Moreover, the trackingby-detection approach is used to realize player tracking. FPGA technology is used to handle the compute-intensive vision processing tasks by implementing the video acquisition, video preprocessing, player segmentation, and team identification & player detection in hardware, while the less compute-intensive player tracking is performed on the CPU of a host-PC. Player detection and tracking are evaluated using basketball and handball datasets. The results of this work show that the maximum achieved frame rate for the FPGA implementation is 96.7 fps using a Xilinx Virtex-4 FPGA and 136.4 fps using a Virtex-7 device. The player tracking requires an average processing time of 2.53 ms per frame in a host-PC equipped with a 2.93 GHz Intel i7-870 CPU. As a result, the proposed reconfigurable system supports a maximum frame rate of 77.6 fps using two GigE Vision cameras with a resolution of 1392x1040 pixels each. Using the FPGA implementation, a speedup by a factor of 15.5 is achieved compared to an OpenCV-based software implementation in a host-PC. Additionally, the results show a high accuracy for player tracking. In particular, the achieved average precision and recall for player detection are up to 84.02% and 96.6%, respectively. For player tracking, the achieved average precision and recall are up to 94.85% and 94.72%, respectively. Furthermore, the proposed reconfigurable system achieves a 2.4 times higher performance per Watt than a software-based implementation (without FPGA support) for player tracking in a host-PC.Acknowledgments: I (Omar W. Ibraheem) would like to thank the German Academic Exchange Service (DAAD), the Congnitronics and Sensor Systems research group, and the Cluster of Excellence Cognitive Interaction Technology ‘CITEC’ (EXC 277) (Bielefeld University) not only for funding the work in this thesis, but also for all the help and support they gave to successfully finish my thesis

Tracking devices and physical performance analysis in team sports: a comprehensive framework for research—trends and future directions

Background: Tracking devices, such as global (GPS) and local (LPS) positioning systems, combined with physiological measurements, have become reliable tools to characterize movement patterns, assessing the external load (EL), internal load (IL), fatigue, and performance of athletes in team sports. This scoping review aims to provide a comprehensive understanding of the applicability of tracking systems in physical performance analysis within team sports and the wellbeing of athletes based on research strategies and combined variables. Methods: A systematic search was conducted in PubMed, Web of Knowledge, and Scopus databases according to PRISMA guidelines. The 79 studies that were reviewed met the following criteria: (1) contained relevant data regarding elite athletes′ performance; (2) athletes’ EL and IL; (3) were written in the English language; (4) were related only to team sports. Results: The findings indicate that tracking technology has been engaged in several research areas, including performance analysis, training vs. match load management, injuries, and nutrition, through characterization and correlational studies. Metrics, primarily focused on kinematic and mechanical EL aspects, have been employed in combination with IL data to analyze the performance of athletes. However, the lack of an integrative model for the analysis and integration of EL and IL metrics within each team sport suggests an interesting direction for further research. Conclusion: There is a need for coherence between the methods and the research goals on performance analysis. The development of a framework that guides experimental studies is highly recommended, particularly on manipulating metrics analyzed between training and match sessions, injury prevention, and nutrition. This will lead to the development of the most applied sports science research to improve the preparation and decision-making of athletes based on reliable data.info:eu-repo/semantics/publishedVersio

Multi-sensor human action recognition with particular application to tennis event-based indexing

The ability to automatically classify human actions and activities using vi- sual sensors or by analysing body worn sensor data has been an active re- search area for many years. Only recently with advancements in both fields and the ubiquitous nature of low cost sensors in our everyday lives has auto- matic human action recognition become a reality. While traditional sports coaching systems rely on manual indexing of events from a single modality, such as visual or inertial sensors, this thesis investigates the possibility of cap- turing and automatically indexing events from multimodal sensor streams. In this work, we detail a novel approach to infer human actions by fusing multimodal sensors to improve recognition accuracy. State of the art visual action recognition approaches are also investigated. Firstly we apply these action recognition detectors to basic human actions in a non-sporting con- text. We then perform action recognition to infer tennis events in a tennis court instrumented with cameras and inertial sensing infrastructure. The system proposed in this thesis can use either visual or inertial sensors to au- tomatically recognise the main tennis events during play. A complete event retrieval system is also presented to allow coaches to build advanced queries, which existing sports coaching solutions cannot facilitate, without an inordi- nate amount of manual indexing. The event retrieval interface is evaluated against a leading commercial sports coaching tool in terms of both usability and efficiency

Wireless sensing: Material identification and localization

Wireless signals are everywhere around us, and they have truly revolutionized the world by all standards. When one thinks of this revolution, one envisions the advances in wireless communication—TV broadcasts, FM radios, WiFi, Bluetooth, cellular mobile phones, and even wireless chips inside the human body. What gets less appreciated, however, is that wireless signals can also be a powerful sensor. The fact that wireless signals touch and penetrate all objects in our environment, and bounce back, make them a powerful lens to view our world through. This thesis focuses on using wireless signals as sensors. We will explore how modifications to wireless signal propagation can reveal the physical properties of the materials that these signals have passed through. This enables identification of materials without touching them or performing any chemical analysis on them. We will show the ability to distinguish between closely related liquids, such as Pepsi and Coca-Cola, or distilled water and mineral water, by simply passing wireless signals through the liquids, and analyzing the signals that emerge on the other side. The propagation delay of wireless signals when passing through air can reveal the distance between a transmitter and a receiver. We show how this primitive can be extended for localization with applications to sports, battlefields, and emergency response. Through modifications to the distance measurement mechanisms, we show how localization is possible even when wireless devices are constantly under motion. We end by discussing future directions in which both of these sensing techniques can be extended. Under the right conditions, it might be possible to localize an object to 5mm precision with applications in robotic machines, augmented reality, and virtual reality. We then discuss the possibility of using reflections of wireless signals, for example, to determine soil moisture content in agricultural fields