4,564 research outputs found
Stochastic Prediction of Multi-Agent Interactions from Partial Observations
We present a method that learns to integrate temporal information, from a
learned dynamics model, with ambiguous visual information, from a learned
vision model, in the context of interacting agents. Our method is based on a
graph-structured variational recurrent neural network (Graph-VRNN), which is
trained end-to-end to infer the current state of the (partially observed)
world, as well as to forecast future states. We show that our method
outperforms various baselines on two sports datasets, one based on real
basketball trajectories, and one generated by a soccer game engine.Comment: ICLR 2019 camera read
Spatial movement pattern recognition in soccer based on relative player movements
Knowledge of spatial movement patterns in soccer occurring on a regular basis can give a soccer coach, analyst or reporter insights in the playing style or tactics of a group of players or team. Furthermore, it can support a coach to better prepare for a soccer match by analysing (trained) movement patterns of both his own as well as opponent players. We explore the use of the Qualitative Trajectory Calculus (QTC), a spatiotemporal qualitative calculus describing the relative movement between objects, for spatial movement pattern recognition of players movements in soccer. The proposed method allows for the recognition of spatial movement patterns that occur on different parts of the field and/or at different spatial scales. Furthermore, the Levenshtein distance metric supports the recognition of similar movements that occur at different speeds and enables the comparison of movements that have different temporal lengths. We first present the basics of the calculus, and subsequently illustrate its applicability with a real soccer case. To that end, we present a situation where a user chooses the movements of two players during 20 seconds of a real soccer match of a 2016-2017 professional soccer competition as a reference fragment. Following a pattern matching procedure, we describe all other fragments with QTC and calculate their distance with the QTC representation of the reference fragment. The top-k most similar fragments of the same match are presented and validated by means of a duo-trio test. The analyses show the potential of QTC for spatial movement pattern recognition in soccer
Coordinated Multi-Agent Imitation Learning
We study the problem of imitation learning from demonstrations of multiple
coordinating agents. One key challenge in this setting is that learning a good
model of coordination can be difficult, since coordination is often implicit in
the demonstrations and must be inferred as a latent variable. We propose a
joint approach that simultaneously learns a latent coordination model along
with the individual policies. In particular, our method integrates unsupervised
structure learning with conventional imitation learning. We illustrate the
power of our approach on a difficult problem of learning multiple policies for
fine-grained behavior modeling in team sports, where different players occupy
different roles in the coordinated team strategy. We show that having a
coordination model to infer the roles of players yields substantially improved
imitation loss compared to conventional baselines.Comment: International Conference on Machine Learning 201
A Graph-Based Method for Soccer Action Spotting Using Unsupervised Player Classification
Action spotting in soccer videos is the task of identifying the specific time
when a certain key action of the game occurs. Lately, it has received a large
amount of attention and powerful methods have been introduced. Action spotting
involves understanding the dynamics of the game, the complexity of events, and
the variation of video sequences. Most approaches have focused on the latter,
given that their models exploit the global visual features of the sequences. In
this work, we focus on the former by (a) identifying and representing the
players, referees, and goalkeepers as nodes in a graph, and by (b) modeling
their temporal interactions as sequences of graphs. For the player
identification, or player classification task, we obtain an accuracy of 97.72%
in our annotated benchmark. For the action spotting task, our method obtains an
overall performance of 57.83% average-mAP by combining it with other
audiovisual modalities. This performance surpasses similar graph-based methods
and has competitive results with heavy computing methods. Code and data are
available at https://github.com/IPCV/soccer_action_spotting.Comment: Accepted at the 5th International ACM Workshop on Multimedia Content
Analysis in Sports (MMSports 2022
Bring it to the Pitch: Combining Video and Movement Data to Enhance Team Sport Analysis
Analysts in professional team sport regularly perform analysis to gain strategic and tactical insights into player and team behavior. Goals of team sport analysis regularly include identification of weaknesses of opposing teams, or assessing performance and improvement potential of a coached team. Current analysis workflows are typically based on the analysis of team videos. Also, analysts can rely on techniques from Information Visualization, to depict e.g., player or ball trajectories. However, video analysis is typically a time-consuming process, where the analyst needs to memorize and annotate scenes. In contrast, visualization typically relies on an abstract data model, often using abstract visual mappings, and is not directly linked to the observed movement context anymore. We propose a visual analytics system that tightly integrates team sport video recordings with abstract visualization of underlying trajectory data. We apply appropriate computer vision techniques to extract trajectory data from video input. Furthermore, we apply advanced trajectory and movement analysis techniques to derive relevant team sport analytic measures for region, event and player analysis in the case of soccer analysis. Our system seamlessly integrates video and visualization modalities, enabling analysts to draw on the advantages of both analysis forms. Several expert studies conducted with team sport analysts indicate the effectiveness of our integrated approach
- …