47,072 research outputs found
Detect or Track: Towards Cost-Effective Video Object Detection/Tracking
State-of-the-art object detectors and trackers are developing fast. Trackers
are in general more efficient than detectors but bear the risk of drifting. A
question is hence raised -- how to improve the accuracy of video object
detection/tracking by utilizing the existing detectors and trackers within a
given time budget? A baseline is frame skipping -- detecting every N-th frames
and tracking for the frames in between. This baseline, however, is suboptimal
since the detection frequency should depend on the tracking quality. To this
end, we propose a scheduler network, which determines to detect or track at a
certain frame, as a generalization of Siamese trackers. Although being
light-weight and simple in structure, the scheduler network is more effective
than the frame skipping baselines and flow-based approaches, as validated on
ImageNet VID dataset in video object detection/tracking.Comment: Accepted to AAAI 201
Extraction and Classification of Diving Clips from Continuous Video Footage
Due to recent advances in technology, the recording and analysis of video
data has become an increasingly common component of athlete training
programmes. Today it is incredibly easy and affordable to set up a fixed camera
and record athletes in a wide range of sports, such as diving, gymnastics,
golf, tennis, etc. However, the manual analysis of the obtained footage is a
time-consuming task which involves isolating actions of interest and
categorizing them using domain-specific knowledge. In order to automate this
kind of task, three challenging sub-problems are often encountered: 1)
temporally cropping events/actions of interest from continuous video; 2)
tracking the object of interest; and 3) classifying the events/actions of
interest.
Most previous work has focused on solving just one of the above sub-problems
in isolation. In contrast, this paper provides a complete solution to the
overall action monitoring task in the context of a challenging real-world
exemplar. Specifically, we address the problem of diving classification. This
is a challenging problem since the person (diver) of interest typically
occupies fewer than 1% of the pixels in each frame. The model is required to
learn the temporal boundaries of a dive, even though other divers and
bystanders may be in view. Finally, the model must be sensitive to subtle
changes in body pose over a large number of frames to determine the
classification code. We provide effective solutions to each of the sub-problems
which combine to provide a highly functional solution to the task as a whole.
The techniques proposed can be easily generalized to video footage recorded
from other sports.Comment: To appear at CVsports 201
- …