529 research outputs found
Memory Based Online Learning of Deep Representations from Video Streams
We present a novel online unsupervised method for face identity learning from
video streams. The method exploits deep face descriptors together with a memory
based learning mechanism that takes advantage of the temporal coherence of
visual data. Specifically, we introduce a discriminative feature matching
solution based on Reverse Nearest Neighbour and a feature forgetting strategy
that detect redundant features and discard them appropriately while time
progresses. It is shown that the proposed learning procedure is asymptotically
stable and can be effectively used in relevant applications like multiple face
identification and tracking from unconstrained video streams. Experimental
results show that the proposed method achieves comparable results in the task
of multiple face tracking and better performance in face identification with
offline approaches exploiting future information. Code will be publicly
available.Comment: arXiv admin note: text overlap with arXiv:1708.0361
Detect or Track: Towards Cost-Effective Video Object Detection/Tracking
State-of-the-art object detectors and trackers are developing fast. Trackers
are in general more efficient than detectors but bear the risk of drifting. A
question is hence raised -- how to improve the accuracy of video object
detection/tracking by utilizing the existing detectors and trackers within a
given time budget? A baseline is frame skipping -- detecting every N-th frames
and tracking for the frames in between. This baseline, however, is suboptimal
since the detection frequency should depend on the tracking quality. To this
end, we propose a scheduler network, which determines to detect or track at a
certain frame, as a generalization of Siamese trackers. Although being
light-weight and simple in structure, the scheduler network is more effective
than the frame skipping baselines and flow-based approaches, as validated on
ImageNet VID dataset in video object detection/tracking.Comment: Accepted to AAAI 201
- …