428 research outputs found
Energy-efficient Amortized Inference with Cascaded Deep Classifiers
Deep neural networks have been remarkable successful in various AI tasks but
often cast high computation and energy cost for energy-constrained applications
such as mobile sensing. We address this problem by proposing a novel framework
that optimizes the prediction accuracy and energy cost simultaneously, thus
enabling effective cost-accuracy trade-off at test time. In our framework, each
data instance is pushed into a cascade of deep neural networks with increasing
sizes, and a selection module is used to sequentially determine when a
sufficiently accurate classifier can be used for this data instance. The
cascade of neural networks and the selection module are jointly trained in an
end-to-end fashion by the REINFORCE algorithm to optimize a trade-off between
the computational cost and the predictive accuracy. Our method is able to
simultaneously improve the accuracy and efficiency by learning to assign easy
instances to fast yet sufficiently accurate classifiers to save computation and
energy cost, while assigning harder instances to deeper and more powerful
classifiers to ensure satisfiable accuracy. With extensive experiments on
several image classification datasets using cascaded ResNet classifiers, we
demonstrate that our method outperforms the standard well-trained ResNets in
accuracy but only requires less than 20% and 50% FLOPs cost on the CIFAR-10/100
datasets and 66% on the ImageNet dataset, respectively
FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow
Multiple object tracking (MOT) has been successfully investigated in computer
vision.
However, MOT for the videos captured by unmanned aerial vehicles (UAV) is
still challenging due to small object size, blurred object appearance, and very
large and/or irregular motion in both ground objects and UAV platforms.
In this paper, we propose FOLT to mitigate these problems and reach fast and
accurate MOT in UAV view.
Aiming at speed-accuracy trade-off, FOLT adopts a modern detector and
light-weight optical flow extractor to extract object detection features and
motion features at a minimum cost.
Given the extracted flow, the flow-guided feature augmentation is designed to
augment the object detection feature based on its optical flow, which improves
the detection of small objects.
Then the flow-guided motion prediction is also proposed to predict the
object's position in the next frame, which improves the tracking performance of
objects with very large displacements between adjacent frames.
Finally, the tracker matches the detected objects and predicted objects using
a spatially matching scheme to generate tracks for every object.
Experiments on Visdrone and UAVDT datasets show that our proposed model can
successfully track small objects with large and irregular motion and outperform
existing state-of-the-art methods in UAV-MOT tasks.Comment: Accepted by ACM Multi-Media 202
- …