20 research outputs found
FOLT: Fast Multiple Object Tracking from UAV-captured Videos Based on Optical Flow
Multiple object tracking (MOT) has been successfully investigated in computer
vision.
However, MOT for the videos captured by unmanned aerial vehicles (UAV) is
still challenging due to small object size, blurred object appearance, and very
large and/or irregular motion in both ground objects and UAV platforms.
In this paper, we propose FOLT to mitigate these problems and reach fast and
accurate MOT in UAV view.
Aiming at speed-accuracy trade-off, FOLT adopts a modern detector and
light-weight optical flow extractor to extract object detection features and
motion features at a minimum cost.
Given the extracted flow, the flow-guided feature augmentation is designed to
augment the object detection feature based on its optical flow, which improves
the detection of small objects.
Then the flow-guided motion prediction is also proposed to predict the
object's position in the next frame, which improves the tracking performance of
objects with very large displacements between adjacent frames.
Finally, the tracker matches the detected objects and predicted objects using
a spatially matching scheme to generate tracks for every object.
Experiments on Visdrone and UAVDT datasets show that our proposed model can
successfully track small objects with large and irregular motion and outperform
existing state-of-the-art methods in UAV-MOT tasks.Comment: Accepted by ACM Multi-Media 202
Align, Perturb and Decouple: Toward Better Leverage of Difference Information for RSI Change Detection
Change detection is a widely adopted technique in remote sense imagery (RSI)
analysis in the discovery of long-term geomorphic evolution. To highlight the
areas of semantic changes, previous effort mostly pays attention to learning
representative feature descriptors of a single image, while the difference
information is either modeled with simple difference operations or implicitly
embedded via feature interactions. Nevertheless, such difference modeling can
be noisy since it suffers from non-semantic changes and lacks explicit guidance
from image content or context. In this paper, we revisit the importance of
feature difference for change detection in RSI, and propose a series of
operations to fully exploit the difference information: Alignment, Perturbation
and Decoupling (APD). Firstly, alignment leverages contextual similarity to
compensate for the non-semantic difference in feature space. Next, a difference
module trained with semantic-wise perturbation is adopted to learn more
generalized change estimators, which reversely bootstraps feature extraction
and prediction. Finally, a decoupled dual-decoder structure is designed to
predict semantic changes in both content-aware and content-agnostic manners.
Extensive experiments are conducted on benchmarks of LEVIR-CD, WHU-CD and
DSIFN-CD, demonstrating our proposed operations bring significant improvement
and achieve competitive results under similar comparative conditions. Code is
available at https://github.com/wangsp1999/CD-Research/tree/main/openAPDComment: To appear in IJCAI 202
Multisource and Multitemporal Data Fusion in Remote Sensing
The sharp and recent increase in the availability of data captured by
different sensors combined with their considerably heterogeneous natures poses
a serious challenge for the effective and efficient processing of remotely
sensed data. Such an increase in remote sensing and ancillary datasets,
however, opens up the possibility of utilizing multimodal datasets in a joint
manner to further improve the performance of the processing approaches with
respect to the application at hand. Multisource data fusion has, therefore,
received enormous attention from researchers worldwide for a wide variety of
applications. Moreover, thanks to the revisit capability of several spaceborne
sensors, the integration of the temporal information with the spatial and/or
spectral/backscattering information of the remotely sensed data is possible and
helps to move from a representation of 2D/3D data to 4D data structures, where
the time variable adds new information as well as challenges for the
information extraction algorithms. There are a huge number of research works
dedicated to multisource and multitemporal data fusion, but the methods for the
fusion of different modalities have expanded in different paths according to
each research community. This paper brings together the advances of multisource
and multitemporal data fusion approaches with respect to different research
communities and provides a thorough and discipline-specific starting point for
researchers at different levels (i.e., students, researchers, and senior
researchers) willing to conduct novel investigations on this challenging topic
by supplying sufficient detail and references
Atypical radio pulsations from magnetar SGR 1935+2154
Magnetars are neutron stars with extremely strong magnetic fields, frequently
powering high-energy activity in X-rays. Pulsed radio emission following some
X-ray outbursts have been detected, albeit its physical origin is unclear. It
has long been speculated that the origin of magnetars' radio signals is
different from those from canonical pulsars, although convincing evidence is
still lacking. Five months after magnetar SGR 1935+2154's X-ray outburst and
its associated Fast Radio Burst (FRB) 20200428, a radio pulsar phase was
discovered. Here we report the discovery of X-ray spectral hardening associated
with the emergence of periodic radio pulsations from SGR 1935+2154 and a
detailed analysis of the properties of the radio pulses. The complex radio
pulse morphology, which contains both narrow-band emission and frequency
drifts, has not been seen before in other magnetars, but is similar to those of
repeating FRBs - even though the luminosities are many orders of magnitude
different. The observations suggest that radio emission originates from the
outer magnetosphere of the magnetar, and the surface heating due to the
bombardment of inward-going particles from the radio emission region is
responsible for the observed X-ray spectral hardening.Comment: 47 pages, 11 figure
From Web Directories to Ontologies: Natural Language Processing Challenges
Hierarchical classifications are used pervasively by humans as a means to organize their data and knowledge about the world. One of their main advantages is that natural language labels, used to describe their contents, are easily understood by human users. However, at the same time, this is also one of their main disadvantages as these same labels are ambiguous and very hard to be reasoned about by software agents. This fact creates an insuperable hindrance for classifications to being embedded in the Semantic Web infrastructure. This paper presents an approach to converting classifications into lightweight ontologies, and it makes the following contributions: (i) it identifies the main NLP problems related to the conversion process and shows how they are different from the classical problems of NLP; (ii) it proposes heuristic solutions to these problems, which are especially effective in this domain; and (iii) it evaluates the proposed solutions by testing them on DMoz data
SAFFNet: Self-Attention-Based Feature Fusion Network for Remote Sensing Few-Shot Scene Classification
In real applications, it is necessary to classify new unseen classes that cannot be acquired in training datasets. To solve this problem, few-shot learning methods are usually adopted to recognize new categories with only a few (out-of-bag) labeled samples together with the known classes available in the (large-scale) training dataset. Unlike common scene classification images obtained by CCD (Charge-Coupled Device) cameras, remote sensing scene classification datasets tend to have plentiful texture features rather than shape features. Therefore, it is important to extract more valuable texture semantic features from a limited number of labeled input images. In this paper, a multi-scale feature fusion network for few-shot remote sensing scene classification is proposed by integrating a novel self-attention feature selection module, denoted as SAFFNet. Unlike a pyramidal feature hierarchy for object detection, the informative representations of the images with different receptive fields are automatically selected and re-weighted for feature fusion after refining network and global pooling operation for a few-shot remote sensing classification task. Here, the feature weighting value can be fine-tuned by the support set in the few-shot learning task. The proposed model is evaluated on three publicly available datasets for few shot remote sensing scene classification. Experimental results demonstrate the effectiveness of the proposed SAFFNet to improve the few-shot classification accuracy significantly compared to other few-shot methods and the typical multi-scale feature fusion network
A continuation method for semi-supervised svms
Semi-Supervised Support Vector Machines (S3VMs) are an appealing method for using unlabeled data in classification: their objective function favors decision boundaries which do not cut clusters. However their main problem is that the optimization problem is non-convex and has many local minima, which often results in suboptimal performances. In this paper we propose to use a global optimization technique known as continuation to alleviate this problem. Compared to other algorithms minimizing the same objective function, our continuation method often leads to lower test errors. 1