104,873 research outputs found
HPatches: A benchmark and evaluation of handcrafted and learned local descriptors
In this paper, we propose a novel benchmark for evaluating local image
descriptors. We demonstrate that the existing datasets and evaluation protocols
do not specify unambiguously all aspects of evaluation, leading to ambiguities
and inconsistencies in results reported in the literature. Furthermore, these
datasets are nearly saturated due to the recent improvements in local
descriptors obtained by learning them from large annotated datasets. Therefore,
we introduce a new large dataset suitable for training and testing modern
descriptors, together with strictly defined evaluation protocols in several
tasks such as matching, retrieval and classification. This allows for more
realistic, and thus more reliable comparisons in different application
scenarios. We evaluate the performance of several state-of-the-art descriptors
and analyse their properties. We show that a simple normalisation of
traditional hand-crafted descriptors can boost their performance to the level
of deep learning based descriptors within a realistic benchmarks evaluation
An evaluation of recent local image descriptors for real-world applications of image matching
This paper discusses and compares the best and most recent local descriptors, evaluating them on increasingly complex image matching tasks, encompassing planar and non-planar scenarios under severe viewpoint changes. This evaluation, aimed at assessing descriptor suitability for real-world applications, leverages the concept of approximated overlap error as a means to naturally extend to non-planar scenes the standard metric used for planar scenes. According to the evaluation results, most descriptors exhibit a gradual performance degradation in the transition from planar to non-planar scenes. The best descriptors are those capable of capturing well not only the local image context, but also the global scene structure. Data-driven approaches are shown to have reached the matching robustness and accuracy of the best hand-crafted descriptor
Local 2D Pattern Spectra as Connected Region Descriptors
International audienceWe validate the usage of augmented 2D shape-size pattern spectra, calculated on arbitrary connected regions. The evaluation is performed on MSER regions and competitive performance with SIFT descriptors achieved in a simple retrieval system, by combining the local pattern spectra with normalized central moments. An additional advantage of the proposed descriptors is their size: being half the size of SIFT, they can handle larger databases in a time-efficient manner. We focus in this paper on presenting the challenges faced when transitioning from global pattern spectra to the local ones. An exhaustive study on the parameters and the properties of the newly constructed descriptor is the main contribution offered. We also consider possible improvements to the quality and computation efficiency of the proposed local descriptors
Unsupervised image segmentation based on the multi-resolution integration of adaptive local texture descriptions
The major aim of this paper consists of a comprehensive quantitative evaluation of adaptive texture descriptors when integrated into an unsupervised image segmentation framework. The techniques involved in this evaluation are: the standard and rotation invariant Local Binary Pattern (LBP) operators, multichannel texture decomposition based on Gabor filters and a recently proposed technique that analyses the distribution of dominant image orientations at both micro and macro levels. These selected descriptors share two essential properties: (a) they evaluate the texture information at micro-level in small neighborhoods, while (b) the distributions of the local features calculated from texture units describe the texture at macrolevel. This adaptive scenario facilitates the integration of the texture descriptors into an unsupervised clustering based segmentation scheme that embeds a multi-resolution approach. The conducted experiments evaluate the performance of these techniques and also analyze the influence of important parameters (such as scale, frequency and orientation) upon the segmentation results
- âŠ