HPatches: A benchmark and evaluation of handcrafted and learned local descriptors

In this paper, we propose a novel benchmark for evaluating local image descriptors. We demonstrate that the existing datasets and evaluation protocols do not specify unambiguously all aspects of evaluation, leading to ambiguities and inconsistencies in results reported in the literature. Furthermore, these datasets are nearly saturated due to the recent improvements in local descriptors obtained by learning them from large annotated datasets. Therefore, we introduce a new large dataset suitable for training and testing modern descriptors, together with strictly defined evaluation protocols in several tasks such as matching, retrieval and classification. This allows for more realistic, and thus more reliable comparisons in different application scenarios. We evaluate the performance of several state-of-the-art descriptors and analyse their properties. We show that a simple normalisation of traditional hand-crafted descriptors can boost their performance to the level of deep learning based descriptors within a realistic benchmarks evaluation

An evaluation of recent local image descriptors for real-world applications of image matching

This paper discusses and compares the best and most recent local descriptors, evaluating them on increasingly complex image matching tasks, encompassing planar and non-planar scenarios under severe viewpoint changes. This evaluation, aimed at assessing descriptor suitability for real-world applications, leverages the concept of approximated overlap error as a means to naturally extend to non-planar scenes the standard metric used for planar scenes. According to the evaluation results, most descriptors exhibit a gradual performance degradation in the transition from planar to non-planar scenes. The best descriptors are those capable of capturing well not only the local image context, but also the global scene structure. Data-driven approaches are shown to have reached the matching robustness and accuracy of the best hand-crafted descriptor

Local 2D Pattern Spectra as Connected Region Descriptors

International audienceWe validate the usage of augmented 2D shape-size pattern spectra, calculated on arbitrary connected regions. The evaluation is performed on MSER regions and competitive performance with SIFT descriptors achieved in a simple retrieval system, by combining the local pattern spectra with normalized central moments. An additional advantage of the proposed descriptors is their size: being half the size of SIFT, they can handle larger databases in a time-efficient manner. We focus in this paper on presenting the challenges faced when transitioning from global pattern spectra to the local ones. An exhaustive study on the parameters and the properties of the newly constructed descriptor is the main contribution offered. We also consider possible improvements to the quality and computation efficiency of the proposed local descriptors

Unsupervised image segmentation based on the multi-resolution integration of adaptive local texture descriptions

The major aim of this paper consists of a comprehensive quantitative evaluation of adaptive texture descriptors when integrated into an unsupervised image segmentation framework. The techniques involved in this evaluation are: the standard and rotation invariant Local Binary Pattern (LBP) operators, multichannel texture decomposition based on Gabor filters and a recently proposed technique that analyses the distribution of dominant image orientations at both micro and macro levels. These selected descriptors share two essential properties: (a) they evaluate the texture information at micro-level in small neighborhoods, while (b) the distributions of the local features calculated from texture units describe the texture at macrolevel. This adaptive scenario facilitates the integration of the texture descriptors into an unsupervised clustering based segmentation scheme that embeds a multi-resolution approach. The conducted experiments evaluate the performance of these techniques and also analyze the influence of important parameters (such as scale, frequency and orientation) upon the segmentation results