Ensemble of Different Approaches for a Reliable Person Re-identification System

An ensemble of approaches for reliable person re-identification is proposed in this paper. The proposed ensemble is built combining widely used person re-identification systems using different color spaces and some variants of state-of-the-art approaches that are proposed in this paper. Different descriptors are tested, and both texture and color features are extracted from the images; then the different descriptors are compared using different distance measures (e.g., the Euclidean distance, angle, and the Jeffrey distance). To improve performance, a method based on skeleton detection, extracted from the depth map, is also applied when the depth map is available. The proposed ensemble is validated on three widely used datasets (CAVIAR4REID, IAS, and VIPeR), keeping the same parameter set of each approach constant across all tests to avoid overfitting and to demonstrate that the proposed system can be considered a general-purpose person re-identification system. Our experimental results show that the proposed system offers significant improvements over baseline approaches. The source code used for the approaches tested in this paper will be available at https://www.dei.unipd.it/node/2357 and http://robotics.dei.unipd.it/reid/

Effective Image Fingerprint Extraction Based on Random Bubble Sampling

In this paper we propose an algorithm for image fingerprint extraction based on random selection of circular bubbles on the considered image. In more detail, a fingerprint vector is associated to the image, the components of which are the variances of pixel luminance values in randomly selected circular zones of the image. The positions and radius of these bubbles result from a random selection, whose parameters are user-defined. The obtained fingerprint has then been used for content-based image retrieval, using the standard euclidean distance as similarity metric between the extracted features. Experiments based on the detection of various linearly and nonlinearly distorted versions of a test image in a large database show very promising results

Indexing Techniques for Image and Video Databases: an approach based on Animate Vision Paradigm

[ITALIANO]In questo lavoro di tesi vengono presentate e discusse delle innovative tecniche di indicizzazione per database video e di immagini basate sul paradigma della “Animate Vision” (Visione Animata). Da un lato, sarà mostrato come utilizzando, quali algoritmi di analisi di una data immagine, alcuni meccanismi di visione biologica, come i movimenti saccadici e le fissazioni dell'occhio umano, sia possibile ottenere un query processing in database di immagini più efficace ed efficiente. In particolare, verranno discussi, la metodologia grazie alla quale risulta possibile generare due sequenze di fissazioni, a partire rispettivamente, da un'immagine di query I_q ed una di test I_t del data set, e, come confrontare tali sequenze al fine di determinare una possibile misura della similarità (consistenza) tra le due immagini. Contemporaneamente, verrà discusso come tale approccio unito a tecniche classiche di clustering possa essere usato per scoprire le associazioni semantiche nascoste tra immagini, in termini di categorie, che, di contro, permettono un'automatica pre-classificazione (indicizzazione) delle immagini e possono essere usate per guidare e migliorare il processo di query. Saranno presentati, infine, dei risultati preliminari e l'approccio proposto sarà confrontato con le più recenti tecniche per il recupero di immagini descritte in letteratura. Dall'altro lato, sarà mostrato come utilizzando la precedente rappresentazione “foveata” di un'immagine, risulti possibile partizionare un video in shot. Più precisamente, il metodo per il rilevamento dei cambiamenti di shot si baserà sulla computazione, in ogni istante di tempo, della misura di consistenza tra le sequenze di fissazioni generate da un osservatore ideale che guarda il video. Lo schema proposto permette l'individuazione, attraverso l'utilizzo di un'unica tecnica anziché di più metodi dedicati, sia delle transizioni brusche sia di quelle graduali. Vengono infine mostrati i risultati ottenuti su varie tipologie di video e, come questi, validano l'approccio proposto. / [INGLESE]In this dissertation some novel indexing techniques for video and image database based on “Animate Vision” Paradigm are presented and discussed. From one hand, it will be shown how, by embedding within image inspection algorithms active mechanisms of biological vision such as saccadic eye movements and fixations, a more effective query processing in image database can be achieved. In particular, it will be discussed the way to generate two fixation sequences from a query image I_q and a test image I_t of the data set, respectively, and how to compare the two sequences in order to compute a possible similarity (consistency) measure between the two images. Meanwhile, it will be shown how the approach can be used with classical clustering techniques to discover and represent the hidden semantic associations among images, in terms of categories, which, in turn, allow an automatic pre-classification (indexing), and can be used to drive and improve the query processing. Eventually, preliminary results will be presented and the proposed approach compared with the most recent techniques for image retrieval described in the literature. From the other one, it will be discussed how by taking advantage of such foveated representation of an image, it is possible to partitioning of a video into shots. More precisely, the shot-change detection method will be based on the computation, at each time instant, of the consistency measure of the fixation sequences generated by an ideal observer looking at the video. The proposed scheme aims at detecting both abrupt and gradual transitions between shots using a single technique, rather than a set of dedicated methods. Results on videos of various content types are reported and validate the proposed approach

Histogrammes spatiaux couleur optimisés pour l'indexation d'images par le contenu

- Dans cet article, nous présentons une méthode qui augmente l'efficacité et la précision des systèmes d'indexation et de recherche d'images couleur par le contenu basés sur les histogrammes spatiaux. Cette technique consiste essentiellement à extraire les informations spatiales de l'image en la divisant en plusieurs sous-images rectangulaires interférées (grille des histogrammes). La méthodologie proposée optimise, via une combinaison linéaire, le découpage horizontal et vertical de l'image pour le calcul des histogrammes spatiaux. Nous augmentons ainsi la performance de la recherche en réduisant en même temps le coût de stockage et le temps de calcul par rapport aux méthodes classiques dont le choix concernant le découpage reste arbitraire

An Information Theoretic Approach to Content Based Image Retrieval.

We propose an information theoretic approach to the representation and comparison of color features in digital images to handle various problems in the area of content-based image retrieval. The interpretation of color histograms as joint probability density functions enables the use of a wide range of concepts from information theory to be considered in the extraction of color features from images and the computation of similarity between pairs of images. The entropy of an image is a measure of the randomness of the color distribution in an image. Rather than replacing color histograms as an image representation, we demonstrate that image entropy can be used to augment color histograms for more efficient image retrieval. We propose an indexing algorithm in which image entropy is used to drastically reduce the search space for color histogram computations. Our experimental tests applied to an image database with 10,000 images suggest that the image entropy-based indexing algorithm is scalable for image retrieval of large image databases. We also proposed a new similarity measure called the maximum relative entropy measure for comparing image feature vectors that represent probability density functions. This measure is an improvement of the Kullback-Leibler number in that it is non-negative and satisfies the identity and symmetry axioms. We also propose a new usability paradigm called Query By Example Sets (QBES) that allows users, particularly novice users, the ability to express queries in terms of multiple images

Review of Person Re-identification Techniques

Person re-identification across different surveillance cameras with disjoint fields of view has become one of the most interesting and challenging subjects in the area of intelligent video surveillance. Although several methods have been developed and proposed, certain limitations and unresolved issues remain. In all of the existing re-identification approaches, feature vectors are extracted from segmented still images or video frames. Different similarity or dissimilarity measures have been applied to these vectors. Some methods have used simple constant metrics, whereas others have utilised models to obtain optimised metrics. Some have created models based on local colour or texture information, and others have built models based on the gait of people. In general, the main objective of all these approaches is to achieve a higher-accuracy rate and lowercomputational costs. This study summarises several developments in recent literature and discusses the various available methods used in person re-identification. Specifically, their advantages and disadvantages are mentioned and compared.Comment: Published 201