An algorithm for the contextual adaption of SURF octave selection with good matching performance: best octaves.

Speeded-Up Robust Features is a feature extraction algorithm designed for real-time execution, although this is rarely achievable on low-power hardware such as that in mobile robots. One way to reduce the computation is to discard some of the scale-space octaves, and previous research has simply discarded the higher octaves. This paper shows that this approach is not always the most sensible and presents an algorithm for choosing which octaves to discard based on the properties of the imagery. Results obtained with this best octaves algorithm show that it is able to achieve a significant reduction in computation without compromising matching performance

A contribution for single and multiple faces recognition using feature-based approaches

Among biometric recognition systems, face biometrics plays an important role in research activities and security applications since face images can be acquired without any knowledge of individuals. Nowadays a huge amount of digital images and video sequences have been acquired mainly from uncontrolled conditions, frequently including noise, blur, occlusion and variation on scale and illumination. Because of these issues, face recognition (FR) is still an active research area and becomes a complex problem and a challenging task. In this context, the motivation comes from the fact that recognition of faces in digital images with complex background and databases of face images have become one of the successful applications of Computer Vision. Hence, the main goal of this work is to recognize one or more faces from still images with multiple faces and from a database of single faces obtained under different conditions. To work with multiple face images under varying conditions, a semi-supervised approach proposed based on the invariant and discriminative power of local features. The extraction of local features is done using Speeded-Up Robust Features (SURF). The search for regions from which optimal features can be extracted is fulfilled by an improved ABC algorithm. To fully exploit the proposed approach, an extensive experimental analysis was performed. Results show that this approach is robust and efficient for face recognition applications except for faces with non-uniform illumination. In the literature, a significant number of single FR researches are based on extraction of only one feature and machine learning approaches. Besides, existing feature extraction approaches broadly use either global or local features. To obtain relevant and complementary features from face images, a face recognition methodology should consider heterogeneous features and semi-global features. Therefore, a novel hierarchical semi-supervised FR approach is proposed based on extraction of global, semi-global and local features. Global and semi-global features are extracted using Color Angles (CA) and edge histogram descriptors (EHD) meanwhile only local features are extracted using SURF. An extensive experimental analysis using the three feature extraction methods was done first individually followed by a three-stage hierarchical scheme using the face images obtained under two different lighting conditions with facial expression and slight scale variation. Furthermore, the performance of the approach was also analyzed using global, semi-global and local features combinations for CA and EHD. The proposed approach achieves high recognition rates considering all image conditions tested in this work. In addition to this, the results emphasize the influence of local and semi-global features in the recognition performance. In both, single face and multiple faces approaches, the main achievement is the high performance obtained only from the discriminative capacity of extracted features without any training schemes.Entre os sistemas de reconhecimento biométrico, a biometria da face exerce um papel importante nas atividades de pesquisa e nas aplicações de segurança, pois a face pode ser obtida sem conhecimento prévio de um indivíduo. Atualmente, uma grande quantidade de imagens digitais e seqüências de vídeo têm sido adquiridas principalmente sob condições não-controladas, freqüentemente com ruído, borramento, oclusão e variação de escala e iluminação. Por esses problemas, o reconhecimento facial (RF) é ainda considerado como uma área de pesquisa ativa e uma tarefa desafiadora. A motivação vem do fato que o reconhecimento de faces nas imagens com fundo complexo e em base de imagens faciais tem sido uma aplicação de sucesso. Portanto, o principal foco deste trabalho é reconhecer uma ou mais faces em imagens estáticas contendo diversos indivíduos e um individuo (face) em uma base de imagens com faces únicas obtidas sob condições diferentes. Para trabalhar com faces múltiplas, uma abordagem semi-supervisionada foi proposta baseada em características locais invariantes e discriminativas. A extração de características (EC) locais é feita utilizando-se do algoritmo Speeded-Up Robust Features (SURF). A busca por regiões nas quais as características ótimas podem ser extraídas é atendida através do algoritmo ABC. Os resultados obtidos mostram que esta abordagem é robusta e eficiente para aplicações de RF exceto para faces com iluminação não-uniforme. Muitos trabalhos de RF são baseados somente na extração de uma característica e nas abordagens de aprendizagem de máquina. Além disso, as abordagens existentes de EC usam características globais e/ou locais. Para obter características relevantes e complementares, a metodologia de RF deve considerar também as características de diferentes tipos e semi-globais. Portanto, a abordagem hierárquica de RF é proposta baseada na EC como globais, semi-globais e locais. As globais e semi-globais são extraídas utilizando-se de Color Angles (CA) e Edge Histogram Descriptors (EHD) enquanto somente características locais são extraídas utilizando-se do SURF. Uma ampla análise experimental foi feita utilizando os três métodos individualmente, seguido por um esquema hierárquico de três - estágios usando imagens faciais obtidas sob duas condições diferentes de iluminação com expressão facial e uma variação de escala leve. Além disso, para CA e EHD, o desempenho da abordagem foi também analisado combinando-se características globais, semi-globais e locais. A abordagem proposta alcança uma taxa de reconhecimento alta com as imagens de todas as condições testadas neste trabalho. Os resultados enfatizam a influência das características locais e semi-globais no desempenho do reconhecimento. Em ambas as abordagens, tanto nas faces únicas quanto nas faces múltiplas, a conquista principal é o alto desempenho obtido somente com a capacidade discriminativa de características sem nenhum esquema de treinamento

High Performance Video Stream Analytics System for Object Detection and Classification

Due to the recent advances in cameras, cell phones and camcorders, particularly the resolution at which they can record an image/video, large amounts of data are generated daily. This video data is often so large that manually inspecting it for object detection and classification can be time consuming and error prone, thereby it requires automated analysis to extract useful information and meta-data. The automated analysis from video streams also comes with numerous challenges such as blur content and variation in illumination conditions and poses. We investigate an automated video analytics system in this thesis which takes into account the characteristics from both shallow and deep learning domains. We propose fusion of features from spatial frequency domain to perform highly accurate blur and illumination invariant object classification using deep learning networks. We also propose the tuning of hyper-parameters associated with the deep learning network through a mathematical model. The mathematical model used to support hyper-parameter tuning improved the performance of the proposed system during training. The outcomes of various hyper-parameters on system's performance are compared. The parameters that contribute towards the most optimal performance are selected for the video object classification. The proposed video analytics system has been demonstrated to process a large number of video streams and the underlying infrastructure is able to scale based on the number and size of the video stream(s) being processed. The extensive experimentation on publicly available image and video datasets reveal that the proposed system is significantly more accurate and scalable and can be used as a general purpose video analytics system.N/

Blur robust and color constant image description

An important class of color constant image descriptors is based on image derivatives. These derivative-based image descriptors have a major drawback: they are sensitive to changes of image blur. Image blur has various causes such as being outof-focus, motion of the camera or the object, and inaccurate acquisition settings. Since image blur is a frequently occurring image degradation, it is desirable for object description to be robust to its variations. We propose a set of descriptors which are both robust with respect to blurring effects, and invariant to illuminant color changes. Experiments on retrieval tasks show that the newly proposed object descriptors outperform existing descriptors in the presence of blurring effects