Provably scale-covariant networks from oriented quasi quadrature measures in cascade

This article presents a continuous model for hierarchical networks based on a combination of mathematically derived models of receptive fields and biologically inspired computations. Based on a functional model of complex cells in terms of an oriented quasi quadrature combination of first- and second-order directional Gaussian derivatives, we couple such primitive computations in cascade over combinatorial expansions over image orientations. Scale-space properties of the computational primitives are analysed and it is shown that the resulting representation allows for provable scale and rotation covariance. A prototype application to texture analysis is developed and it is demonstrated that a simplified mean-reduced representation of the resulting QuasiQuadNet leads to promising experimental results on three texture datasets.Comment: 12 pages, 3 figures, 1 tabl

When Face Recognition Meets with Deep Learning: an Evaluation of Convolutional Neural Networks for Face Recognition

Deep learning, in particular Convolutional Neural Network (CNN), has achieved promising results in face recognition recently. However, it remains an open question: why CNNs work well and how to design a 'good' architecture. The existing works tend to focus on reporting CNN architectures that work well for face recognition rather than investigate the reason. In this work, we conduct an extensive evaluation of CNN-based face recognition systems (CNN-FRS) on a common ground to make our work easily reproducible. Specifically, we use public database LFW (Labeled Faces in the Wild) to train CNNs, unlike most existing CNNs trained on private databases. We propose three CNN architectures which are the first reported architectures trained using LFW data. This paper quantitatively compares the architectures of CNNs and evaluate the effect of different implementation choices. We identify several useful properties of CNN-FRS. For instance, the dimensionality of the learned features can be significantly reduced without adverse effect on face recognition accuracy. In addition, traditional metric learning method exploiting CNN-learned features is evaluated. Experiments show two crucial factors to good CNN-FRS performance are the fusion of multiple CNNs and metric learning. To make our work reproducible, source code and models will be made publicly available.Comment: 7 pages, 4 figures, 7 table

Colour Texture analysis

This chapter presents a novel and generic framework for image segmentation using a compound image descriptor that encompasses both colour and texture information in an adaptive fashion. The developed image segmentation method extracts the texture information using low-level image descriptors (such as the Local Binary Patterns (LBP)) and colour information by using colour space partitioning. The main advantage of this approach is the analysis of the textured images at a micro-level using the local distribution of the LBP values, and in the colour domain by analysing the local colour distribution obtained after colour segmentation. The use of the colour and texture information separately has proven to be inappropriate for natural images as they are generally heterogeneous with respect to colour and texture characteristics. Thus, the main problem is to use the colour and texture information in a joint descriptor that can adapt to the local properties of the image under analysis. We will review existing approaches to colour and texture analysis as well as illustrating how our approach can be successfully applied to a range of applications including the segmentation of natural images, medical imaging and product inspection

Automatic segmentation of skin cancer images using adaptive color clustering

This paper presents the development of an adaptive image segmentation algorithm designed for the identification of the skin cancer and pigmented lesions in dermoscopy images. The key component of the developed algorithm is the Adaptive Spatial K-Means (A-SKM) clustering technique that is applied to extract the color features from skin cancer images. Adaptive-SKM is a novel technique that includes the primary features that describe the color smoothness and texture complexity in the process of pixel assignment. The A-SKM has been included in the development of a flexible color-texture image segmentation scheme and the experimental data indicates that the developed algorithm is able to produce accurate segmentation when applied to a large number of skin cancer (melanoma) images

Unsupervised image segmentation based on the multi-resolution integration of adaptive local texture descriptions

The major aim of this paper consists of a comprehensive quantitative evaluation of adaptive texture descriptors when integrated into an unsupervised image segmentation framework. The techniques involved in this evaluation are: the standard and rotation invariant Local Binary Pattern (LBP) operators, multichannel texture decomposition based on Gabor filters and a recently proposed technique that analyses the distribution of dominant image orientations at both micro and macro levels. These selected descriptors share two essential properties: (a) they evaluate the texture information at micro-level in small neighborhoods, while (b) the distributions of the local features calculated from texture units describe the texture at macrolevel. This adaptive scenario facilitates the integration of the texture descriptors into an unsupervised clustering based segmentation scheme that embeds a multi-resolution approach. The conducted experiments evaluate the performance of these techniques and also analyze the influence of important parameters (such as scale, frequency and orientation) upon the segmentation results