Plant image retrieval using color, shape and texture features

We present a content-based image retrieval system for plant image retrieval, intended especially for the house plant identification problem. A plant image consists of a collection of overlapping leaves and possibly flowers, which makes the problem challenging.We studied the suitability of various well-known color, shape and texture features for this problem, as well as introducing some new texture matching techniques and shape features. Feature extraction is applied after segmenting the plant region from the background using the max-flow min-cut technique. Results on a database of 380 plant images belonging to 78 different types of plants show promise of the proposed new techniques and the overall system: in 55% of the queries, the correct plant image is retrieved among the top-15 results. Furthermore, the accuracy goes up to 73% when a 132-image subset of well-segmented plant images are considered

Multi-resolution texture classification based on local image orientation

The aim of this paper is to evaluate quantitatively the discriminative power of the image orientation in the texture classification process. In this regard, we have evaluated the performance of two texture classification schemes where the image orientation is extracted using the partial derivatives of the Gaussian function. Since the texture descriptors are dependent on the observation scale, in this study the main emphasis is placed on the implementation of multi-resolution texture analysis schemes. The experimental results were obtained when the analysed texture descriptors were applied to standard texture databases

Evaluation of local orientation for texture classification

The aim of this paper is to present a study where we evaluate the optimal inclusion of the texture orientation in the classification process. In this paper the orientation for each pixel in the image is extracted using the partial derivatives of the Gaussian function and the main focus of our work is centred on the evaluation of the local dominant orientation (which is calculated by combining the magnitude and local orientation) on the classification results. While the dominant orientation of the texture depends strongly on the observation scale, in this paper we propose to evaluate the macro-texture by calculating the distribution of the dominant orientations for all pixels in the image that sample the texture at micro-level. The experimental results were conducted on standard texture databases and the results indicate that the dominant orientation calculated at micro-level is an appropriate measure for texture description

Perceptual-based textures for scene labeling: a bottom-up and a top-down approach

Due to the semantic gap, the automatic interpretation of digital images is a very challenging task. Both the segmentation and classification are intricate because of the high variation of the data. Therefore, the application of appropriate features is of utter importance. This paper presents biologically inspired texture features for material classification and interpreting outdoor scenery images. Experiments show that the presented texture features obtain the best classification results for material recognition compared to other well-known texture features, with an average classification rate of 93.0%. For scene analysis, both a bottom-up and top-down strategy are employed to bridge the semantic gap. At first, images are segmented into regions based on the perceptual texture and next, a semantic label is calculated for these regions. Since this emerging interpretation is still error prone, domain knowledge is ingested to achieve a more accurate description of the depicted scene. By applying both strategies, 91.9% of the pixels from outdoor scenery images obtained a correct label

Relating visual and semantic image descriptors

This paper addresses the automatic analysis of visual content and extraction of metadata beyond pure visual descriptors. Two approaches are described: Automatic Image Annotation (AIA) and Confidence Clustering (CC). AIA attempts to automatically classify images based on two binary classifiers and is designed for the consumer electronics domain. Contrastingly, the CC approach does not attempt to assign a unique label to images but rather to organise the database based on concepts

Detecting the presence of large buildings in natural images

This paper addresses the issue of classification of lowlevel features into high-level semantic concepts for the purpose of semantic annotation of consumer photographs. We adopt a multi-scale approach that relies on edge detection to extract an edge orientation-based feature description of the image, and apply an SVM learning technique to infer the presence of a dominant building object in a general purpose collection of digital photographs. The approach exploits prior knowledge on the image context through an assumption that all input images are �outdoor�, i.e. indoor/outdoor classification (the context determination stage) has been performed. The proposed approach is validated on a diverse dataset of 1720 images and its performance compared with that of the MPEG-7 edge histogram descriptor