Image classification by visual bag-of-words refinement and reduction

This paper presents a new framework for visual bag-of-words (BOW) refinement and reduction to overcome the drawbacks associated with the visual BOW model which has been widely used for image classification. Although very influential in the literature, the traditional visual BOW model has two distinct drawbacks. Firstly, for efficiency purposes, the visual vocabulary is commonly constructed by directly clustering the low-level visual feature vectors extracted from local keypoints, without considering the high-level semantics of images. That is, the visual BOW model still suffers from the semantic gap, and thus may lead to significant performance degradation in more challenging tasks (e.g. social image classification). Secondly, typically thousands of visual words are generated to obtain better performance on a relatively large image dataset. Due to such large vocabulary size, the subsequent image classification may take sheer amount of time. To overcome the first drawback, we develop a graph-based method for visual BOW refinement by exploiting the tags (easy to access although noisy) of social images. More notably, for efficient image classification, we further reduce the refined visual BOW model to a much smaller size through semantic spectral clustering. Extensive experimental results show the promising performance of the proposed framework for visual BOW refinement and reduction

Revisiting the Hubble sequence in the SDSS DR7 spectroscopic sample: a publicly available bayesian automated classification

We present an automated morphological classification in 4 types (E,S0,Sab,Scd) of ~700.000 galaxies from the SDSS DR7 spectroscopic sample based on support vector machines. The main new property of the classification is that we associate to each galaxy a probability of being in the four morphological classes instead of assigning a single class. The classification is therefore better adapted to nature where we expect a continuos transition between different morphological types. The algorithm is trained with a visual classification and then compared to several independent visual classifications including the Galaxy Zoo first release catalog. We find a very good correlation between the automated classification and classical visual ones. The compiled catalog is intended for use in different applications and can be downloaded at http://gepicom04.obspm.fr/sdss_morphology/Morphology_2010.html and soon from the CasJobs database.Comment: A&A in press, english corrections from language editor adde

Assessing neural tuning for object perception in schizophrenia and bipolar disorder with multivariate pattern analysis of fMRI data.

IntroductionDeficits in visual perception are well-established in schizophrenia and are linked to abnormal activity in the lateral occipital complex (LOC). Related deficits may exist in bipolar disorder. LOC contains neurons tuned to object features. It is unknown whether neural tuning in LOC or other visual areas is abnormal in patients, contributing to abnormal perception during visual tasks. This study used multivariate pattern analysis (MVPA) to investigate perceptual tuning for objects in schizophrenia and bipolar disorder.MethodsFifty schizophrenia participants, 51 bipolar disorder participants, and 47 matched healthy controls completed five functional magnetic resonance imaging (fMRI) runs of a perceptual task in which they viewed pictures of four different objects and an outdoor scene. We performed classification analyses designed to assess the distinctiveness of activity corresponding to perception of each stimulus in LOC (a functionally localized region of interest). We also performed similar classification analyses throughout the brain using a searchlight technique. We compared classification accuracy and patterns of classification errors across groups.ResultsStimulus classification accuracy was significantly above chance in all groups in LOC and throughout visual cortex. Classification errors were mostly within-category confusions (e.g., misclassifying one chair as another chair). There were no group differences in classification accuracy or patterns of confusion.ConclusionsThe results show for the first time MVPA can be used successfully to classify individual perceptual stimuli in schizophrenia and bipolar disorder. However, the results do not provide evidence of abnormal neural tuning in schizophrenia and bipolar disorder

Learning and Using Taxonomies For Fast Visual Categorization

The computational complexity of current visual categorization algorithms scales linearly at best with the number of categories. The goal of classifying simultaneously N_(cat) = 10^4 - 10^5 visual categories requires sub-linear classification costs. We explore algorithms for automatically building classification trees which have, in principle, log N_(cat) complexity. We find that a greedy algorithm that recursively splits the set of categories into the two minimally confused subsets achieves 5-20 fold speedups at a small cost in classification performance. Our approach is independent of the specific classification algorithm used. A welcome by-product of our algorithm is a very reasonable taxonomy of the Caltech-256 dataset