'Part'ly first among equals: Semantic part-based benchmarking for state-of-the-art object recognition systems

An examination of object recognition challenge leaderboards (ILSVRC, PASCAL-VOC) reveals that the top-performing classifiers typically exhibit small differences amongst themselves in terms of error rate/mAP. To better differentiate the top performers, additional criteria are required. Moreover, the (test) images, on which the performance scores are based, predominantly contain fully visible objects. Therefore, `harder' test images, mimicking the challenging conditions (e.g. occlusion) in which humans routinely recognize objects, need to be utilized for benchmarking. To address the concerns mentioned above, we make two contributions. First, we systematically vary the level of local object-part content, global detail and spatial context in images from PASCAL VOC 2010 to create a new benchmarking dataset dubbed PPSS-12. Second, we propose an object-part based benchmarking procedure which quantifies classifiers' robustness to a range of visibility and contextual settings. The benchmarking procedure relies on a semantic similarity measure that naturally addresses potential semantic granularity differences between the category labels in training and test datasets, thus eliminating manual mapping. We use our procedure on the PPSS-12 dataset to benchmark top-performing classifiers trained on the ILSVRC-2012 dataset. Our results show that the proposed benchmarking procedure enables additional differentiation among state-of-the-art object classifiers in terms of their ability to handle missing content and insufficient object detail. Given this capability for additional differentiation, our approach can potentially supplement existing benchmarking procedures used in object recognition challenge leaderboards.Comment: Extended version of our ACCV-2016 paper. Author formatting modifie

Distinguishing Posed and Spontaneous Smiles by Facial Dynamics

Smile is one of the key elements in identifying emotions and present state of mind of an individual. In this work, we propose a cluster of approaches to classify posed and spontaneous smiles using deep convolutional neural network (CNN) face features, local phase quantization (LPQ), dense optical flow and histogram of gradient (HOG). Eulerian Video Magnification (EVM) is used for micro-expression smile amplification along with three normalization procedures for distinguishing posed and spontaneous smiles. Although the deep CNN face model is trained with large number of face images, HOG features outperforms this model for overall face smile classification task. Using EVM to amplify micro-expressions did not have a significant impact on classification accuracy, while the normalizing facial features improved classification accuracy. Unlike many manual or semi-automatic methodologies, our approach aims to automatically classify all smiles into either `spontaneous' or `posed' categories, by using support vector machines (SVM). Experimental results on large UvA-NEMO smile database show promising results as compared to other relevant methods.Comment: 16 pages, 8 figures, ACCV 2016, Second Workshop on Spontaneous Facial Behavior Analysi

Heterologous expression screens in Nicotiana benthamiana identify a candidate effector of the wheat Yellow Rust Pathogen that associates with processing bodies

Rust fungal pathogens of wheat (Triticum spp.) affect crop yields worldwide. The molecular mechanisms underlying the virulence of these pathogens remain elusive, due to the limited availability of suitable molecular genetic research tools. Notably, the inability to perform high-throughput analyses of candidate virulence proteins (also known as effectors) impairs progress. We previously established a pipeline for the fast-forward screens of rust fungal candidate effectors in the model plant Nicotiana benthamiana. This pipeline involves selecting candidate effectors in silico and performing cell biology and protein-protein interaction assays in planta to gain insight into the putative functions of candidate effectors. In this study, we used this pipeline to identify and characterize sixteen candidate effectors from the wheat yellow rust fungal pathogen Puccinia striiformis f sp tritici. Nine candidate effectors targeted a specific plant subcellular compartment or protein complex, providing valuable information on their putative functions in plant cells. One candidate effector, PST02549, accumulated in processing bodies (P-bodies), protein complexes involved in mRNA decapping, degradation, and storage. PST02549 also associates with the P-body-resident ENHANCER OF mRNA DECAPPING PROTEIN 4 (EDC4) from N. benthamiana and wheat. We propose that P-bodies are a novel plant cell compartment targeted by pathogen effectors

The effect of S-substitution at the O6-guanine site on the structure and dynamics of a DNA oligomer containing a G:T mismatch

The effect of S-substitution on the O6 guanine site of a 13-mer DNA duplex containing a G:T mismatch is studied using molecular dynamics. The structure, dynamic evolution and hydration of the S-substituted duplex are compared with those of a normal duplex, a duplex with Ssubstitution on guanine, but no mismatch and a duplex with just a G:T mismatch. The S-substituted mismatch leads to cell death rather than repair. One suggestion is that the G:T mismatch recognition protein recognises the S-substituted mismatch (GS:T) as G:T. This leads to a cycle of futile repair ending in DNA breakage and cell death. We find that some structural features of the helix are similar for the duplex with the G:T mismatch and that with the S-substituted mismatch, but differ from the normal duplex, notably the helical twist. These differences arise from the change in the hydrogen-bonding pattern of the base pair. However a marked feature of the S-substituted G:T mismatch duplex is a very large opening. This showed considerable variability. It is suggested that this enlarged opening would lend support to an alternative model of cell death in which the mismatch protein attaches to thioguanine and activates downstream damage-response pathways. Attack on the sulphur by reactive oxygen species, also leading to cell death, would also be aided by the large, variable opening

Actuation of Micro-Optomechanical Systems Via Cavity-Enhanced Optical Dipole Forces

We demonstrate a new type of optomechanical system employing a movable, micron-scale waveguide evanescently-coupled to a high-Q optical microresonator. Micron-scale displacements of the waveguide are observed for milliwatt(mW)-level optical input powers. Measurement of the spatial variation of the force on the waveguide indicates that it arises from a cavity-enhanced optical dipole force due to the stored optical field of the resonator. This force is used to realize an all-optical tunable filter operating with sub-mW control power. A theoretical model of the system shows the maximum achievable force to be independent of the intrinsic Q of the optical resonator and to scale inversely with the cavity mode volume, suggesting that such forces may become even more effective as devices approach the nanoscale.Comment: 4 pages, 5 figures. High resolution version available at (http://copilot.caltech.edu/publications/CEODF_hires.pdf). For associated movie, see (http://copilot.caltech.edu/research/optical_forces/index.htm

Free-hand sketch synthesis with deformable stroke models

We present a generative model which can automatically summarize the stroke composition of free-hand sketches of a given category. When our model is fit to a collection of sketches with similar poses, it discovers and learns the structure and appearance of a set of coherent parts, with each part represented by a group of strokes. It represents both consistent (topology) as well as diverse aspects (structure and appearance variations) of each sketch category. Key to the success of our model are important insights learned from a comprehensive study performed on human stroke data. By fitting this model to images, we are able to synthesize visually similar and pleasant free-hand sketches

A study of observation scales based on Felzenswalb-Huttenlocher dissimilarity measure for hierarchical segmentation

International audienceHierarchical image segmentation provides a region-oriented scale-space, i.e., a set of image segmentations at different detail levels in which the segmentations at finer levels are nested with respect to those at coarser levels. Guimarães et al. proposed a hierarchical graph based image segmentation (HGB) method based on the Felzenszwalb-Huttenlocher dissimilarity. This HGB method computes, for each edge of a graph, the minimum scale in a hierarchy at which two regions linked by this edge should merge according to the dissimilarity. In order to generalize this method, we first propose an algorithm to compute the intervals which contain all the observation scales at which the associated regions should merge. Then, following the current trend in mathematical morphology to study criteria which are not increasing on a hierarchy, we present various strategies to select a significant observation scale in these intervals. We use the BSDS dataset to assess our observation scale selection methods. The experiments show that some of these strategies lead to better segmentation results than the ones obtained with the original HGB method

Hierarchical information clustering by means of topologically embedded graphs

We introduce a graph-theoretic approach to extract clusters and hierarchies in complex data-sets in an unsupervised and deterministic manner, without the use of any prior information. This is achieved by building topologically embedded networks containing the subset of most significant links and analyzing the network structure. For a planar embedding, this method provides both the intra-cluster hierarchy, which describes the way clusters are composed, and the inter-cluster hierarchy which describes how clusters gather together. We discuss performance, robustness and reliability of this method by first investigating several artificial data-sets, finding that it can outperform significantly other established approaches. Then we show that our method can successfully differentiate meaningful clusters and hierarchies in a variety of real data-sets. In particular, we find that the application to gene expression patterns of lymphoma samples uncovers biologically significant groups of genes which play key-roles in diagnosis, prognosis and treatment of some of the most relevant human lymphoid malignancies.Comment: 33 Pages, 18 Figures, 5 Table

Inactivation of Poxviruses by Upper-Room UVC Light in a Simulated Hospital Room Environment

In the event of a smallpox outbreak due to bioterrorism, delays in vaccination programs may lead to significant secondary transmission. In the early phases of such an outbreak, transmission of smallpox will take place especially in locations where infected persons may congregate, such as hospital emergency rooms. Air disinfection using upper-room 254 nm (UVC) light can lower the airborne concentrations of infective viruses in the lower part of the room, and thereby control the spread of airborne infections among room occupants without exposing occupants to a significant amount of UVC. Using vaccinia virus aerosols as a surrogate for smallpox we report on the effectiveness of air disinfection, via upper-room UVC light, under simulated real world conditions including the effects of convection, mechanical mixing, temperature and relative humidity. In decay experiments, upper-room UVC fixtures used with mixing by a conventional ceiling fan produced decreases in airborne virus concentrations that would require additional ventilation of more than 87 air changes per hour. Under steady state conditions the effective air changes per hour associated with upper-room UVC ranged from 18 to 1000. The surprisingly high end of the observed range resulted from the extreme susceptibility of vaccinia virus to UVC at low relative humidity and use of 4 UVC fixtures in a small room with efficient air mixing. Increasing the number of UVC fixtures or mechanical ventilation rates resulted in greater fractional reduction in virus aerosol and UVC effectiveness was higher in winter compared to summer for each scenario tested. These data demonstrate that upper-room UVC has the potential to greatly reduce exposure to susceptible viral aerosols. The greater survival at baseline and greater UVC susceptibility of vaccinia under winter conditions suggest that while risk from an aerosol attack with smallpox would be greatest in winter, protective measures using UVC may also be most efficient at this time. These data may also be relevant to influenza, which also has improved aerosol survival at low RH and somewhat similar sensitivity to UVC

Household catastrophic healthcare expenditure and impoverishment due to rotavirus gastroenteritis requiring hospitalization in Malaysia.

BACKGROUND: While healthcare costs for rotavirus gastroenteritis requiring hospitalization may be burdensome on households in Malaysia, exploration on the distribution and catastrophic impact of these expenses on households are lacking. OBJECTIVES: We assessed the economic burden, levels and distribution of catastrophic healthcare expenditure, the poverty impact on households and inequities related to healthcare payments for acute gastroenteritis requiring hospitalization in Malaysia. METHODS: A two-year prospective, hospital-based study was conducted from 2008 to 2010 in an urban (Kuala Lumpur) and rural (Kuala Terengganu) setting in Malaysia. All children under the age of 5 years admitted for acute gastroenteritis were included. Patients were screened for rotavirus and information on healthcare expenditure was obtained. RESULTS: Of the 658 stool samples collected at both centers, 248 (38%) were positive for rotavirus. Direct and indirect costs incurred were significantly higher in Kuala Lumpur compared with Kuala Terengganu (US$222 Vs. US$45; p<0.001). The mean direct and indirect costs for rotavirus gastroenteritis consisted 20% of monthly household income in Kuala Lumpur, as compared with only 5% in Kuala Terengganu. Direct medical costs paid out-of-pocket caused 141 (33%) households in Kuala Lumpur to experience catastrophic expenditure and 11 (3%) households to incur poverty. However in Kuala Terengganu, only one household (0.5%) experienced catastrophic healthcare expenditure and none were impoverished. The lowest income quintile in Kuala Lumpur was more likely to experience catastrophic payments compared to the highest quintile (87% vs 8%). The concentration index for out-of-pocket healthcare payments was closer to zero at Kuala Lumpur (0.03) than at Kuala Terengganu (0.24). CONCLUSIONS: While urban households were wealthier, healthcare expenditure due to gastroenteritis had more catastrophic and poverty impact on the urban poor. Universal rotavirus vaccination would reduce both disease burden and health inequities in Malaysia