1,309 research outputs found

    iPose: Instance-Aware 6D Pose Estimation of Partly Occluded Objects

    Full text link
    We address the task of 6D pose estimation of known rigid objects from single input images in scenarios where the objects are partly occluded. Recent RGB-D-based methods are robust to moderate degrees of occlusion. For RGB inputs, no previous method works well for partly occluded objects. Our main contribution is to present the first deep learning-based system that estimates accurate poses for partly occluded objects from RGB-D and RGB input. We achieve this with a new instance-aware pipeline that decomposes 6D object pose estimation into a sequence of simpler steps, where each step removes specific aspects of the problem. The first step localizes all known objects in the image using an instance segmentation network, and hence eliminates surrounding clutter and occluders. The second step densely maps pixels to 3D object surface positions, so called object coordinates, using an encoder-decoder network, and hence eliminates object appearance. The third, and final, step predicts the 6D pose using geometric optimization. We demonstrate that we significantly outperform the state-of-the-art for pose estimation of partly occluded objects for both RGB and RGB-D input

    Model-based object recognition from a complex binary imagery using genetic algorithm

    Get PDF
    This paper describes a technique for model-based object recognition in a noisy and cluttered environment, by extending the work presented in an earlier study by the authors. In order to accurately model small irregularly shaped objects, the model and the image are represented by their binary edge maps, rather then approximating them with straight line segments. The problem is then formulated as that of finding the best describing match between a hypothesized object and the image. A special form of template matching is used to deal with the noisy environment, where the templates are generated on-line by a Genetic Algorithm. For experiments, two complex test images have been considered and the results when compared with standard techniques indicate the scope for further research in this direction

    Real-Time Hand Shape Classification

    Full text link
    The problem of hand shape classification is challenging since a hand is characterized by a large number of degrees of freedom. Numerous shape descriptors have been proposed and applied over the years to estimate and classify hand poses in reasonable time. In this paper we discuss our parallel framework for real-time hand shape classification applicable in real-time applications. We show how the number of gallery images influences the classification accuracy and execution time of the parallel algorithm. We present the speedup and efficiency analyses that prove the efficacy of the parallel implementation. Noteworthy, different methods can be used at each step of our parallel framework. Here, we combine the shape contexts with the appearance-based techniques to enhance the robustness of the algorithm and to increase the classification score. An extensive experimental study proves the superiority of the proposed approach over existing state-of-the-art methods.Comment: 11 page

    Probabilistic Search for Object Segmentation and Recognition

    Full text link
    The problem of searching for a model-based scene interpretation is analyzed within a probabilistic framework. Object models are formulated as generative models for range data of the scene. A new statistical criterion, the truncated object probability, is introduced to infer an optimal sequence of object hypotheses to be evaluated for their match to the data. The truncated probability is partly determined by prior knowledge of the objects and partly learned from data. Some experiments on sequence quality and object segmentation and recognition from stereo data are presented. The article recovers classic concepts from object recognition (grouping, geometric hashing, alignment) from the probabilistic perspective and adds insight into the optimal ordering of object hypotheses for evaluation. Moreover, it introduces point-relation densities, a key component of the truncated probability, as statistical models of local surface shape.Comment: 18 pages, 5 figure

    Anomalous diffusion and asymmetric tempering memory in neutrophil chemotaxis.

    Get PDF
    The motility of neutrophils and their ability to sense and to react to chemoattractants in their environment are of central importance for the innate immunity. Neutrophils are guided towards sites of inflammation following the activation of G-protein coupled chemoattractant receptors such as CXCR2 whose signaling strongly depends on the activity of Ca2+ permeable TRPC6 channels. It is the aim of this study to analyze data sets obtained in vitro (murine neutrophils) and in vivo (zebrafish neutrophils) with a stochastic mathematical model to gain deeper insight into the underlying mechanisms. The model is based on the analysis of trajectories of individual neutrophils. Bayesian data analysis, including the covariances of positions for fractional Brownian motion as well as for exponentially and power-law tempered model variants, allows the estimation of parameters and model selection. Our model-based analysis reveals that wildtype neutrophils show pure superdiffusive fractional Brownian motion. This so-called anomalous dynamics is characterized by temporal long-range correlations for the movement into the direction of the chemotactic CXCL1 gradient. Pure superdiffusion is absent vertically to this gradient. This points to an asymmetric 'memory' of the migratory machinery, which is found both in vitro and in vivo. CXCR2 blockade and TRPC6-knockout cause tempering of temporal correlations in the chemotactic gradient. This can be interpreted as a progressive loss of memory, which leads to a marked reduction of chemotaxis and search efficiency of neutrophils. In summary, our findings indicate that spatially differential regulation of anomalous dynamics appears to play a central role in guiding efficient chemotactic behavior

    Aberrant visual pathway development in albinism: from retina to cortex

    Get PDF
    Albinism refers to a group of genetic abnormalities in melanogenesis that are associated neuronal misrouting through the optic chiasm. Previous imaging studies have shown structural alterations at different points along the visual pathway of people with albinism (PWA) including foveal hypoplasia, optic nerve and chiasm size alterations and visual cortex reorganisation, but fail to provide a holistic in-vivo characterisation of the visual neurodevelopmental alterations from retina to visual cortex. We perform quantitative assessment of visual pathway structure and function in 23 PWA and 20 matched controls using optical coherence tomography (OCT), volumetric magnetic resonance imaging (MRI), diffusion tensor imaging and visual evoked potentials (VEP). PWA had a higher streamline decussation index (percentage of total tractography streamlines decussating at the chiasm) compared to controls (Z=-2.24, p=0.025), and streamline decussation index correlated weakly significantly with inter-hemispheric asymmetry measured using VEP (r=0.484, p=0.042). For PWA, a significant correlation was found between foveal development index and total number of streamlines (r=0.662, p less than 0.001). Optic nerve (p=0.001) and tract (p=0.010) width, and chiasm width (P less than 0.001), area (p=0.006) and volume (p=0.005), were significantly smaller in PWA compared to controls. Significant positive correlations were found between peri-papillary retinal nerve fibre layer thickness and optic nerve (r=0.642, p less than 0.001) and tract (r=0.663, p less than 0.001) width. Occipital pole cortical thickness was 6.88% higher (Z=-4.10, p less than 0.001) in PWA and was related to anterior visual pathway structures including foveal retinal pigment epithelium complex thickness (r=-0.579, p=0.005), optic disc (r=0.478, p=0.021) and rim areas (r=0.597, p=0.003). We were unable to demonstrate a significant relationship between OCT-derived foveal or optic nerve measures and MRI-derived chiasm size or streamline decussation index. Non-invasive imaging techniques demonstrate aberrant development throughout the visual pathways of PWA compared to controls. Our novel tractographic demonstration of altered chiasmatic decussation in PWA corresponds to VEP measured cortical asymmetry and is consistent with chiasmatic misrouting in albinism. We also demonstrate a significant relationship between retinal pigment epithelium and visual cortex thickness indicating that retinal pigmentation defects in albinism lead to downstream structural reorganisation of the visual cortex

    Shape Matching and Object Recognition

    Get PDF
    We approach recognition in the framework of deformable shape matching, relying on a new algorithm for finding correspondences between feature points. This algorithm sets up correspondence as an integer quadratic programming problem, where the cost function has terms based on similarity of corresponding geometric blur point descriptors as well as the geometric distortion between pairs of corresponding feature points. The algorithm handles outliers, and thus enables matching of exemplars to query images in the presence of occlusion and clutter. Given the correspondences, we estimate an aligning transform, typically a regularized thin plate spline, resulting in a dense correspondence between the two shapes. Object recognition is handled in a nearest neighbor framework where the distance between exemplar and query is the matching cost between corresponding points. We show results on two datasets. One is the Caltech 101 dataset (Li, Fergus and Perona), a challenging dataset with large intraclass variation. Our approach yields a 45 % correct classification rate in addition to localization. We also show results for localizing frontal and profile faces that are comparable to special purpose approaches tuned to faces

    Exploring the measurement of markedness and its relationship with other linguistic variables

    Get PDF
    Antonym pair members can be differentiated by each word's markedness-that distinction attributable to the presence or absence of features at morphological or semantic levels. Morphologically marked words incorporate their unmarked counterpart with additional morphs (e.g., "unlucky" vs. "lucky"); properties used to determine semantically marked words (e.g., "short" vs. "long") are less clearly defined. Despite extensive theoretical scrutiny, the lexical properties of markedness have received scant empirical study. The current paper employs an antonym sequencing approach to measure markedness: establishing markedness probabilities for individual words and evaluating their relationship with other lexical properties (e.g., length, frequency, valence). Regression analyses reveal that markedness probability is, as predicted, related to affixation and also strongly related to valence. Our results support the suggestion that antonym sequence is reflected in discourse, and further analysis demonstrates that markedness probabilities, derived from the antonym sequencing task, reflect the ordering of antonyms within natural language. In line with the Pollyanna Hypothesis, we argue that markedness is closely related to valence; language users demonstrate a tendency to present words evaluated positively ahead of those evaluated negatively if given the choice. Future research should consider the relationship of markedness and valence, and the influence of contextual information in determining which member of an antonym pair is marked or unmarked within discourse
    • ā€¦
    corecore