34 research outputs found

    MotionDeltaCNN: Sparse CNN Inference of Frame Differences in Moving Camera Videos

    Full text link
    Convolutional neural network inference on video input is computationally expensive and requires high memory bandwidth. Recently, DeltaCNN managed to reduce the cost by only processing pixels with significant updates over the previous frame. However, DeltaCNN relies on static camera input. Moving cameras add new challenges in how to fuse newly unveiled image regions with already processed regions efficiently to minimize the update rate - without increasing memory overhead and without knowing the camera extrinsics of future frames. In this work, we propose MotionDeltaCNN, a sparse CNN inference framework that supports moving cameras. We introduce spherical buffers and padded convolutions to enable seamless fusion of newly unveiled regions and previously processed regions -- without increasing memory footprint. Our evaluation shows that we outperform DeltaCNN by up to 90% for moving camera videos

    Visual Estimation of Fingertip Pressure on Diverse Surfaces using Easily Captured Data

    Full text link
    People often use their hands to make contact with the world and apply pressure. Machine perception of this important human activity could be widely applied. Prior research has shown that deep models can estimate hand pressure based on a single RGB image. Yet, evaluations have been limited to controlled settings, since performance relies on training data with high-resolution pressure measurements that are difficult to obtain. We present a novel approach that enables diverse data to be captured with only an RGB camera and a cooperative participant. Our key insight is that people can be prompted to perform actions that correspond with categorical labels describing contact pressure (contact labels), and that the resulting weakly labeled data can be used to train models that perform well under varied conditions. We demonstrate the effectiveness of our approach by training on a novel dataset with 51 participants making fingertip contact with instrumented and uninstrumented objects. Our network, ContactLabelNet, dramatically outperforms prior work, performs well under diverse conditions, and matched or exceeded the performance of human annotators

    Many-worlds browsing for control of multibody dynamics

    Full text link

    Mutations in multidomain protein MEGF8 identify a Carpenter syndrome subtype associated with defective lateralization

    Get PDF
    Carpenter syndrome is an autosomal-recessive multiple-congenital-malformation disorder characterized by multisuture craniosynostosis and polysyndactyly of the hands and feet; many other clinical features occur, and the most frequent include obesity, umbilical hernia, cryptorchidism, and congenital heart disease. Mutations of RAB23, encoding a small GTPase that regulates vesicular transport, are present in the majority of cases. Here, we describe a disorder caused by mutations in multiple epidermal-growth-factor-like-domains 8 (MEGF8), which exhibits substantial clinical overlap with Carpenter syndrome but is frequently associated with abnormal left-right patterning. We describe five affected individuals with similar dysmorphic facies, and three of them had either complete situs inversus, dextrocardia, or transposition of the great arteries; similar cardiac abnormalities were previously identified in a mouse mutant for the orthologous Megf8. The mutant alleles comprise one nonsense, three missense, and two splice-site mutations; we demonstrate in zebrafish that, in contrast to the wild-type protein, the proteins containing all three missense alterations provide only weak rescue of an early gastrulation phenotype induced by Megf8 knockdown. We conclude that mutations in MEGF8 cause a Carpenter syndrome subtype frequently associated with defective left-right patterning, probably through perturbation of signaling by hedgehog and nodal family members. We did not observe any subject with biallelic loss-of function mutations, suggesting that some residual MEGF8 function might be necessary for survival and might influence the phenotypes observed

    Massively parallel fitness profiling reveals multiple novel enzymes in Pseudomonas putida lysine metabolism

    Get PDF
    P. putida lysine metabolism can produce multiple commodity chemicals, conferring great biotechnological value. Despite much research, the connection of lysine catabolism to central metabolism in P. putida remained undefined. Here, we used random barcode transposon sequencing to fill the gaps of lysine metabolism in P. putida. We describe a route of 2-oxoadipate (2OA) catabolism, which utilizes DUF1338-containing protein P. putida 5260 (PP_5260) in bacteria. Despite its prevalence in many domains of life, DUF1338-containing proteins have had no known biochemical function. We demonstrate that PP_5260 is a metalloenzyme which catalyzes an unusual route of decarboxylation of 2OA to d-2-hydroxyglutarate (d-2HG). Our screen also identified a recently described novel glutarate metabolic pathway. We validate previous results and expand the understanding of glutarate hydroxylase CsiD by showing that can it use either 2OA or 2KG as a cosubstrate. Our work demonstrated that biological novelty can be rapidly identified using unbiased experimental genetics and that RB-TnSeq can be used to rapidly validate previous results.Despite intensive study for 50 years, the biochemical and genetic links between lysine metabolism and central metabolism in Pseudomonas putida remain unresolved. To establish these biochemical links, we leveraged random barcode transposon sequencing (RB-TnSeq), a genome-wide assay measuring the fitness of thousands of genes in parallel, to identify multiple novel enzymes in both l- and d-lysine metabolism. We first describe three pathway enzymes that catabolize l-2-aminoadipate (l-2AA) to 2-ketoglutarate (2KG), connecting d-lysine to the TCA cycle. One of these enzymes, P. putida 5260 (PP_5260), contains a DUF1338 domain, representing a family with no previously described biological function. Our work also identified the recently described coenzyme A (CoA)-independent route of l-lysine degradation that results in metabolization to succinate. We expanded on previous findings by demonstrating that glutarate hydroxylase CsiD is promiscuous in its 2-oxoacid selectivity. Proteomics of selected pathway enzymes revealed that expression of catabolic genes is highly sensitive to the presence of particular pathway metabolites, implying intensive local and global regulation. This work demonstrated the utility of RB-TnSeq for discovering novel metabolic pathways in even well-studied bacteria, as well as its utility a powerful tool for validating previous research

    A História da Alimentação: balizas historiográficas

    Full text link
    Os M. pretenderam traçar um quadro da História da Alimentação, não como um novo ramo epistemológico da disciplina, mas como um campo em desenvolvimento de práticas e atividades especializadas, incluindo pesquisa, formação, publicações, associações, encontros acadêmicos, etc. Um breve relato das condições em que tal campo se assentou faz-se preceder de um panorama dos estudos de alimentação e temas correia tos, em geral, segundo cinco abardagens Ia biológica, a econômica, a social, a cultural e a filosófica!, assim como da identificação das contribuições mais relevantes da Antropologia, Arqueologia, Sociologia e Geografia. A fim de comentar a multiforme e volumosa bibliografia histórica, foi ela organizada segundo critérios morfológicos. A seguir, alguns tópicos importantes mereceram tratamento à parte: a fome, o alimento e o domínio religioso, as descobertas européias e a difusão mundial de alimentos, gosto e gastronomia. O artigo se encerra com um rápido balanço crítico da historiografia brasileira sobre o tema

    L.: Backward steps in rigid body simulation

    No full text
    Figure 1: A time-reversed rigid body simulation with 3037 rigid balls bouncing, colliding, and sliding into place that was computed in under one hour. Physically based simulation of rigid body dynamics is commonly done by time-stepping systems forward in time. In this paper, we propose methods to allow time-stepping rigid body systems backward in time. Unfortunately, reverse-time integration of rigid bodies involving frictional contact is mathematically ill-posed, and can lack unique solutions. We instead propose time-reversed rigid body integrators that can sample possible solutions when unique ones do not exist. We also discuss challenges related to dissipation-related energy gain, sensitivity to initial conditions, stacking, constraints and articulation, rolling, sliding, skidding, bouncing, high angular velocities, rapid velocity growth from micro-collisions, and other problems encountered when going against the usual flow of time

    Skinning Mesh Animations

    No full text
    We extend approaches for skinning characters to the general setting of skinning deformable mesh animations. We provide an automatic algorithm for generating progressive skinning approximations, that is particularly efficient for pseudo-articulated motions. Our contributions include the use of nonparametric mean shift clustering of high-dimensional mesh rotation sequences to automatically identify statistically relevant bones, and robust least squares methods to determine bone transformations, bone-vertex influence sets, and vertex weight values. We use a low-rank data reduction model defined in the undeformed mesh configuration to provide progressive convergence with a fixed number of bones. We show that the resulting skinned animations enable efficient hardware rendering, rest pose editing, and deformable collision detection. Finally, we present numerous examples where skins were automatically generated using a single set of parameter values
    corecore