Augmented Deep Learning Techniques for Robotic State Estimation

While robotic systems may have once been relegated to structured environments and automation style tasks, in recent years these boundaries have begun to erode. As robots begin to operate in largely unstructured environments, it becomes more difficult for them to effectively interpret their surroundings. As sensor technology improves, the amount of data these robots must utilize can quickly become intractable. Additional challenges include environmental noise, dynamic obstacles, and inherent sensor non-linearities. Deep learning techniques have emerged as a way to efficiently deal with these challenges. While end-to-end deep learning can be convenient, challenges such as validation and training requirements can be prohibitive to its use. In order to address these issues, we propose augmenting the power of deep learning techniques with tools such as optimization methods, physics based models, and human expertise. In this work, we present a principled framework for approaching a problem that allows a user to identify the types of augmentation methods and deep learning techniques best suited to their problem. To validate our framework, we consider three different domains: LIDAR based odometry estimation, hybrid soft robotic control, and sonar based underwater mapping. First, we investigate LIDAR based odometry estimation which can be characterized with both high data precision and availability; ideal for augmenting with optimization methods. We propose using denoising autoencoders (DAEs) to address the challenges presented by modern LIDARs. Our proposed approach is comprised of two stages: a novel pre-processing stage for robust feature identification and a scan matching stage for motion estimation. Using real-world data from the University of Michigan North Campus long-term vision and LIDAR dataset (NCLT dataset) as well as the KITTI dataset, we show that our approach generalizes across domains; is capable of reducing the per-estimate error of standard ICP methods on average by 25.5% for the translational component and 57.53% for the rotational component; and is capable of reducing the computation time of state-of-the-art ICP methods by a factor of 7.94 on average while achieving competitive performance. Next, we consider hybrid soft robotic control which has lower data precision due to real-world noise (e.g., friction and manufacturing imperfections). Here, augmenting with model based methods is more appropriate. We present a novel approach for modeling, and classifying between, the system load states introduced when constructing staged soft arm configurations. Our proposed approach is comprised of two stages: an LSTM calibration routine used to identify the current load state and a control input generation step that combines a generalized quasistatic model with the learned load model. We show our method is capable of classifying between different arm configurations at a rate greater than 95%. Additionally, our method is capable of reducing the end-effector error of quasistatic model only control to within 1 cm of our controller baseline. Finally, we examine sonar based underwater mapping. Here, data is so noisy that augmenting with human experts and incorporating some global context is required. We develop a novel framework that enables the real-time 3D reconstruction of underwater environments using features from 2D sonar images. In our approach, a convolutional neural network (CNN) analyzes sonar imagery in real-time and only proposes a small subset of high-quality frames to the human expert for feature annotation. We demonstrate that our approach provides real-time reconstruction capability without loss in classification performance on datasets captured onboard our underwater vehicle while operating in a variety of environments

Stent implantation into the tracheo-bronchial system in rabbits: histopathologic sequelae in bare metal vs. drug-eluting stents

BACKGROUND: Stent implantation into the tracheo-bronchial system may be life-saving in selected pediatric patients with otherwise intractable stenosis of the upper airways. Following implantation, significant tissue proliferation may occur, requiring re-interventions. We sought to evaluate the effect of immunosuppressive coating of the stents on the extent of tissue proliferation in an animal model. METHODS: Bare metal and sirolimus-coated stents (Bx Sonic and Cypher Select, Johnson & Johnson, Cordis) were implanted into non-stenotic lower airways of New Zealand white rabbits (weight 3.1 to 4.8 kg). Three stents with sirolimus coating and six bare metal stents could be analyzed by means of histology and immunohistochemistry 12 months after implantation. RESULTS: On a macroscopic evaluation, all stents were partially covered with a considerable amount of whitish tissue. Histologically, these proliferations contained fiber-rich connective tissue and some fibromuscular cells without significant differences between both stent types. The superficial tissue layer was formed by typical respiratory epithelium and polygonal cells. Abundant lymphocyte infiltrations and moderate granulocyte infiltrations were found in both groups correspondingly, whereas foreign-body reaction was more pronounced around sirolimus-eluting stents. CONCLUSIONS: After stent implantation in the tracheo-bronchial system of rabbits, we found tissue reactions comparable to those seen after stent implantation into the vascular system. There was no difference between coated and uncoated stents with regard to quality and quantity of tissue proliferation. We found, however, a significantly different inflammatory reaction with a more pronounced foreign-body reaction in sirolimus-coated stents. In our small series, drug-eluting stents did not exhibit any benefit over bare metal stents in an experimental setting

American Gut: an Open Platform for Citizen Science Microbiome Research

McDonald D, Hyde E, Debelius JW, et al. American Gut: an Open Platform for Citizen Science Microbiome Research. mSystems. 2018;3(3):e00031-18

Large scale multifactorial likelihood quantitative analysis of BRCA1 and BRCA2 variants: An ENIGMA resource to support clinical variant classification

The multifactorial likelihood analysis method has demonstrated utility for quantitative assessment of variant pathogenicity for multiple cancer syndrome genes. Independent data types currently incorporated in the model for assessing BRCA1 and BRCA2 variants include clinically calibrated prior probability of pathogenicity based on variant location and bioinformatic prediction of variant effect, co-segregation, family cancer history profile, co-occurrence with a pathogenic variant in the same gene, breast tumor pathology, and case-control information. Research and clinical data for multifactorial likelihood analysis were collated for 1,395 BRCA1/2 predominantly intronic and missense variants, enabling classification based on posterior probability of pathogenicity for 734 variants: 447 variants were classified as (likely) benign, and 94 as (likely) pathogenic; and 248 classifications were new or considerably altered relative to ClinVar submissions. Classifications were compared with information not yet included in the likelihood model, and evidence strengths aligned to those recommended for ACMG/AMP classification codes. Altered mRNA splicing or function relative to known nonpathogenic variant controls were moderately to strongly predictive of variant pathogenicity. Variant absence in population datasets provided supporting evidence for variant pathogenicity. These findings have direct relevance for BRCA1 and BRCA2 variant evaluation, and justify the need for gene-specific calibration of evidence types used for variant classification

On the mechanisms governing gas penetration into a tokamak plasma during a massive gas injection

A new 1D radial fluid code, IMAGINE, is used to simulate the penetration of gas into a tokamak plasma during a massive gas injection (MGI). The main result is that the gas is in general strongly braked as it reaches the plasma, due to mechanisms related to charge exchange and (to a smaller extent) recombination. As a result, only a fraction of the gas penetrates into the plasma. Also, a shock wave is created in the gas which propagates away from the plasma, braking and compressing the incoming gas. Simulation results are quantitatively consistent, at least in terms of orders of magnitude, with experimental data for a D 2 MGI into a JET Ohmic plasma. Simulations of MGI into the background plasma surrounding a runaway electron beam show that if the background electron density is too high, the gas may not penetrate, suggesting a possible explanation for the recent results of Reux et al in JET (2015 Nucl. Fusion 55 093013)