Low-Shot Learning with Imprinted Weights

Human vision is able to immediately recognize novel visual categories after seeing just one or a few training examples. We describe how to add a similar capability to ConvNet classifiers by directly setting the final layer weights from novel training examples during low-shot learning. We call this process weight imprinting as it directly sets weights for a new category based on an appropriately scaled copy of the embedding layer activations for that training example. The imprinting process provides a valuable complement to training with stochastic gradient descent, as it provides immediate good classification performance and an initialization for any further fine-tuning in the future. We show how this imprinting process is related to proxy-based embeddings. However, it differs in that only a single imprinted weight vector is learned for each novel category, rather than relying on a nearest-neighbor distance to training instances as typically used with embedding methods. Our experiments show that using averaging of imprinted weights provides better generalization than using nearest-neighbor instance embeddings.Comment: CVPR 201

Unsupervised Learning of Depth and Ego-Motion from Video

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the task of view synthesis as the supervisory signal. The networks are thus coupled via the view synthesis objective during training, but can be applied independently at test time. Empirical evaluation on the KITTI dataset demonstrates the effectiveness of our approach: 1) monocular depth performing comparably with supervised methods that use either ground-truth pose or depth for training, and 2) pose estimation performing favorably with established SLAM systems under comparable input settings.Comment: Accepted to CVPR 2017. Project webpage: https://people.eecs.berkeley.edu/~tinghuiz/projects/SfMLearner

Precursors, black holes, and a locality bound

We revisit the problem of precursors in the AdS/CFT correspondence. Identification of the precursors is expected to improve our understanding of the tension between holography and bulk locality and of the resolution of the black hole information paradox. Previous arguments that the precursors are large, undecorated Wilson loops are found to be flawed. We argue that the role of precursors should become evident when one saturates a certain locality bound. The spacetime uncertainty principle is a direct consequence of this bound.Comment: 26 pages, 8 figs; reference added, minor clarification in sec. 2; incorrect draft mistakenly used in version

Small and mighty: adaptation of superphylum Patescibacteria to groundwater environment drives their genome simplicity.

BackgroundThe newly defined superphylum Patescibacteria such as Parcubacteria (OD1) and Microgenomates (OP11) has been found to be prevalent in groundwater, sediment, lake, and other aquifer environments. Recently increasing attention has been paid to this diverse superphylum including > 20 candidate phyla (a large part of the candidate phylum radiation, CPR) because it refreshed our view of the tree of life. However, adaptive traits contributing to its prevalence are still not well known.ResultsHere, we investigated the genomic features and metabolic pathways of Patescibacteria in groundwater through genome-resolved metagenomics analysis of > 600 Gbp sequence data. We observed that, while the members of Patescibacteria have reduced genomes (~ 1 Mbp) exclusively, functions essential to growth and reproduction such as genetic information processing were retained. Surprisingly, they have sharply reduced redundant and nonessential functions, including specific metabolic activities and stress response systems. The Patescibacteria have ultra-small cells and simplified membrane structures, including flagellar assembly, transporters, and two-component systems. Despite the lack of CRISPR viral defense, the bacteria may evade predation through deletion of common membrane phage receptors and other alternative strategies, which may explain the low representation of prophage proteins in their genomes and lack of CRISPR. By establishing the linkages between bacterial features and the groundwater environmental conditions, our results provide important insights into the functions and evolution of this CPR group.ConclusionsWe found that Patescibacteria has streamlined many functions while acquiring advantages such as avoiding phage invasion, to adapt to the groundwater environment. The unique features of small genome size, ultra-small cell size, and lacking CRISPR of this large lineage are bringing new understandings on life of Bacteria. Our results provide important insights into the mechanisms for adaptation of the superphylum in the groundwater environments, and demonstrate a case where less is more, and small is mighty

The information paradox and the locality bound

Hawking's argument for information loss in black hole evaporation rests on the assumption of independent Hilbert spaces for the interior and exterior of a black hole. We argue that such independence cannot be established without incorporating strong gravitational effects that undermine locality and invalidate the use of quantum field theory in a semiclassical background geometry. These considerations should also play a role in a deeper understanding of horizon complementarity.Comment: 21 pages, harvmac; v2-3. minor corrections, references adde

Optimizing PiB-PET SUVR change-over-time measurement by a large-scale analysis of longitudinal reliability, plausibility, separability, and correlation with MMSE

AbstractQuantitative measurements of change in β-amyloid load from Positron Emission Tomography (PET) images play a critical role in clinical trials and longitudinal observational studies of Alzheimer's disease. These measurements are strongly affected by methodological differences between implementations, including choice of reference region and use of partial volume correction, but there is a lack of consensus for an optimal method. Previous works have examined some relevant variables under varying criteria, but interactions between them prevent choosing a method via combined meta-analysis. In this work, we present a thorough comparison of methods to measure change in β-amyloid over time using Pittsburgh Compound B (PiB) PET imaging.MethodsWe compare 1,024 different automated software pipeline implementations with varying methodological choices according to four quality metrics calculated over three-timepoint longitudinal trajectories of 129 subjects: reliability (straightness/variance); plausibility (lack of negative slopes); ability to predict accumulator/non-accumulator status from baseline value; and correlation between change in β-amyloid and change in Mini Mental State Exam (MMSE) scores.Results and conclusionFrom this analysis, we show that an optimal longitudinal measure of β-amyloid from PiB should use a reference region that includes a combination of voxels in the supratentorial white matter and those in the whole cerebellum, measured using two-class partial volume correction in the voxel space of each subject's corresponding anatomical MR image

British Lung Foundation/United Kingdom primary immunodeficiency network consensus statement on the definition, diagnosis, and management of granulomatous-lymphocytic interstitial lung disease in common variable immunodeficiency disorders

A proportion of people living with common variable immunodeficiency disorders develop granulomatous-lymphocytic interstitial lung disease (GLILD). We aimed to develop a consensus statement on the definition, diagnosis, and management of GLILD. All UK specialist centers were contacted and relevant physicians were invited to take part in a 3-round online Delphi process. Responses were graded as Strongly Agree, Tend to Agree, Neither Agree nor Disagree, Tend to Disagree, and Strongly Disagree, scored +1, +0.5, 0, −0.5, and −1, respectively. Agreement was defined as greater than or equal to 80% consensus. Scores are reported as mean ± SD. There was 100% agreement (score, 0.92 ± 0.19) for the following definition: “GLILD is a distinct clinico-radio-pathological ILD occurring in patients with [common variable immunodeficiency disorders], associated with a lymphocytic infiltrate and/or granuloma in the lung, and in whom other conditions have been considered and where possible excluded.” There was consensus that the workup of suspected GLILD requires chest computed tomography (CT) (0.98 ± 0.01), lung function tests (eg, gas transfer, 0.94 ± 0.17), bronchoscopy to exclude infection (0.63 ± 0.50), and lung biopsy (0.58 ± 0.40). There was no consensus on whether expectant management following optimization of immunoglobulin therapy was acceptable: 67% agreed, 25% disagreed, score 0.38 ± 0.59; 90% agreed that when treatment was required, first-line treatment should be with corticosteroids alone (score, 0.55 ± 0.51)