Private Model Compression via Knowledge Distillation

The soaring demand for intelligent mobile applications calls for deploying powerful deep neural networks (DNNs) on mobile devices. However, the outstanding performance of DNNs notoriously relies on increasingly complex models, which in turn is associated with an increase in computational expense far surpassing mobile devices' capacity. What is worse, app service providers need to collect and utilize a large volume of users' data, which contain sensitive information, to build the sophisticated DNN models. Directly deploying these models on public mobile devices presents prohibitive privacy risk. To benefit from the on-device deep learning without the capacity and privacy concerns, we design a private model compression framework RONA. Following the knowledge distillation paradigm, we jointly use hint learning, distillation learning, and self learning to train a compact and fast neural network. The knowledge distilled from the cumbersome model is adaptively bounded and carefully perturbed to enforce differential privacy. We further propose an elegant query sample selection method to reduce the number of queries and control the privacy loss. A series of empirical evaluations as well as the implementation on an Android mobile device show that RONA can not only compress cumbersome models efficiently but also provide a strong privacy guarantee. For example, on SVHN, when a meaningful $(9.83,10^{-6})$-differential privacy is guaranteed, the compact model trained by RONA can obtain 20$\times$ compression ratio and 19$\times$ speed-up with merely 0.97% accuracy loss.Comment: Conference version accepted by AAAI'1

Quantum Transport and Field Induced Insulating States in Bilayer Graphene pnp Junctions

We perform transport measurements in high quality bilayer graphene pnp junctions with suspended top gates. At a magnetic field B=0, we demonstrate band gap opening by an applied perpendicular electric field, with an On/Off ratio up to 20,000 at 260mK. Within the band gap, the conductance decreases exponentially by 3 orders of magnitude with increasing electric field, and can be accounted for by variable range hopping with a gate-tunable density of states, effective mass, and localization length. At large B, we observe quantum Hall conductance with fractional values, which arise from equilibration of edge states between differentially-doped regions, and the presence of an insulating state at filling factor {\nu}=0. Our work underscores the importance of bilayer graphene for both fundamental interest and technological applications.Comment: 4 figures, to appear in Nano Lett. Minor typos correcte

Surface states on a topologically non-trivial semimetal: The case of Sb(110)

The electronic structure of Sb(110) is studied by angle-resolved photoemission spectroscopy and first-principle calculations, revealing several electronic surface states in the projected bulk band gaps around the Fermi energy. The dispersion of the states can be interpreted in terms of a strong spin-orbit splitting. The bulk band structure of Sb has the characteristics of a strong topological insulator with a Z2 invariant nu0=1. This puts constraints on the existence of metallic surface states and the expected topology of the surface Fermi contour. However, bulk Sb is a semimetal, not an insulator and these constraints are therefore partly relaxed. This relation of bulk topology and expected surface state dispersion for semimetals is discussed.Comment: 7 pages, 4 figure

Genetic mapping and legume synteny of aphid resistance in African cowpea (Vigna unguiculata L. Walp.) grown in California.

The cowpea aphid Aphis craccivora Koch (CPA) is a destructive insect pest of cowpea, a staple legume crop in Sub-Saharan Africa and other semiarid warm tropics and subtropics. In California, CPA causes damage on all local cultivars from early vegetative to pod development growth stages. Sources of CPA resistance are available in African cowpea germplasm. However, their utilization in breeding is limited by the lack of information on inheritance, genomic location and marker linkage associations of the resistance determinants. In the research reported here, a recombinant inbred line (RIL) population derived from a cross between a susceptible California blackeye cultivar (CB27) and a resistant African breeding line (IT97K-556-6) was genotyped with 1,536 SNP markers. The RILs and parents were phenotyped for CPA resistance using field-based screenings during two main crop seasons in a 'hotspot' location for this pest within the primary growing region of the Central Valley of California. One minor and one major quantitative trait locus (QTL) were consistently mapped on linkage groups 1 and 7, respectively, both with favorable alleles contributed from IT97K-556-6. The major QTL appeared dominant based on a validation test in a related F2 population. SNP markers flanking each QTL were positioned in physical contigs carrying genes involved in plant defense based on synteny with related legumes. These markers could be used to introgress resistance alleles from IT97K-556-6 into susceptible local blackeye varieties by backcrossing

Association Studies and Legume Synteny Reveal Haplotypes Determining Seed Size in Vigna unguiculata.

Highly specific seed market classes for cowpea and other grain legumes exist because grain is most commonly cooked and consumed whole. Size, shape, color, and texture are critical features of these market classes and breeders target development of cultivars for market acceptance. Resistance to biotic and abiotic stresses that are absent from elite breeding material are often introgressed through crosses to landraces or wild relatives. When crosses are made between parents with different grain quality characteristics, recovery of progeny with acceptable or enhanced grain quality is problematic. Thus genetic markers for grain quality traits can help in pyramiding genes needed for specific market classes. Allelic variation dictating the inheritance of seed size can be tagged and used to assist the selection of large seeded lines. In this work we applied 1,536-plex SNP genotyping and knowledge of legume synteny to characterize regions of the cowpea genome associated with seed size. These marker-trait associations will enable breeders to use marker-based selection approaches to increase the frequency of progeny with large seed. For 804 individuals derived from eight bi-parental populations, QTL analysis was used to identify markers linked to 10 trait determinants. In addition, the population structure of 171 samples from the USDA core collection was identified and incorporated into a genome-wide association study which supported more than half of the trait-associated regions important in the bi-parental populations. Seven of the total 10 QTLs were supported based on synteny to seed size associated regions identified in the related legume soybean. In addition to delivering markers linked to major trait determinants in the context of modern breeding, we provide an analysis of the diversity of the USDA core collection of cowpea to identify genepools, migrants, admixture, and duplicates

A major QTL corresponding to the Rk locus for resistance to root-knot nematodes in cowpea (Vigna unguiculata L. Walp.).

Key messageGenome resolution of a major QTL associated with the Rk locus in cowpea for resistance to root-knot nematodes has significance for plant breeding programs and R gene characterization. Cowpea (Vigna unguiculata L. Walp.) is a susceptible host of root-knot nematodes (Meloidogyne spp.) (RKN), major plant-parasitic pests in global agriculture. To date, breeding for host resistance in cowpea has relied on phenotypic selection which requires time-consuming and expensive controlled infection assays. To facilitate marker-based selection, we aimed to identify and map quantitative trait loci (QTL) conferring the resistance trait. One recombinant inbred line (RIL) and two F2:3 populations, each derived from a cross between a susceptible and a resistant parent, were genotyped with genome-wide single nucleotide polymorphism (SNP) markers. The populations were screened in the field for root-galling symptoms and/or under growth-chamber conditions for nematode reproduction levels using M. incognita and M. javanica biotypes. One major QTL was mapped consistently on linkage group VuLG11 of each population. By genotyping additional cowpea lines and near-isogenic lines derived from conventional backcrossing, we confirmed that the detected QTL co-localized with the genome region associated with the Rk locus for RKN resistance that has been used in conventional breeding for many decades. This chromosomal location defined with flanking markers will be a valuable target in marker-assisted breeding and for positional cloning of genes controlling RKN resistance