f-Divergence Minimization for Sequence-Level Knowledge Distillation

Knowledge distillation (KD) is the process of transferring knowledge from a large model to a small one. It has gained increasing attention in the natural language processing community, driven by the demands of compressing ever-growing language models. In this work, we propose an f-DISTILL framework, which formulates sequence-level knowledge distillation as minimizing a generalized f-divergence function. We propose four distilling variants under our framework and show that existing SeqKD and ENGINE approaches are approximations of our f-DISTILL methods. We further derive step-wise decomposition for our f-DISTILL, reducing intractable sequence-level divergence to word-level losses that can be computed in a tractable manner. Experiments across four datasets show that our methods outperform existing KD approaches, and that our symmetric distilling losses can better force the student to learn from the teacher distribution.Comment: Accepted by ACL 202

Development Of Structural-functional Integrated Energy Storage Concrete With Innovative Macro-encapsulated PCM By Hollow Steel Ball

Phase change materials (PCMs) have great potential for applications in energy efficient buildings. In this study, an innovative method of macro-encapsulation of PCM using hollow steel balls (HSB) was developed and the thermal and mechanical performance of PCM-HSB concrete was examined. The macro-encapsulation system (PCM-HSB) was attached with a metal clamp (c) for better mechanical interlocking with the mortar matrix. The latent heat of PCM-HSB-c that can be acquired is approximately 153.1 J/g, which can be considered to rank highly among PCM composites. According to the self-designed thermal performance evaluation, the PCM–HSB-c concrete panel is capable of reducing and deferring the peak indoor temperature. The indoor temperature of the room model using PCM-HSB-c panels was significantly lower than the ones with normal concrete panels by a range of 3–6%. Furthermore, the test room using a higher PCM-HSB-c content demonstrated a greater ability to maintain a lower indoor room temperature for a longer period of time during heating cycles. In consideration of the mechanical properties, thermal performance and other aspects of cost factors, 50% and 75% PCM-HSB-c replacement levels are recommended in producing concrete

AutoEncoding Tree for City Generation and Applications

City modeling and generation have attracted an increased interest in various applications, including gaming, urban planning, and autonomous driving. Unlike previous works focused on the generation of single objects or indoor scenes, the huge volumes of spatial data in cities pose a challenge to the generative models. Furthermore, few publicly available 3D real-world city datasets also hinder the development of methods for city generation. In this paper, we first collect over 3,000,000 geo-referenced objects for the city of New York, Zurich, Tokyo, Berlin, Boston and several other large cities. Based on this dataset, we propose AETree, a tree-structured auto-encoder neural network, for city generation. Specifically, we first propose a novel Spatial-Geometric Distance (SGD) metric to measure the similarity between building layouts and then construct a binary tree over the raw geometric data of building based on the SGD metric. Next, we present a tree-structured network whose encoder learns to extract and merge spatial information from bottom-up iteratively. The resulting global representation is reversely decoded for reconstruction or generation. To address the issue of long-dependency as the level of the tree increases, a Long Short-Term Memory (LSTM) Cell is employed as a basic network element of the proposed AETree. Moreover, we introduce a novel metric, Overlapping Area Ratio (OAR), to quantitatively evaluate the generation results. Experiments on the collected dataset demonstrate the effectiveness of the proposed model on 2D and 3D city generation. Furthermore, the latent features learned by AETree can serve downstream urban planning applications

Impaired Osteoblast Function in GPRC6A Null Mice

GPRC6A is a widely expressed orphan G protein–coupled receptor that senses extracellular amino acids, osteocalcin, and divalent cations in vitro. GPRC6A null (GPRC6A−/−) mice exhibit multiple metabolic abnormalities including osteopenia. To investigate whether the osseous abnormalities are a direct function of GPRC6A in osteoblasts, we examined the function of primary osteoblasts and bone marrow stromal cell cultures (BMSCs) in GPRC6A−/− mice. We confirmed that GPRC6A−/− mice exhibited a decrease in bone mineral density (BMD) associated with reduced expression of osteocalcin, ALP, osteoprotegerin, and Runx2-II transcripts in bone. Osteoblasts and BMSCs derived from GPRC6A−/− mice exhibited an attenuated response to extracellular calcium-stimulated extracellular signal-related kinase (ERK) activation, diminished alkaline phosphatase (ALP) expression, and impaired mineralization ex vivo. In addition, siRNA-mediated knockdown of GPRC6A in MC3T3 osteoblasts also resulted in a reduction in extracellular calcium-stimulated ERK activity. To explore the potential relevance of GPRC6A function in humans, we looked for an association between GPRC6A gene polymorphisms and BMD in a sample of 1000 unrelated American Caucasians. We found that GPRC6A gene polymorphisms were significantly associated with human spine BMD. These data indicate that GRPC6A directly participates in the regulation of osteoblast-mediated bone mineralization and may mediate the anabolic effects of extracellular amino acids, osteocalcin, and divalent cations in bone. © 2010 American Society for Bone and Mineral Research

Identifying lipid particle sub-types in live Caenorhabditis elegans with two-photon fluorescence lifetime imaging

Fat metabolism is an important modifier of aging and longevity in Caenorhabditis elegans. Given the anatomy and hermaphroditic nature of C. elegans, a major challenge is to distinguish fats that serve the energetic needs of the parent from those that are allocated to the progeny. Broadband coherent anti-Stokes Raman scattering (BCARS) microscopy has revealed that the composition and dynamics of lipid particles are heterogeneous both within and between different tissues of this organism. Using BCARS, we have previously succeeded in distinguishing lipid-rich particles that serve as energetic reservoirs of the parent from those that are destined for the progeny. While BCARS microscopy produces high-resolution images with very high information content, it is not yet a widely available platform. Here we report a new approach combining the lipophilic vital dye Nile Red and two-photon fluorescence lifetime imaging microscopy (2p-FLIM) for the in vivo discrimination of lipid particle sub-types. While it is widely accepted that Nile Red staining yields unreliable results for detecting lipid structures in live C. elegans due to strong interference of autofluorescence and non-specific staining signals, our results show that simple FLIM phasor analysis can effectively separate those signals and is capable of differentiating the non-polar lipid-dominant (lipid-storage), polar lipid-dominant (yolk lipoprotein) particles, and the intermediates that have been observed using BCARS microscopy. An advantage of this approach is that images can be acquired using common, commercially available 2p-FLIM systems within about 10% of the time required to generate a BCARS image. Our work provides a novel, broadly accessible approach for analyzing lipid-containing structures in a complex, live whole organism context

Measurement of the top quark forward-backward production asymmetry and the anomalous chromoelectric and chromomagnetic moments in pp collisions at √s = 13 TeV

Abstract The parton-level top quark (t) forward-backward asymmetry and the anomalous chromoelectric (d̂ t) and chromomagnetic (μ̂ t) moments have been measured using LHC pp collisions at a center-of-mass energy of 13 TeV, collected in the CMS detector in a data sample corresponding to an integrated luminosity of 35.9 fb−1. The linearized variable AFB(1) is used to approximate the asymmetry. Candidate t t ¯ events decaying to a muon or electron and jets in final states with low and high Lorentz boosts are selected and reconstructed using a fit of the kinematic distributions of the decay products to those expected for t t ¯ final states. The values found for the parameters are AFB(1)=0.048−0.087+0.095(stat)−0.029+0.020(syst),μ̂t=−0.024−0.009+0.013(stat)−0.011+0.016(syst), and a limit is placed on the magnitude of | d̂ t| < 0.03 at 95% confidence level. [Figure not available: see fulltext.

MUSiC : a model-unspecific search for new physics in proton-proton collisions at root s=13TeV

Results of the Model Unspecific Search in CMS (MUSiC), using proton-proton collision data recorded at the LHC at a centre-of-mass energy of 13 TeV, corresponding to an integrated luminosity of 35.9 fb(-1), are presented. The MUSiC analysis searches for anomalies that could be signatures of physics beyond the standard model. The analysis is based on the comparison of observed data with the standard model prediction, as determined from simulation, in several hundred final states and multiple kinematic distributions. Events containing at least one electron or muon are classified based on their final state topology, and an automated search algorithm surveys the observed data for deviations from the prediction. The sensitivity of the search is validated using multiple methods. No significant deviations from the predictions have been observed. For a wide range of final state topologies, agreement is found between the data and the standard model simulation. This analysis complements dedicated search analyses by significantly expanding the range of final states covered using a model independent approach with the largest data set to date to probe phase space regions beyond the reach of previous general searches.Peer reviewe

Measurement of prompt open-charm production cross sections in proton-proton collisions at root s=13 TeV

The production cross sections for prompt open-charm mesons in proton-proton collisions at a center-of-mass energy of 13TeV are reported. The measurement is performed using a data sample collected by the CMS experiment corresponding to an integrated luminosity of 29 nb(-1). The differential production cross sections of the D*(+/-), D-+/-, and D-0 ((D) over bar (0)) mesons are presented in ranges of transverse momentum and pseudorapidity 4 < p(T) < 100 GeV and vertical bar eta vertical bar < 2.1, respectively. The results are compared to several theoretical calculations and to previous measurements.Peer reviewe

Search for new particles in events with energetic jets and large missing transverse momentum in proton-proton collisions at root s=13 TeV

A search is presented for new particles produced at the LHC in proton-proton collisions at root s = 13 TeV, using events with energetic jets and large missing transverse momentum. The analysis is based on a data sample corresponding to an integrated luminosity of 101 fb(-1), collected in 2017-2018 with the CMS detector. Machine learning techniques are used to define separate categories for events with narrow jets from initial-state radiation and events with large-radius jets consistent with a hadronic decay of a W or Z boson. A statistical combination is made with an earlier search based on a data sample of 36 fb(-1), collected in 2016. No significant excess of events is observed with respect to the standard model background expectation determined from control samples in data. The results are interpreted in terms of limits on the branching fraction of an invisible decay of the Higgs boson, as well as constraints on simplified models of dark matter, on first-generation scalar leptoquarks decaying to quarks and neutrinos, and on models with large extra dimensions. Several of the new limits, specifically for spin-1 dark matter mediators, pseudoscalar mediators, colored mediators, and leptoquarks, are the most restrictive to date.Peer reviewe