18 research outputs found

    Teaching What You Should Teach: A Data-Based Distillation Method

    Full text link
    In real teaching scenarios, an excellent teacher always teaches what he (or she) is good at but the student is not. This gives the student the best assistance in making up for his (or her) weaknesses and becoming a good one overall. Enlightened by this, we introduce the "Teaching what you Should Teach" strategy into a knowledge distillation framework, and propose a data-based distillation method named "TST" that searches for desirable augmented samples to assist in distilling more efficiently and rationally. To be specific, we design a neural network-based data augmentation module with priori bias, which assists in finding what meets the teacher's strengths but the student's weaknesses, by learning magnitudes and probabilities to generate suitable data samples. By training the data augmentation module and the generalized distillation paradigm in turn, a student model is learned with excellent generalization ability. To verify the effectiveness of our method, we conducted extensive comparative experiments on object recognition, detection, and segmentation tasks. The results on the CIFAR-10, ImageNet-1k, MS-COCO, and Cityscapes datasets demonstrate that our method achieves state-of-the-art performance on almost all teacher-student pairs. Furthermore, we conduct visualization studies to explore what magnitudes and probabilities are needed for the distillation process.Comment: 13 pages, 4 figure

    Molecular-Scale Nanodiamond with High-Density Color Centers Fabricated from Graphite by Laser Shocking

    Get PDF
    Nanodiamonds (NDs) with nitrogen vacancy (NV) color centers have the potential for quantum information science and bioimaging due to their stable and non-classical photon emission at room temperature. Large-scale fabrication of molecular-size nanodiamonds with sufficient color centers may economically promote their application in versatile multidisciplinary fields. Here, the manufacture of molecular-size NV center-enriched nanodiamonds from graphite powder is reported. We use an ultrafast laser shocking technique to generate intense plasma, which transforms graphite to nanodiamonds under the confinement layer. Molecular dynamics simulations suggest that the high pressure of 35 GPa and the high temperature of 3,000K result in the metaphase transition of graphite to nanodiamonds within 100 ps. A high concentration of NV centers is observed at the optimal laser energy of 3.82 GW/cm2, at which point molecular-size (∼5 nm) nanodiamonds can individually host as many as 100 NV centers. Consecutive melamine annealing following ultrafast laser shocking enriches the number of NV centers >10-fold and enhances the spontaneous decay rate of the NV center by up to 5 times. Our work may enhance the feasibility of nanodiamonds for applications, including quantum information, electromagnetic sensing, bioimaging, and drug delivery

    Reticulation is a Risk Factor of Progressive Subpleural non-Fibrotic Interstitial Lung Abnormalities

    Get PDF
    Rationale: Interstitial lung abnormalities (ILAs) are being increasingly identified in clinical practice. In particular for subpleural non-fibrotic ILAs, the risk of progression over time and the risk factors for progressive behavior are still largely unknown. Objectives: To determine the age band prevalence of ILAs and the risk of radiological progression of subpleural non-fibrotic ILAs over time in a large health check-up population, and to identify how reticulation contributes to the risk of radiological progression. Methods: Based on ILAs definition by the Fleischner Society, low-dose chest CT images from community-dwelling population undergone health check-up were evaluated for ILAs. Multivariable logistic regression was used to assess the risk of radiological progression. Measurements and Main Results: Among 155,539 individuals, 3,300 (2.1%) were confirmed to have ILAs: the vast majority (81.7%) were defined as subpleural non-fibrotic ILAs. The prevalence of ILAs increased linearly with age (P for trend<0.0001). Of 454 individuals with subpleural non-fibrotic ILAs, 198 (43.6%) had radiological progression over 4 years. The presence of reticulation on initial imaging was an independent predictor of radiological progression (OR 1.9; 95%CI 1.2-3.0, P=0.0040). No difference in radiological progression was identified between subpleural non-fibrotic ILAs with extensive reticulation and subpleural fibrotic ILAs (73.0% vs. 68.8%, P=0.7626). Conclusions: The prevalence of ILAs increases linearly with age. Nearly half of subpleural non-fibrotic ILAs progress radiologically over 4 years. The presence of reticulation is a risk factor for radiological progression. Subpleural non-fibrotic ILAs with extensive reticulation are likely to be a feature of subpleural fibrotic ILAs

    A Stochastic Inexact Robust Model for Regional Energy System Management and Emission Reduction Potential Analysis—A Case Study of Zibo City, China

    No full text
    In this study, in order to improve regional energy system adjustment, a multistage stochastic inexact robust programming (MSIRP) is proposed for electric-power generation planning and structure adjustment management under uncertainty. Scenario-based inexact multistage stochastic programming and stochastic robust optimization were integrated into general programming to reflect uncertainties that were expressed as interval values and probability distributions in the objective function and constraints. An MSIRP-based energy system optimization model is proposed for electric-power structure management of Zibo City in Shandong Province, China. Three power demand scenarios associated with electric-power structure adjustment, imported electricity, and emission reduction were designed to obtain multiple decision schemes for supporting regional sustainable energy system development. The power generation schemes, imported electricity, and emissions of CO2 and air pollutants were analyzed. The results indicated that the model can effectively not only provide a more stable energy supply strategies and electric-power structure adjustment schemes, but also improve the balanced development between conventional and new clear power generation technologies under uncertainty

    Iridium-Catalyzed Aerobic α,β-Dehydrogenation of γ,δ-Unsaturated Amides and Acids: Activation of Both α- and β‑C–H bonds through an Allyl–Iridium Intermediate

    No full text
    Direct aerobic α,β-dehydrogenation of γ,δ-unsaturated amides and acids using a simple iridium/copper relay catalysis system is described. We developed a new strategy that overcomes the challenging issue associated with the low α-acidity of amides and acids. Instead of α-C–H metalation, this reaction proceeds by β-C–H activation, which results in enhanced α-acidity. Conjugated dienamides and dienoic acids were synthesized in excellent yield with this reaction, which uses a simple reaction protocol. Mechanistic experiments suggest a catalyst resting state mechanism in which both α-C–H and β-C–H cleavage is accelerated

    Mpox multi-antigen mRNA vaccine candidates by a simplified manufacturing strategy afford efficient protection against lethal orthopoxvirus challenge

    No full text
    Current unprecedented mpox outbreaks in non-endemic regions represent a global public health concern. Although two live-attenuated vaccinia virus (VACV)-based vaccines have been urgently approved for people at high risk for mpox, a safer and effective vaccine that can be available for the general public is desperately needed. By utilizing a simplified manufacturing strategy of mixing DNA plasmids before transcription, we developed two multi-antigen mRNA vaccine candidates, which encode four (M1, A29, B6, A35, termed as Rmix4) or six (M1, H3, A29, E8, B6, A35, termed as Rmix6) mpox virus antigens. We demonstrated that those mpox multi-antigen mRNA vaccine candidates elicited similar potent cross-neutralizing immune responses against VACV, and compared to Rmix4, Rmix6 elicited significantly stronger cellular immune responses. Moreover, immunization with both vaccine candidates protected mice from the lethal VACV challenge. Investigation of B-cell receptor (BCR) repertoire elicited by mpox individual antigen demonstrated that the M1 antigen efficiently induced neutralizing antibody responses, and all neutralizing antibodies among the top 20 frequent antibodies appeared to target the same conformational epitope as 7D11, revealing potential vulnerability to viral immune evasion. Our findings suggest that Rmix4 and Rmix6 from a simplified manufacturing process are promising candidates to combat mpox

    Constructing robust 3D ionomer networks in the catalyst layer to achieve stable water electrolysis for green hydrogen production

    No full text
    The widespread application of proton exchange membrane water electrolyzers (PEMWEs) is hampered by insufficient lifetime caused by degradation of the anode catalyst layer (ACL). Here, an important degradation mechanism has been identified, attributed to poor mechanical stability causing the mass transfer channels to be blocked by ionomers under operating conditions. By using liquid-phase atomic force microscopy, we directly observed that the ionomers were randomly distributed (RD) in the ACL, which occupied the mass transfer channels due to swelling, creeping, and migration properties. Interestingly, we found that alternating treatments of the ACL in different water/temperature environments resulted in forming three-dimensional ionomer networks (3D INs) in the ACL, which increased the mechanical strength of microstructures by 3 times. Benefitting from the efficient and stable mass transfer channels, the lifetime was improved by 19 times. A low degradation rate of approximately 3.0 μV/h at 80 °C and a high current density of 2.0 A/cm2 was achieved on a 50 cm2 electrolyzer. These data demonstrated a forecasted lifetime of 80 000 h, approaching the 2026 DOE lifetime target. This work emphasizes the importance of the mechanical stability of the ACL and offers a general strategy for designing and developing a durable PEMWE.</p
    corecore