Prototypical Fine-tuning: Towards Robust Performance Under Varying Data Sizes

In this paper, we move towards combining large parametric models with non-parametric prototypical networks. We propose prototypical fine-tuning, a novel prototypical framework for fine-tuning pretrained language models (LM), which automatically learns a bias to improve predictive performance for varying data sizes, especially low-resource settings. Our prototypical fine-tuning approach can automatically adjust the model capacity according to the number of data points and the model's inherent attributes. Moreover, we propose four principles for effective prototype fine-tuning towards the optimal solution. Experimental results across various datasets show that our work achieves significant performance improvements under various low-resource settings, as well as comparable and usually better performances in high-resource scenarios.Comment: Published as a conference paper at AAAI 202

GOATS: Goal Sampling Adaptation for Scooping with Curriculum Reinforcement Learning

In this work, we first formulate the problem of robotic water scooping using goal-conditioned reinforcement learning. This task is particularly challenging due to the complex dynamics of fluids and the need to achieve multi-modal goals. The policy is required to successfully reach both position goals and water amount goals, which leads to a large convoluted goal state space. To overcome these challenges, we introduce Goal Sampling Adaptation for Scooping (GOATS), a curriculum reinforcement learning method that can learn an effective and generalizable policy for robot scooping tasks. Specifically, we use a goal-factorized reward formulation and interpolate position goal distributions and amount goal distributions to create curriculum throughout the learning process. As a result, our proposed method can outperform the baselines in simulation and achieves 5.46% and 8.71% amount errors on bowl scooping and bucket scooping tasks, respectively, under 1000 variations of initial water states in the tank and a large goal state space. Besides being effective in simulation environments, our method can efficiently adapt to noisy real-robot water-scooping scenarios with diverse physical configurations and unseen settings, demonstrating superior efficacy and generalizability. The videos of this work are available on our project page: https://sites.google.com/view/goatscooping

A High-Kinetics Sulfur Cathode with a Highly Efficient Mechanism for Superior Room-Temperature Na-S Batteries

2020 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim Applications of room-temperature-sodium sulfur (RT-Na/S) batteries are currently impeded by the insulating nature of sulfur, the slow redox kinetics of sulfur with sodium, and the dissolution and migration of sodium polysulfides. Herein, a novel micrometer-sized hierarchical S cathode supported by FeS2 electrocatalyst, which is grown in situ in well-confined carbon nanocage assemblies, is presented. The hierarchical carbon matrix can provide multiple physical entrapment to polysulfides, and the FeS2 nanograins exhibit a low Na-ion diffusion barrier, strong binding energy, and high affinity for sodium polysulfides. Their combination makes it an ideal sulfur host to immobilize the polysulfides and achieve reversible conversion of polysulfides toward Na2S. Importantly, the hierarchical S cathode is suitable for large-scale production via the inexpensive and green spray-drying method. The porous hierarchical S cathode offers a high sulfur content of 65.5 wt%, and can deliver high reversible capacity (524 mAh g−1 over 300 cycles at 0.1 A g−1) and outstanding rate capability (395 mAh g−1 at 1 A g−1 for 850 cycles), holding great promise for both scientific research and real application

Breastmilk microbiome changes associated with lactational mastitis and treatment with dandelion extract

IntroductionDandelion (Pugongying) is one of the most frequently used Chinese herbs for treating lactational mastitis (LM). Pugongying granules, a patented medication primarily comprised of dandelion extract, have been approved by CFDA for LM treatment in China. The aims of this study were to investigate the etiology of LM and the mechanism by which Pugongying granules decrease LM symptoms, with a particular focus on the microbial communities found in breastmilk.MethodsParticipants were recruited from a previously performed randomized controlled trial (Identifier: NCT03756324, ClinicalTrials.gov). Between 2019 and 2020, women diagnosed with unilateral LM at the Beijing University of Chinese Medicine Third Affiliated Hospital were enrolled. In total, 42 paired breastmilk samples from the healthy and affected breasts of the participants were collected. Additionally, 37 paired pre- and post-treatment breastmilk samples from the affected breast were collected from women who received a 3-day course of either Pugongying granules (20 women) or cefdinir (17 women). Clinical outcomes [e.g., body temperature, visual analogue scale (VAS) score for breast pain, the percentage of neutrophils (NE%)] were analyzed pre- and post-treatment, and the breastmilk samples were subjected to 16S rRNA gene sequencing to analyze the alpha and beta diversities and identify significant bacteria. Finally, the relationship between microorganisms and clinical outcomes was analyzed.ResultsThere was no significant difference in fever and pain between the Pugongying group and cefdinir group. The most prevalent bacterial genera in breastmilk were Streptococcus and Staphylococcus. Compared to healthy breastmilk, microbial diversity was reduced in affected breastmilk, and there was a higher relative abundance of Streptococcus. After Pugongying treatment, there was an increase in microbial diversity with significantly higher abundance of Corynebacterium. A negative correlation was found between Corynebacterium, VAS score, and NE%. Treatment with cefdinir did not affect microbial diversity. Taken together, our results show a correlation between LM and reduced microbial diversity, as well as an increased abundance of Streptococcus in affected breastmilk.ConclusionPugongying granules enhanced microbial diversity in breastmilk samples. Given the substantial variation in individual microbiomes, identifying specific species of Streptococcus and Corynebacterium associated with LM may provide additional insight into LM pathogenesis and treatment

Short- and long-term effects of manganese, zinc and copper ions on nitrogen removal in nitritation-anammox process

This study provided a deep insight into the impacts of trace elements (Mn2+, Zn2+ and Cu2+) on nitritation-anammox process. For short-term exposure, all the three elements could improve the nitrogen removal rate (NRR) and the optimal concentrations were 2.0 mg/L, 2.0 mg/L and 0.5 mg/L for Mn2+, Zn2+ and Cu2+, respectively. Accordingly, the NRR were enhanced 54.62%, 45.93% and 44.09%. The long-term experiments were carried out in lab-scale sequencing batch reactors. The surprising results showed that only Mn2+ addition could enhance the long-term nitritation-anammox process, and the NRR increased from 0.35 ± 0.01 kg N/m3/d (control, no extra trace element addition) to 0.49 ± 0.03 kg N/m3/d. Vice versa, the amendment of Zn2+ reduced the NRR to 0.28 ± 0.02 kg N/m3/d, and Cu2+ had no significant effect on the NRR (0.36 ± 0.01 kg N/m3/d). From the analysis of microbial community structure, it was explained by the increasing abundance of anaerobic ammonium oxidizing bacteria (AnAOB) only in Mn2+ treatment, whereas Zn2+ predominantly promoted ammonium oxidizing bacteria (AOB). Additionally, the majority of Mn2+ was identified inside AnAOB cells, and Zn2+ and Cu2+ were mainly located in AOB. Our results indicated the synergistic effects of trace elements on nitritation-anammox, both short-term encouraging activities of AnAOB and long-term altering microbial community structure. This work implies the importance of trace elements addition in nitritation-anammox process

A Facile Strategy for Immobilizing GOD and HRP onto Pollen Grain and Its Application to Visual Detection of Glucose

Pollen grain was explored as a new carrier for enzyme immobilization. After being modified with boric acid-functionalized titania, the pollen grain was able to covalently immobilize glycosylated enzymes by boronate affinity interaction under very mild experimental conditions (e.g., pH 7.0, ambient temperature and free of organic solvent). The glucose oxidase and horse radish peroxidase-immobilized pollen grain became a bienzyme system. The pollen grain also worked as an indicator of the cascade reaction by changing its color. A rapid, simple and cost-effective approach for the visual detection of glucose was then developed. When the glucose concentration exceeded 0.5 mM, the color change was observable by the naked eye. The assay of glucose in body fluid samples exhibited its great potential for practical application

Analysis on the Force and Life of Gearbox in Double-Rotor Wind Turbine

In order to study the force and life of the key components in the gearbox of an existing double-rotor wind turbine, the design and structural parameters of the gearbox in the traditional National Renewable Energy Laboratory (NREL) 5 MW single-rotor wind turbine are adopted, and the fixed ring gear of the first planetary stage transmission is released to form a differential gearbox suitable for a double-rotor wind turbine with two inputs. The double input is used to connect the double rotor. Subsequently, the characteristics of the gearbox in a double-rotor wind turbine are discussed. On the basis of the constant rated power of the whole wind turbine, the total power is divided into two parts, which are allocated to the double rotors, then two rotational speeds of the two inputs are given according to different power ratios by complying with the matching principle of force and moment. Furthermore, the force acting on the pitch circle of the planet gear, as well as the force and life of the planet bearing of the two-stage planetary transmission are calculated and compared with a single-rotor wind turbine. The results show that the structural advantages of a double-rotor wind turbine can reduce the stress of key components of the gearbox and increase the life span of the planet bearing, thereby the life of the whole gearbox is improved and the downtime of the whole wind turbine is reduced

Spin dynamics characteristics of nitrogen vacancy spins in diamond films using enhanced Raman shift with spin microscopy

The diamond films were deposited on a Si substrate with chemical vapor deposition MCVD using methane-hydrogen gas. Raman active phonon and sp2/sp3 ratio in diamond/Si(100) films were investigated by Raman spectra in the difference scattering configurations. Furthermore, the Raman scattering spectrum of diamond/Si(100) hetero-junction was measured with different thickness to investigate the spin dynamics of nitrogen vacancy spins. The Fluorescence scanning microscopy indicated that nitrogen vacancy center electron spin was coupled to the host nitrogen nuclear spin by the electron spin resonance. The strong peak of 1332 cm−1 displayed the F2g symmetry of diamond, while the broad E2g mode peak of 1550 cm−1 was a broad band G mode, and 1150 cm−1 peak corresponded to the nano-diamond and disordered graphitic carbon form with disordered SP2 hybridization. The Raman spectra of the diamond films were observed as a function of the residual stress, crystal size and their orientation. The peaks of 1132 cm−1 and 1480 cm−1 were associated with hydrogen bonding. The transport of diamond exhibited sp3 spin related effect. The diamond/Si(100) PDOS is the results of spin-related couple of sp3, p and d orbital hybridization. The spin dynamics was achieved by the orbital competition, strong crystal field and charge order. Keyword: Diamond films, Dynamics of nitrogen vacancy, Spin-orbit dynamics, Raman shift, Spin microscop

Comprehensive evaluation of carbon sequestration potential of landscape tree species and its influencing factors analysis: implications for urban green space management

Abstract Background Continuous increasing carbon dioxide (CO2) has aggravated global warming and promoted urban tree planting projects for many countries. So it’s imperative to select high carbon sequestering landscape tree species while considering their aesthetic values of urban green space. Results 32 tree species were selected as test objects which were commonly used in landscaping in Zhengzhou, a typical northern city of China. To assess the comprehensive carbon sequestration potential of landscape tree species in different plant configuration types, we simultaneously considered their daily net carbon sequestration per unit leaf area (wCO 2 ), daily net carbon sequestration per unit land area (WCO 2 ) and daily net carbon sequestration of the whole plant (QCO 2 ) through cluster analysis. Besides that, we found out the key factors affecting carbon sequestration potential of landscape tree species by redundancy analysis. Conclusion Populus, P Stenoptera, P. acerifolia among large arbors (LA), V odoratissimum, P. Serratifolia, S. oblata among small arbors (SA), and B sinica var. Parvifolia, B. Megistophylla, L quihoui among shrubs (S) were recommended for local urban green space management. Photosynthetic rate (Pn), crown area (CA) and leaf area index (LAI) were the key factors which affected the comprehensive carbon sequestration potential both for LA, SA and S