On Effectively Learning of Knowledge in Continual Pre-training

Pre-trained language models (PLMs) like BERT have made significant progress in various downstream NLP tasks. However, by asking models to do cloze-style tests, recent work finds that PLMs are short in acquiring knowledge from unstructured text. To understand the internal behaviour of PLMs in retrieving knowledge, we first define knowledge-baring (K-B) tokens and knowledge-free (K-F) tokens for unstructured text and ask professional annotators to label some samples manually. Then, we find that PLMs are more likely to give wrong predictions on K-B tokens and attend less attention to those tokens inside the self-attention module. Based on these observations, we develop two solutions to help the model learn more knowledge from unstructured text in a fully self-supervised manner. Experiments on knowledge-intensive tasks show the effectiveness of the proposed methods. To our best knowledge, we are the first to explore fully self-supervised learning of knowledge in continual pre-training

Histopathological Observation of Immunized Rhesus Macaques with Plague Vaccines after Subcutaneous Infection of Yersinia pestis

In our previous study, complete protection was observed in Chinese-origin rhesus macaques immunized with SV1 (20 µg F1 and 10 µg rV270) and SV2 (200 µg F1 and 100 µg rV270) subunit vaccines and with EV76 live attenuated vaccine against subcutaneous challenge with 6×106 CFU of Y. pestis. In the present study, we investigated whether the vaccines can effectively protect immunized animals from any pathologic changes using histological and immunohistochemical techniques. In addition, the glomerular basement membranes (GBMs) of the immunized animals and control animals were checked by electron microscopy. The results show no signs of histopathological lesions in the lungs, livers, kidneys, lymph nodes, spleens and hearts of the immunized animals at Day 14 after the challenge, whereas pathological alterations were seen in the corresponding tissues of the control animals. Giemsa staining, ultrastructural examination, and immunohistochemical staining revealed bacteria in some of the organs of the control animals, whereas no bacterium was observed among the immunized animals. Ultrastructural observation revealed that no glomerular immune deposits on the GBM. These observations suggest that the vaccines can effectively protect animals from any pathologic changes and eliminate Y. pestis from the immunized animals. The control animals died from multi-organ lesions specifically caused by the Y. pestis infection. We also found that subcutaneous infection of animals with Y. pestis results in bubonic plague, followed by pneumonic and septicemic plagues. The histopathologic features of plague in rhesus macaques closely resemble those of rodent and human plagues. Thus, Chinese-origin rhesus macaques serve as useful models in studying Y. pestis pathogenesis, host response and the efficacy of new medical countermeasures against plague

GmFT2a, a Soybean Homolog of FLOWERING LOCUS T, Is Involved in Flowering Transition and Maintenance

BACKGROUND: Flowering reversion can be induced in soybean (Glycine max L. Merr.), a typical short-day (SD) dicot, by switching from SD to long-day (LD) photoperiods. This process may involve florigen, putatively encoded by FLOWERING LOCUS T (FT) in Arabidopsis thaliana. However, little is known about the potential function of soybean FT homologs in flowering reversion. METHODS: A photoperiod-responsive FT homologue GmFT (renamed as GmFT2a hereafter) was cloned from the photoperiod-sensitive cultivar Zigongdongdou. GmFT2a gene expression under different photoperiods was analyzed by real-time quantitative PCR. In situ hybridization showed direct evidence for its expression during flowering-related processes. GmFT2a was shown to promote flowering using transgenic studies in Arabidopsis and soybean. The effects of photoperiod and temperature on GmFT2a expression were also analyzed in two cultivars with different photoperiod-sensitivities. RESULTS: GmFT2a expression is regulated by photoperiod. Analyses of GmFT2a transcripts revealed a strong correlation between GmFT2a expression and flowering maintenance. GmFT2a transcripts were observed continuously within the vascular tissue up to the shoot apex during flowering. By contrast, transcripts decreased to undetectable levels during flowering reversion. In grafting experiments, the early-flowering, photoperiod-insensitive stock Heihe27 promotes the appearance of GmFT2a transcripts in the shoot apex of scion Zigongdongdou under noninductive LD conditions. The photothermal effects of GmFT2a expression diversity in cultivars with different photoperiod-sensitivities and a hypothesis is proposed. CONCLUSION: GmFT2a expression is associated with flowering induction and maintenance. Therefore, GmFT2a is a potential target gene for soybean breeding, with the aim of increasing geographic adaptation of this crop

Research on the influence of driving harmonic on electromagnetic field and temperature field of permanent magnet synchronous motor

At present, the drivers with different control methods are used in most of permanent magnet synchronous motors (PMSM). A current outputted by a driver contains a large number of harmonics that will cause the PMSM torque ripple, winding heating and rotor temperature rise too large and so on. In this paper, in order to determine the influence of the current harmonics on the motor performance, different harmonic currents were injected into the motor armature. Firstly, in order to study the influence of the current harmonic on the motor magnetic field, a novel decoupling method of the motor magnetic field was proposed. On this basis, the difference of harmonic content in an air gap magnetic field was studied, and the influence of a harmonic current on the air gap flux density was obtained. Secondly, by comparing the fluctuation of the motor torque in the fundamental and different harmonic currents, the influence of harmonic on a motor torque ripple was determined. Then, the influence of different current harmonics on the eddy current loss of the motor was compared and analyzed, and the influence of the drive harmonic on the eddy current loss was obtained. Finally, by using a finite element method (FEM), the motor temperature distribution with different harmonics was obtained

HVDC auxiliary emergency power control strategy for power disturbance in two different positions of AC/DC interconnection system

High voltage direct current (HVDC) emergency control can significantly improve the transient stability of an AC/DC interconnected power grid, and is an important measure to reduce the amount of generator and load shedding when the system fails. For the AC/DC interconnected power grid, according to the location of failure, disturbances can be classified into two categories: 1) interconnected system tie-line faults, which will cause the power unbalance at both ends of the AC system, as a result of the generator rotor acceleration at the sending-end grid and the generator rotor deceleration at the receiving-end grid; 2) AC system internal faults, due to the isolation effect of the DC system, only the rotor of the generator in the disturbed area changes, which has little impact on the other end of the grid. In view of the above two different locations of disturbance, auxiliary power and frequency combination control as well as a switch strategy, are proposed in this paper. A four-machine two-area transmission system and a multi-machine AC/DC parallel transmission system were built on the PSCAD platform. The simulation results verify the effectiveness of the proposed control strategy

High Density and Uniform Plant Distribution Improve Soybean Yield by Regulating Population Uniformity and Canopy Light Interception

Optimizing the spatial distribution of plants under normal conditions of water and fertilizer is widely used by farmers to improve soybean yield. However, the relationship between soybean yield and spatial plant distribution in the field has not been well studied. This study examined the effect of planting density and plant distribution pattern on soybean plant growth, yield components, canopy light interception, and dry matter accumulation. We also analyzed the relationship between photosynthetic rate, dry matter accumulation, and yield under different planting densities and plant distribution. A two year field experiment was conducted during the 2018 and 2019 soybean planting seasons. Two planting densities (1.8 × 105 and 2.7 × 105 plants ha−1) and two plant distribution patterns (uniform and non-uniform plant spacing) were tested. Higher planting density significantly increased the canopy light interception and dry matter accumulation during soybean growth, leading to increased soybean productivity. The seed yield of soybean under higher planting density was 22.8% higher than under normal planting density. Soybean planted under uniform spacing significantly reduced the differences plant-to-plant. Uniform plant spacing significantly increased the canopy light interception and dry matter accumulation of the soybean population. In addition, the coefficient of variation of seed weight per plant between individual plants under uniform plant distribution decreased by 71.5% compared with non-uniform plant distribution. Furthermore, uniform plant distribution increased soybean seed yield by 9.5% over non-uniform plant distribution. This study demonstrates that increasing planting density under uniform plant distribution can be useful to obtain higher seed yield without increasing other farm inputs

Identification of a Chromosome 1 Substitution Line B6-Chr1BLD as a Novel Hyperlipidemia Model via Phenotyping Screening

Hyperlipidemia is a chronic disease that seriously affects human health. Due to the fact that traditional animal models cannot fully mimic hyperlipidemia in humans, new animal models are urgently needed for basic drug research on hyperlipidemia. Previous studies have demonstrated that the genomic diversity of the wild mice chromosome 1 substitution lines was significantly different from that of laboratory mice, suggesting that it might be accompanied by phenotypic diversity. We first screened the blood lipid-related phenotype of chromosome 1 substitution lines. We found that the male HFD-fed B6-Chr1BLD mice showed more severe hyperlipidemia-related phenotypes in body weight, lipid metabolism and liver lesions. By RNA sequencing and whole-genome sequencing results of B6-Chr1BLD, we found that several differentially expressed single nucleotide polymorphism enriched genes were associated with lipid metabolism-related pathways. Lipid metabolism-related genes, mainly including Aida, Soat1, Scly and Ildr2, might play an initial and upstream role in the abnormal metabolic phenotype of male B6-Chr1BLD mice. Taken together, male B6-Chr1BLD mice could serve as a novel, polygenic interaction-based hyperlipidemia model. This study could provide a novel animal model for accurate clinical diagnosis and precise medicine of hyperlipidemia