COLO: A Contrastive Learning based Re-ranking Framework for One-Stage Summarization

Traditional training paradigms for extractive and abstractive summarization systems always only use token-level or sentence-level training objectives. However, the output summary is always evaluated from summary-level which leads to the inconsistency in training and evaluation. In this paper, we propose a Contrastive Learning based re-ranking framework for one-stage summarization called COLO. By modeling a contrastive objective, we show that the summarization model is able to directly generate summaries according to the summary-level score without additional modules and parameters. Extensive experiments demonstrate that COLO boosts the extractive and abstractive results of one-stage systems on CNN/DailyMail benchmark to 44.58 and 46.33 ROUGE-1 score while preserving the parameter efficiency and inference efficiency. Compared with state-of-the-art multi-stage systems, we save more than 100 GPU training hours and obtaining 3~8 speed-up ratio during inference while maintaining comparable results.Comment: Accepted by COLING 202

Associations of Polymorphisms in the Apolipoprotein APOA1-C3-A5 Gene Cluster with Acute Coronary Syndrome

Background. Acute coronary syndromes (ACSs) are clinically cardiovascular events associated with dyslipidemia in common. Single nucleotide polymorphisms (SNPs) and haplotypes in the APOA1/C3/A5 gene cluster are associated with diabetes and familial combined hyperlipidaemia (FCH). Little is known about whether the polymorphisms in these genes affect lipid homeostasis in patients with ACSs. The present paper aimed to examine these associations with 4 SNPs in the APOA1 −75G > A, the APOC3 −455T > C, and APOA5 −1131T > C, c.553G > T variant to ACSs in Chinese Han. Methods. Chinese Han of 229 patients with ACSs and 254 unrelated controls were analyzed. Four SNPs in APOA1/C3/A5 cluster were genotyped and lipid was determined. Results. Our data show that minor allelic frequencies of APOC3 −455T > C, APOA5 −1131T > C, and c.553G > T polymorphisms in patients with ACSs were significantly higher than control group (P < 0.05). Furthermore, the 3 polymorphic sites were strongly of linkage disequilibrium, and minor alleles of 3 SNP sites had higher TG level than wild alleles (P < 0.05), APOC3 −455C and APOA5 c.553T allele carriers also had lower level of HDL-C. Conclusions. The minor alleles of APOC3 −455T > C, APOA5 −1131T > C, and c.553G > T polymorphisms are closely associated with ACSs

Intranasal Immunization with Chitosan/pCAGGS-flaA Nanoparticles Inhibits Campylobacter jejuni in a White Leghorn Model

Campylobacter jejuni is the most common zoonotic bacterium associated with human diarrhea, and chickens are considered to be one of the most important sources for human infection, with no effective prophylactic treatment available. We describe here a prophylactic strategy using chitosan-DNA intranasal immunization to induce specific immune responses. The chitosan used for intranasal administration is a natural mucus absorption enhancer, which results in transgenic DNA expression in chicken nasopharynx. Chickens immunized with chitosan-DNA nanoparticles, which carried a gene for the major structural protein FlaA, produced significantly increased levels of serum anti-Campylobacter jejuni IgG and intestinal mucosal antibody (IgA), compared to those treated with chitosan-DNA (pCAGGS). Chitosan-pCAGGS-flaA intranasal immunization induced reductions of bacterial expellation by 2-3 log10 and 2 log10 in large intestine and cecum of chickens, respectively, when administered with the isolated C. jejuni strain. This study demonstrated that intranasal delivery of chitosan-DNA vaccine successfully induced effective immune response and might be a promising vaccine candidate against C. jejuni infection

Neutralization of Diverse Human Cytomegalovirus Strains Conferred by Antibodies Targeting Viral gH/gL/pUL128-131 Pentameric Complex

Human cytomegalovirus (HCMV) is the leading cause of congenital viral infection, and developing a prophylactic vaccine is of high priority to public health. We recently reported a replication-defective human cytomegalovirus with restored pentameric complex glycoprotein H (gH)/gL/pUL128-131 for prevention of congenital HCMV infection. While the quantity of vaccine-induced antibody responses can be measured in a viral neutralization assay, assessing the quality of such responses, including the ability of vaccine-induced antibodies to cross-neutralize the field strains of HCMV, remains a challenge. In this study, with a panel of neutralizing antibodies from three healthy human donors with natural HCMV infection or a vaccinated animal, we mapped eight sites on the dominant virus-neutralizing antigen-the pentameric complex of glycoprotein H (gH), gL, and pUL128, pUL130, and pUL131. By evaluating the site-specific antibodies in vaccine immune sera, we demonstrated that vaccination elicited functional antiviral antibodies to multiple neutralizing sites in rhesus macaques, with quality attributes comparable to those of CMV hyperimmune globulin. Furthermore, these immune sera showed antiviral activities against a panel of genetically distinct HCMV clinical isolates. These results highlighted the importance of understanding the quality of vaccine-induced antibody responses, which includes not only the neutralizing potency in key cell types but also the ability to protect against the genetically diverse field strains. IMPORTANCE HCMV is the leading cause of congenital viral infection, and development of a preventive vaccine is a high public health priority. To understand the strain coverage of vaccine-induced immune responses in comparison with natural immunity, we used a panel of broadly neutralizing antibodies to identify the immunogenic sites of a dominant viral antigen-the pentameric complex. We further demonstrated that following vaccination of a replication-defective virus with the restored pentameric complex, rhesus macaques can develop broadly neutralizing antibodies targeting multiple immunogenic sites of the pentameric complex. Such analyses of site-specific antibody responses are imperative to our assessment of the quality of vaccine-induced immunity in clinical studies

Recent advances in PEG–PLA block copolymer nanoparticles

Due to their small particle size and large and modifiable surface, nanoparticles have unique advantages compared with other drug carriers. As a research focus in recent years, polyethylene glycol–polylactic acid (PEG–PLA) block copolymer and its end-group derivative nanoparticles can enhance the drug loading of hydrophobic drugs, reduce the burst effect, avoid being engulfed by phagocytes, increase the circulation time of drugs in blood, and improve bioavailability. Additionally, due to their smaller particle size and modified surface, these nanoparticles can accumulate in inflammation or target locations to enhance drug efficacy and reduce toxicity. Recent advances in PEG–PLA block copolymer nanoparticles, including the synthesis of PEG–PLA and the preparation of PEG–PLA nanoparticles, were introduced in this study, in particular the drug release and modifiable characteristics of PEG–PLA nanoparticles and their application in pharmaceutical preparations

Soil moisture and electrical conductivity relationships under typical Loess Plateau land covers

Vegetation changes that are driven by soil conservation measures significantly affect subsurface water flow patterns and soil water status. Much research on water consumption and sustainability of newly introduced vegetation types at the plot scale has been done in the Loess Plateau of China (LPC), typically using local scale measurements of soil water content (SWC). However, information collected at the plot scale cannot readily be up-scaled. Geophysical methods such as electromagnetic induction (EMI) offer large spatial coverage and therefore could bridge between the scales. A non-invasive, multi-coil, frequency domain, EMI instrument was used to measure the apparent soil electrical conductivity (σ_a) from six effective depths under four typical land-covers; shrub, pasture, natural fallow and crop, in the north of the LPC. Concurrently, SWC was monitored to a depth of 4 m depth using an array of 44 neutron probes distributed along the plots. The measurements of σ_a for six effective depths and the integrated SWC over these depths, show consistent behavior. High variability of σ_a under shrub cover, in particular, is consistent with long term variability of SWC, highlighting the potential unsustainability of this land cover. Linear relationships between SWC and σ_a were established using cumulative sensitivity forward models. The conductivity-SWC model parameters show clear variation with depth, despite lack of appreciable textural variation. This is likely related to the combined effect of elevated pore water conductivity as was illustrated by the simulations obtained with water flow and solute transport models. The results of the study highlight the potential for the implementation of the EMI method for investigations of water distribution in the vadose zone of the LPC, and in particular for qualitative mapping of the vulnerability to excessive vegetation demands, and hence unsustainable land cover

The expression profile of microRNAs in a model of 7,12-dimethyl-benz[a]anthrance-induced oral carcinogenesis in Syrian hamster

<p>Abstract</p> <p>Background</p> <p>Non-coding RNA molecules, such as microRNAs, may play an important role in carcinogenesis. Recent studies have indicated that microRNAs are involved in initiation and progression of various malignancies. However, little work has been done to compare the microRNA expression patterns in oral cancer. In this study, we constructed an animal model of oral squamous cell carcinoma to investigate expression profiles of microRNAs in oral carcinogenesis.</p> <p>Methods</p> <p>The animal model of oral squamous cell carcinoma was conducted by tri-weekly (Monday, Wednesday, and Friday) painting with 5% DMBA in acetone. Six Syrian hamsters, including three from the treated group and three from the control group, were used as a training group for microRNA microarray analysis. All microarray data were analyzed by Significance Analysis of Microarrays (SAM) and CLUSTER 3.0 software, and this result was further confirmed by qRT-PCR assay.</p> <p>Results</p> <p>Seventeen microRNAs were differentially expressed in oral squamous cell carcinoma. Five microRNAs (hsa-miR-21, hsa-miR-200b, hsa-miR-221, hsa-miR-338, and mmu-miR-762) were significantly upregulated and twelve microRNAs (hsa-miR-16, hsa-miR-26a, hsa-miR-29a, hsa-miR-124a, hsa-miR-125b, mmu-miR-126-5p, hsa-miR-143, hsa-miR-145, hsa-miR-148b, hsa-miR-155, hsa-miR-199a, and hsa-miR-203) were down-regulated in cancer tissues. The expression levels of hsa-miR-21 and hsa-miR-16 seen with Stem-loop qRT-PCR were also seen in microarray analysis in all samples.</p> <p>Conclusion</p> <p>Our findings identified specific microRNA expression in oral squamous cell carcinoma and suggested that microRNAs have a role in oral carcinogenesis.</p