Easy and Efficient Transformer : Scalable Inference Solution For large NLP model

Recently, large-scale transformer-based models have been proven to be effective over a variety of tasks across many domains. Nevertheless, putting them into production is very expensive, requiring comprehensive optimization techniques to reduce inference costs. This paper introduces a series of transformer inference optimization techniques that are both in algorithm level and hardware level. These techniques include a pre-padding decoding mechanism that improves token parallelism for text generation, and highly optimized kernels designed for very long input length and large hidden size. On this basis, we propose a transformer inference acceleration library -- Easy and Efficient Transformer (EET), which has a significant performance improvement over existing libraries. Compared to Faster Transformer v4.0's implementation for GPT-2 layer on A100, EET achieves a 1.5-4.5x state-of-art speedup varying with different context lengths. EET is available at https://github.com/NetEase-FuXi/EET. A demo video is available at https://youtu.be/22UPcNGcErg

Effects of Economic Plants Planting under Forest in Mining Area on Rhizosphere Soil Biological Community Characteristics and Physicochemical Properties

This is an essay in the field of mining environmental engineering. In order to evaluate the influence of economic plant planting in the mining area on the rhizosphere soil biological community characteristics and physicochemical properties, 7 typical forest medicine economic plants such as Fallopiamultiflora, Puerarialobata, and 7 typical forest grasses such as Perennial ryegrassand Pennisetum were selected. Taking economic plants as the research object, the experiment of planting potted economic plants under forest was carried out. By measuring plant height, leaf area, aboveground/underground biomass and soil total phosphorus, total potassium, total nitrogen, available nitrogen, available phosphorus, organic matter, cation exchange capacity, and microbial community composition, richness, diversity and other indicators, To comprehensively study the effects of economic plant planting under forest on the characteristics and physicochemical properties of rhizosphere soil. The results showed that planting Chinese herbal plants would increase microbial diversity, while planting forages would have a certain impact on the composition of microbial communities; planting Chinese herbal understory economic plants had a significant improvement in soil fertility, and the most obvious difference was the control. The total nitrogen, alkali-hydrolyzed nitrogen, and organic matter in the group increased by 300.0%, 118.5%, and 825.3%, respectively; planting forages had no obvious effect on soil fertility. The research in this paper shows that planting understory economic plants will have a certain impact on the soil biome and improve soil fertility to a certain extent

Regulation of the Two-Component Regulator CpxR on Aminoglycosides and β-lactams Resistance in Salmonella enterica Serovar Typhimurium

The two-component signal transduction system CpxAR is especially widespread in Gram-negative bacteria. It has been reported that CpxAR contributes to the multidrug resistance (MDR) in Escherichia coli. CpxR is a response regulator in the two-component CpxAR system. The aim of this study was to explore the role of cpxR in the MDR of S. enterica serovar Typhimurium. The minimal inhibitory concentrations (MICs) of various antibiotics commonly used in veterinary medicine for strains JS (a multidrug-susceptible standard strain of S. enterica serovar Typhimurium), JS△cpxR, JS△cpxR/pcpxR, JS△cpxR/pcpxR＊, JS△cpxR△acrB, JS△cpxR△acrB/pcpxR, JS△cpxR△acrB/pcpxR＊, 9 S. enterica serovar Typhimurium isolates (SH1–9), and SH1–9△cpxR were determined by the 2-fold broth microdilution method. The relative mRNA expression levels of ompF, ompC, ompW, ompD, tolC, acrB, acrD, acrF, mdtA, marA, and soxS in strains JS, JS△cpxR, and JS△cpxR/pcpxR were detected by real-time PCR. The results showed 2- to 4-fold decreases in the MICs of amikacin (AMK), gentamycin (GEN), apramycin (APR), neomycin (NEO), ceftriaxone (CRO), ceftiofur (CEF), and cefquinome (CEQ) for strain JS△cpxR, as compared to those for the parental strain JS. Likewise, SH1–9△cpxR were found to have 2- to 8-fold reduction in resistance to the above antibiotics, except for NEO, as compared to their parental strains SH1–9. Furthermore, 2- to 4-fold further decreases in the MICs of AMK, GEN, APR, and CEF for strain JS△cpxR△acrB were observed, as compared to those for strain JS△acrB. In addition, CpxR overproduction in strain JS△cpxR led to significant decreases in the mRNA expression levels of ompF, ompC, ompW, ompD, tolC, acrB, marA, and soxS, and significant increases in those of stm3031 and stm1530. Notably, after all strains were induced simultaneously by GEN to the 15th passage at subinhibitory concentrations, strain JS△cpxR/pcpxR showed significant increases in mRNA expression levels of the efflux pump acrD and mdtA genes, as compared to strain JS△cpxR. Our results indicate that the two-component regulator CpxR contributes to resistance of S. enterica serovar Typhimurium to aminoglycosides and β-lactams by influencing the expression level of the MDR-related genes

Prevalence, resistance pattern, and molecular characterization of Staphylococcus aureus isolates from healthy animals and sick populations in Henan Province, China

Abstract Background Staphylococcus aureus is one of the most prevalent pathogens and a causative agent of a variety of infections in humans and animals. A total of 640 samples were collected from healthy animals and patients from 2013 to 2014 in Henan Province, China, to investigate the prevalence and perform molecular characterization of S. aureus. Antimicrobial resistance and virulence genes were determined and pulsed-field gel electrophoresis (PFGE) and staphylococcal cassette chromosome mec (SCCmec) typing were performed. Results Overall, 22.3% (n = 143) of the samples were positive for S. aureus. The prevalence of methicillin-resistant S. aureus (MRSA) was 5.59%. Capsular polysaccharide locus type 5 (Cap5; 56.64%) was the dominant serotype. S. aureus strains showed high resistance to penicillin (96.50%), ciprofloxacin (52.45%), amikacin (67.83%), erythromycin (96.50%), lincomycin (97.20%), and tetracycline (68.53%) and 109 (76.2%) isolates harbored six or more tested resistance genes. The most predominant resistance genes were aphA (52.45%), ermC (53.15%), and tetM (52.45%). Eighty-seven (60.8%) isolates harbored six or more tested virulence genes. The most predominant enterotoxin genes were sed (20.28%), sej (20.98%), sep (14.69%), and set (37.76%). The prevalence of lukED gene was (57.34%), and a small number of isolates carried pvl (5.59%) and TSST-1 (2.80%). A total of 130 (82.52%) isolates could be typed by PFGE with SmaI digestion. PFGE demonstrated that 45 different patterns (P) that were grouped into 17 pulsotypes and 28 separate pulsotypes using a 90% cut-off value. A total of 118 (82.52%) isolates were successfully typed by spa, and 26 spa types were identified, t15075 (14.00%) and t189 (12.59%) were the most common types. SCCmec types were detected from eight MRSA isolates, with the most prevalent type being SCCmec IVa. MRSA-SCCmec Iva-t437 was observed in human isolates. Conclusion This study revealed a high prevalence of S. aureus in healthy animals and patients from Henan Province, China. Resistant S. aureus exhibited varying degrees of multidrug resistance. The presence of antibiotic resistance and virulence genes may facilitate the spread of S. aureus strains and pose a potential threat to public health, highlighting the need for vigilant monitoring of these isolates at the human–animal interface

Prevalence and molecular characterization of oqxAB in clinical Escherichia coli isolates from companion animals and humans in Henan Province, China

Abstract Background The plasmid-encoded multidrug efflux pump oqxAB confers bacterial resistance primarily to olaquindox, quinolones, and chloramphenicol. The aims of this study were to investigate the prevalence of oqxAB among Escherichia coli isolates from dogs, cats, and humans in Henan, China and the susceptibilities of E. coli isolates to common antibiotics. Methods From 2012 to 2014, a total of 600 samples which included 400 rectal samples and 200 clinical human specimens were tested for the presence of E. coli. All isolates were screened for oqxAB genes by PCR and sequencing. The MICs of 11 antimicrobial agents were determined by the broth microdilution method. A total of 30 representative oqxAB-positive isolates were subjected to ERIC-PCR and MLST. Additionally, conjugation experiments and southern hybridizations were performed. Results Of 270 isolates, 58.5% (62/106) of the isolates from dogs, 56.25% (36/64) of the isolates from cats, and 42.0% (42/100) of the isolates from humans were positive for the oqxAB. Olaquindox resistance was found for 85.7%-100% of oqxAB-positive isolates. Of oqxAB-positive isolates from dogs, cats, and humans, ciprofloxacin resistance was inspected for 85.8%, 59.1%, and 93.8%, respectively. Several oqxAB-positive isolates were demonstrated by ERIC-PCR and MLST, and have high similarity. Phylogenetic analysis showed that oqxAB-positive isolates could be divided into 7 major clusters. OqxAB-positive conjugants were obtained, southern hybridization verified that the oqxAB gene complex was primarily located on plasmids. Conclusion In conclusion, oqxAB-positive isolates were widespread in animals and humans in Henan, China. Carriage of oqxAB on plasmids of E. coli isolates may facilitate the emergence of multidrug resistant and its transmission via horizontal transfer, and might pose a potential threat to public health

Free-Standing and Transparent Graphene Membrane of Polyhedron Box-Shaped Basic Building Units Directly Grown Using a NaCl Template for Flexible Transparent and Stretchable Solid-State Supercapacitors

Transparency has never been integrated into freestanding flexible graphene paper (FF-GP), although FF-GP has been discussed extensively, because a thin transparent graphene sheet will fracture easily when the template or substrate is removed using traditional methods. Here, transparent FF-GP (FFT-GP) was developed using NaCl as the template and was applied in transparent and stretchable supercapacitors. The capacitance was improved by nearly 1000-fold compared with that of the laminated or wrinkled chemical vapor deposition graphene-film-based supercapacitors

MOESM3 of Prevalence, resistance pattern, and molecular characterization of Staphylococcus aureus isolates from healthy animals and sick populations in Henan Province, China

Additional file 3: Table S3. Oligonucleotide sequences, primers, and targets for polymerase chain reaction amplification of antibiotic resistance genes and integrons in S. aureus isolates

MOESM2 of Prevalence, resistance pattern, and molecular characterization of Staphylococcus aureus isolates from healthy animals and sick populations in Henan Province, China

Additional file 2: Table S2. A list of the 33 tested antimicrobials, their classes, and the concentrations used for susceptibility testing of S. aureus