Baichuan 2: Open Large-scale Language Models

Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering. However, most powerful LLMs are closed-source or limited in their capability for languages other than English. In this technical report, we present Baichuan 2, a series of large-scale multilingual language models containing 7 billion and 13 billion parameters, trained from scratch, on 2.6 trillion tokens. Baichuan 2 matches or outperforms other open-source models of similar size on public benchmarks like MMLU, CMMLU, GSM8K, and HumanEval. Furthermore, Baichuan 2 excels in vertical domains such as medicine and law. We will release all pre-training model checkpoints to benefit the research community in better understanding the training dynamics of Baichuan 2.Comment: Baichuan 2 technical report. Github: https://github.com/baichuan-inc/Baichuan

Relationship of Ecosystem Services in the Beijing–Tianjin–Hebei Region Based on the Production Possibility Frontier

The supply and demand of ecosystem services are affected by land use. Only a few studies have conducted in-depth quantitative analyses. This study adopted the Beijing–Tianjin–Hebei region as the research area. The CLUMondo model was adopted to infer the land-use pattern under protection, development, and natural scenarios in 2035. Moreover, the InVEST model was utilized to evaluate carbon sequestration, water yield, and soil conservation under multiple land-use patterns. The production possibility frontier was drawn to visualize the trade-off relationship further. The trade-off intensity index was calculated to quantify the magnitude of the trade-off. (1) Under the development scenario, the accelerated expansion of urbanized land will occupy a large amount of arable and forest land, which should be planned and controlled. (2) The trade-off and synergistic relationships could be transformed under the different land-use scenarios. (3) The production possibility frontier curve for each ecosystem service trade-off and the optimal value of the trade-off configuration were plotted for the different scenarios. The trade-off intensity of ecosystem services was also calculated. This study combined ecosystem services with land-use regulations and revealed the link between ecosystem services and regional land-use pattern change. The aim is to provide a reference for the synergistic progress of the ecological economy in the Beijing–Tianjin–Hebei region

A Low-Cost, Controllable and Interpretable Task-Oriented Chatbot: With Real-World After-Sale Services as Example

Though widely used in industry, traditional task-oriented dialogue systems suffer from three bottlenecks: (i) difficult ontology construction (e.g., intents and slots); (ii) poor controllability and interpretability; (iii) annotation-hungry. In this paper, we propose to represent utterance with a simpler concept named Dialogue Action, upon which we construct a tree-structured TaskFlow and further build task-oriented chatbot with TaskFlow as core component. A framework is presented to automatically construct TaskFlow from large-scale dialogues and deploy online. Our experiments on real-world after-sale customer services show TaskFlow can satisfy the major needs, as well as reduce the developer burden effectively.Comment: Accept at SIGIR Industry Track 202

Oxygen-Plasma-Induced Hetero-Interface NiFe2O4/NiMoO4 Catalyst for Enhanced Electrochemical Oxygen Evolution

The electrolysis of water to produce hydrogen is an effective method for solving the rapid consumption of fossil fuel resources and the problem of global warming. The key to its success is to design an oxygen evolution reaction (OER) electrocatalyst with efficient conversion and reliable stability. Interface engineering is one of the most effective approaches for adjusting local electronic configurations. Adding other metal elements is also an effective way to enrich active sites and improve catalytic activity. Herein, high-valence iron in a heterogeneous interface of NiFe2O4/NiMoO4 composite was obtained through oxygen plasma to achieve excellent electrocatalytic activity and stability. In particular, 270 mV of overpotential is required to reach a current density of 50 mA cm−2, and the overpotential required to reach 500 mA cm−2 is only 309 mV. The electron transfer effect for high-valence iron was determined by X-ray photoelectron spectroscopy (XPS). The fast and irreversible reconstruction and the true active species in the catalytic process were identified by in situ Raman, ex situ XPS, and ex situ transmission electron microscopy (TEM) measurements. This work provides a feasible design guideline to modify electronic structures, promote a metal to an active oxidation state, and thus develop an electrocatalyst with enhanced OER performance

Enhancement of Torularhodin Production in Rhodosporidium toruloides by Agrobacterium tumefaciens-Mediated Transformation and Culture Condition Optimization

Nine transformants of Rhodosporidium toruloides with significant changes in the carotenoid profile were obtained by Agrobacterium tumefaciens-mediated transformation, including a white, three red, and four yellow mutants. A red mutant A1-15-BRQ that showed a high torularhodin production was selected for culture condition optimization. Results indicated that the torularhodin yield was boosted with glucose as the carbon source, at a carbon/nitrogen ratio of 22, a loading volume of 75 mL, and 28 °C. The torularhodin yield of 21.3 mg/L consisting of 94.4% total carotenoids was obtained by Box–Behnken design experiments. The torularhodin yield was 17.0-fold higher than that of the wild type, with time shortened from 9 to 3 days. This study reports an effective strategy for improving torularhodin production and provides a candidate R. toruloides strain for highly selective production of torularhodin

Extractable additives in microplastics: A hidden threat to soil fauna*

Microplastics (MPs) have become an emerging threat for organisms. However, the toxicity mechanisms on biota, especially soil biota remain largely unclear. This study distinguished the effects of five types of MPs and their extractable additives on a typical soil oligochaete Enchytraeus crypticus using a traditional ecotoxicological approach combined with gut microbiota analysis. A variety of inorganic and organic compounds were screened in extractable solutions. Both MPs and their extractable additives decreased the growth and survival rates of the worms and shifted the gut microbiota, and the effects were type-specific. The differences between the effects of MPs and their extractable additives on traditional ecotoxicological parameters were insignificant, suggesting that extractable additives were the main toxicity pathways on soil fauna. The type-specific effects of MPs were attributed to the varied chemical compositions of extractable additives, and the compounds responsible for the shift of gut microbiota were further identified. The distinguishable effects on gut microbiota between MPs and their extractable additives together with the significant regressions between gut microbiota and traditional ecotoxicological parameters confirmed that gut microbiota could be a more sensitive indicator of organism's health conditions. Combined, the study provided an important insight into the toxicity mechanisms of MPs on soil fauna and extractable additives of MPs may be a hidden threat

iRhom2 loss alleviates renal injury in long-term PM2.5-exposed mice by suppression of inflammation and oxidative stress

Particulate matter (PM2.5) is a risk factor for organ injury and disease progression, such as lung, brain and liver. However, its effects on renal injury and the underlying molecular mechanism have not been understood. The inactive rhomboid protein 2 (iRhom2), also known as rhomboid family member 2 (Rhbdf2), is a necessary modulator for shedding of tumor necrosis factor-α (TNF-α) in immune cells, and has been explored in the pathogenesis of chronic renal diseases. In the present study, we found that compared to the wild type (iRhom2+/+) mice, iRhom2 knockout (iRhom2-/-) protected PM2.5-exposed mice from developing severe renal injury, accompanied with improved renal pathological changes and functions. iRhom2-/- mice exhibited reduced inflammatory response, as evidenced by the reduction of interleukin 1β (IL-1β), IL-6, tumor necrosis factor-α (TNF-α) and IL-18 in kidney samples, which might be, at least partly, through inactivating TNF-α converting enzyme/TNF-α receptors (TACE/TNFRs) and inhibitor of α/nuclear factor κ B (IκBα/NF-κB) signaling pathways. In addition, oxidative stress was also restrained by iRhom2-/- in kidney of PM2.5-exposed mice by enhancing heme oxygenase/nuclear factor erythroid 2-related factor 2 (HO-1/Nrf-2) expressions, and reducing phosphorylated c-Jun N-terminal kinase (JNK). In vitro, blockage of HO-1 or Nrf-2 rescued the inflammatory response and oxidative stress that were reduced by iRhom2 knockdown in PM2.5-incubated RAW264.7 cells. Similar results were observed in JNK activator-treated cells. Taken together, our findings indicated that iRhom2 played an essential role in regulating PM2.5-induced chronic renal damage, thus revealing a potential target for preventing chronic kidney diseases development. Keywords: PM2.5, Renal injury, iRhom2, Inflammation, Oxidative stress, JN

Rapid octreotide separation from synthetic peptide crude mixtures by chromatography on poly(styrene-co-divinylbenzene)-based reversed phases

Octreotide, a disulfide-cyclized eight amino acids long analogue of somatostatin, has been used to treat the symptoms associated with metastatic carcinoid tumors (flushing and diarrhea), and vasoactive intestinal peptide secreting adenomas (watery diarrhea). As composed by D-amino acids, C-terminal alcohol, and disulfide bond, octreotide can be only prepared using chemistry synthesis method, which increases difficulty of the traditional reversed-phase separation. In this paper, we report a very fast separation of octreotide from synthetic peptide crude mixtures on a poly(styrene co-divinylbenzene) (PSt)-based reversed phases prepared by a quick membrane emulsification process. In general, fourier-transformed infrared resonance (FT-IR) spectroscopy, reversed-phase high performance liquid chromatography (HPLC) combined with electrospray ionisation mass spectrometry (ESI-MS), and nuclear magnetic resonance (NMR) spectroscopy are routinely used for analyses of resultant peptides. Under the optimized conditions, the octreotide is purified from 42.89% to 99.99%. Consequently, the poly(styrene co-divinylbenzene)-based phase can provide more flexibility to improve separation efficiency for the octreotide from the synthetic peptide crude mixtures. (C) 2015 Elsevier B.V. All rights reserved

Insights into the Bioinformatics and Transcriptional Analysis of the Elongator Complexes (<i>ELPs</i>) Gene Family of Wheat: <i>TaELPs</i> Contribute to Wheat Abiotic Stress Tolerance and Leaf Senescence

Elongator complexes (ELPs) are the protein complexes that promote transcription through histone acetylation in eukaryotic cells and interact with elongating RNA polymerase II (RNAPII). ELPs’ role in plant growth and development, signal transduction, and response to biotic and abiotic stresses have been confirmed in model plants. However, the functions of the wheat ELP genes are not well documented. The present study identified 18 members of the ELPs from the wheat genome with a homology search. Further, bioinformatics and transcription patterns in response to different stress conditions were analyzed to dissect their potential regulatory mechanisms in wheat. Gene duplication analysis showed that 18 pairs of ELP paralogous genes were derived from segmental duplication, which was divided into six clades by protein phylogenetic and cluster analysis. The orthologous analysis of wheat TaELP genes showed that TaELP genes may have evolved from orthologous genes of other plant species or closely related plants. Moreover, a variety of cis-acting regulatory elements (CAREs) related to growth and development, hormone response, and biotic and abiotic stresses were identified in the TaELPs’ promoter regions. The qRT-PCR analysis showed that the transcription of TaELPs was induced under hormone, salt, and drought stress and during leaf senescence. The TaELP2 gene was silenced with BSMV-VIGS, and TaELP2 was preliminarily verified to be involved in the regulation of wheat leaf senescence. Overall, TaELP genes might be regulated by hormone signaling pathways and response to abiotic stress and leaf senescence, which could be investigated further as potential candidate genes for wheat abiotic stress tolerance and yield improvement

Supplemental Material - Effect of Five-Elements Music Therapy Combined With Baduanjin Qigong on Patients With Mild COVID-19

Supplemental Material for Effect of Five-Elements Music Therapy Combined With Baduanjin Qigong on Patients With Mild COVID-19 by Lishi Yin Haijiao Zhang, Yan Peng, Guifang Zhang, Qiyang Chen, Juan Liang, Suzhai Tian, Tingting Tong, Ruiyi Liu, Chenxu Lv, Lijuan Zhao, Ting Liang, Jie Wang and Ling Fan in Journal of Social and Personal Relationships.</p