Baichuan 2: Open Large-scale Language Models

Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering. However, most powerful LLMs are closed-source or limited in their capability for languages other than English. In this technical report, we present Baichuan 2, a series of large-scale multilingual language models containing 7 billion and 13 billion parameters, trained from scratch, on 2.6 trillion tokens. Baichuan 2 matches or outperforms other open-source models of similar size on public benchmarks like MMLU, CMMLU, GSM8K, and HumanEval. Furthermore, Baichuan 2 excels in vertical domains such as medicine and law. We will release all pre-training model checkpoints to benefit the research community in better understanding the training dynamics of Baichuan 2.Comment: Baichuan 2 technical report. Github: https://github.com/baichuan-inc/Baichuan

An open science resource for establishing reliability and reproducibility in functional connectomics

Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals’ resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included

Yielding Ability and Stability and Adaptability of Proso Millet Varieties

The yielding ability and stability and adaptability of eight proso millet varieties from Shanxi, Inner Mongolia, Heilongjiang and Hebei were analyzed and evaluated in different ecological regions including Zhangjiakou, Huanghua and Shijiazhuang in 2015. The results showed that Chishu No.2 and Jishu No.2 have stronger yielding ability, and their grain yields were 3 144.42 (highest) and 3 133.15 kg/ha respectively, ranking first and second in the test varieties. In areas with low fertility, especially in saline-alkali areas, they still have potential for high yields, so they are suitable for promotion in large areas in Hebei Province. Neimi No.8 and Yanshu No.11 showed special adaptability under different ecological conditions. They require high-fertility soil and can be planted in the spring millet area in north of Hebei

Regulating morphologies and near-infrared photothermal conversion of perylene bisimide via sequence-dependent peptide self-assembly

The assembly behavior of perylene bisimide (PBI) can be precisely organised by the conjugation of sequence-dependent di-peptides in aqueous media. The assembled nanostructures and consequent properties of PBI aggregates can be tuned by the use of different peptide sequences with improved yield of radical anions and enhanced photothermal conversion efficiency.</p

Self-Assembly of Monomeric Hydrophobic Photosensitizers with Short Peptides Forming Photodynamic Nanoparticles with Real-Time Tracking Property and without the Need of Release in Vivo

Employing nanoscaled materials as photosensitizer (PS) carriers is an effective strategy to solve the problem of poor solubility and low tumor selectivity of hydrophobic PS in photodynamic therapy (PDT), which compulsorily requires the PS release in PDT implementation. However, the complicated environment in vivo makes it difficult to precisely design and control the release process and the delivery process requires real-time tracking. Developing a delivery strategy of hydrophobic PS in the monomeric form with fluorescent emission and without consideration of the PS release in the PDT process, is in urgent demand. Herein, we report a versatile and potent strategy for fabrication of photodynamic nanoparticles (nanoPSs) with featuring the monomeric PS based on aromatic peptide-modulated self-assembly of porphyrin derivatives. Aromatic peptides within nanoPSs can isolate hydrophobic porphyrins from each other, resulting in monomeric porphyrin delivery with real-time fluorescence tracking property and avoiding self-aggregation and hence porphyrin release. Moreover, partially charged porphyrins tend to expose on the surface of nanoPSs, facilitating production and diffusion of O-1(2). The highest O-1(2) yield can be achieved with porphyrin loading as low as 6 wt %, reducing side effects of excessive porphyrin injection. The nanoPSs show enhanced PDT efficacy in vitro and in vivo leading to complete tumor eradication. This study highlights opportunities for development of active photodynamic nanoparticles and provides an alternative strategy for delivery of hydrophobic photosensitive drugs with enhanced therapeutic effects.</p

Tuning Supramolecular Structure and Functions of Peptide bola-Amphiphile by Solvent Evaporation-Dissolution

Solvent molecules significantly affect the supramolecular self-assembly, for example, in forming solvent-bridged hydrogen bonding networks. Even small changes in solvent composition can have dramatic impact on supramolecular assembly. Herein, we demonstrate the use of trace solvents (as low as 0.04%) to tune the morphology and consequent functions of supramolecular nanostructures based on an aromatic peptide bola-amphiphile. Specifically, perylene bisimide-(di)glycine-tyrosine (PBI-[GY](2)) bola-amphiphile was shown to give rise to red-emitting nanofibers when assembled in water, while exposure to trace organic solvents such as tetrahydrofuran (THF) and others via solvent-evaporation followed by aqueous assembly gave rise to white-light-emitting nanospheres. Differential hydrogen bonding between water (donor and acceptor) and THF (acceptor only) impacts supramolecular organization, which was verified using a density functional theory (DFT) simulation. The tunable consequent surface hydrophobicity was utilized in staining the cytoplasm and membrane of cells, respectively. The trace-solvent effect achieved through evaporationdissolution provides a methodology to mediate the morphologies and consequent functions for supramolecular biomaterials controlled by the self-assembly pathway.</p

Data.xlsx

This file includes monthly or phenological-periodic mean values of litterfall, leaf area index, water-use efficiency, air temperature and soil water content in Southwest China rubber plantations at four stand ages and planting densities

Numerical description of coalbed methane desorption stages based on isothermal adsorption experiment

Quantitative description of desorption stages of coalbed methane is an important basis to objectively understand the production of coalbed methane well, to diagnose the production state, and to optimize the management of draining and collection of coalbed methane. A series of isothermal adsorption experiments were carried out with 12 anthracite samples from 6 coalbed methane wells located in the south of the Qinshui Basin, based on the results of isothermal adsorption experiments, and an analytical model was developed based on the Langmuir sorption theory. With the model, a numerical method that adopts equivalent desorption rate and its curve was established, which can be used to characterize the staged desorption of coalbed methane. According to the experimental and numerical characterizations, three key pressure points determined by the equivalent desorption rate curvature that defines pressure-declining desorption stage, have been proposed and confirmed, namely, start-up pressure, transition pressure and sensitive pressure. By using these three key pressure points, the process of coalbed methane desorption associated with isothermal adsorption experiments can be divided into four stages, i.e., zero desorption stage, slow desorption stage, transition desorption stage, and sensitive desorption stage. According to analogy analysis, there are differences and similarities between the processes of coalbed methane desorption identified by isothermal adsorption experiments and observed in gas production. Moreover, it has been found that larger Langmuir volume and ratio of Langmuir constants are beneficial to earlier advent of steady production stage, whereas it is also possible that the declining production stage may occur ahead of schedule