Baichuan 2: Open Large-scale Language Models

Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering. However, most powerful LLMs are closed-source or limited in their capability for languages other than English. In this technical report, we present Baichuan 2, a series of large-scale multilingual language models containing 7 billion and 13 billion parameters, trained from scratch, on 2.6 trillion tokens. Baichuan 2 matches or outperforms other open-source models of similar size on public benchmarks like MMLU, CMMLU, GSM8K, and HumanEval. Furthermore, Baichuan 2 excels in vertical domains such as medicine and law. We will release all pre-training model checkpoints to benefit the research community in better understanding the training dynamics of Baichuan 2.Comment: Baichuan 2 technical report. Github: https://github.com/baichuan-inc/Baichuan

Vapor-assisted deposition of highly efficient, stable black-phase FAPbI3 perovskite solar cells

Mixtures of cations or halides with FAPbI3 (where FA is formamidinium) lead to high efficiency in perovskite solar cells (PSCs) but also to blue-shifted absorption and long-term stability issues caused by loss of volatile methylammonium (MA) and phase segregation. We report a deposition method using MA thiocyanate (MASCN) or FASCN vapor treatment to convert yellow δ-FAPbI3 perovskite films to the desired pure α-phase. NMR quantifies MA incorporation into the framework. Molecular dynamics simulations show that SCN- anions promote the formation and stabilization of α-FAPbI3 below the thermodynamic phase-transition temperature. We used these low-defect-density α-FAPbI3 films to make PSCs with >23% power-conversion efficiency and long-term operational and thermal stability, as well as a low (330 millivolts) open-circuit voltage loss and a low (0.75 volt) turn-on voltage of electroluminescence

Synthesis of Formate from CO2 Gas Catalyzed by an O2-Tolerant NAD-Dependent Formate Dehydrogenase and Glucose Dehydrogenase.

Direct biocatalytic conversion of CO2 to formic acid is an attractive means of reversibly storing energy in chemical bonds. Formate dehydrogenases (FDHs) are a heterogeneous group of enzymes that catalyze the oxidation of formic acid to carbon dioxide, generating two protons and two electrons. Several FDHs have recently been reported to catalyze the reverse reaction, i.e., the reduction of carbon dioxide to formic acid, under appropriate conditions. The main challenges with these enzymes are relatively low rates of CO2 reduction and high oxygen sensitivity. Our earlier studies (Yu et al. (2017) J. Biol. Chem. 292, 16872-16879) have shown that the FdsABG formate dehydrogenase from Cupriavidus necator is able to effectively catalyze the reduction of CO2, using NADH as a source of reducing equivalents, with a good oxygen tolerance. On the basis of this result, we have developed a highly thermodynamically efficient and cost-effective biocatalytic process for the transformation of CO2 to formic acid using FdsABG. We have  cloned the full-length soluble formate dehydrogenase (FdsABG) from C. necator and expressed it in Escherichia coli with a His-tag fused to the N terminus of the FdsG subunit; this overexpression system has greatly simplified the FdsABG purification process. Importantly, we have also combined this recombinant C. necator FdsABG with another enzyme, glucose dehydrogenase, for continuous regeneration of NADH for CO2 reduction and demonstrated that the combined system is highly effective in reducing CO2 to formate. The results indicate that this system shows significant promise for the future development of an enzyme-based system for the industrial reduction of CO2

Quantitative Characterization of the γ’ Phase Distribution in the Large-Scale Area of the Second-Generation Nickel-Based Single Crystal Blade DD5

Nickel-based single crystal superalloy blades have excellent high-temperature performance as the hot end part of the aero-engine turbine. The most important strengthening phase in the single crystal blade is the γ’ phase, and its morphology and size distribution directly affect the high temperature performance of the single crystal blade. In this work, scanning electron microscopy (SEM) was used to obtain the microscopic images of the γ’ phase in multiple large continuous fields of view in the transverse sections of single crystal blades, and the quantitative statistical characterization of the γ’ phase was performed by image segmentation method based on deep learning. The 20 μm × 20 μm region was selected from the primary dendrite arm, the secondary dendrite arm, and the interdendrite to statistically analyze the γ’ phases. The statistical results show that the average size of the γ’ phase at the position of the interdendrite is significantly larger than the average size of the γ’ phase at the position of the dendrite; the sizes of the γ’ phase at the primary dendrite arm, the secondary dendrite arm and the interdendrite all obey the normal distribution; about 3.17 × 107 γ’ phases are counted in 20 positions in the 5 transverse sections of the single crystal blade in a total area of 5 mm2, and the size, geometric morphology and area fraction of all γ’ phases are respectively counted. In this work, the quantitative parameters of the γ’ phases at 4 different positions of the section of the single crystal superalloy DD5 blade were compared, the size and area fraction of the γ’ phases at the leading edge and the trailing edge were smaller, and the shape of the γ’ phase of the leading edge and the trailing edge is closer to the cube

Cloning and analysis of 1-hydroxy-2-methyl-2-(E)-butenyl-4-diphosphate reductase genes HsHDR1 and HsHDR2 in Huperzia serrate

We cloned and analyzed the two genes of the 1-hydroxy-2-methyl-2-(E)-butenyl-4-diphosphate reductase (HDR) gene family from Huperzia serrate. The two transcripts coding HDR, named HsHDR1 and HsHDR2, were discovered in the transcriptome dataset of H. serrate and were cloned by reverse transcription-polymerase chain reaction (RT-PCR). The physicochemical properties, protein domains, protein secondary structure, and 3D structure of the putative HsHDR1 and HsHDR2 proteins were analyzed. The full-length cDNA of the HsHDR1 gene contained 1431 bp encoding a putative protein with 476 amino acids, whereas the HsHDR2 gene contained 1428 bp encoding a putative protein of 475 amino acids. These two proteins contained the conserved domain of 1-hydroxy-2-methyl-2-(E)-butenyl-4-diphosphate reductase (PF02401), but without the transmembrane region and signal peptide. The most abundant expression of HsHDR1 and HsHDR2 was detected in H. serrate roots, followed by the stems and leaves. Our results provide a foundation for exploring the function of HsHDR1 and HsHDR2 in terpenoid and sterol biosynthesis in Huperziaceae plants

Hydrazinium Salt as Additive To Improve Film Morphology and Carrier Lifetime for High-Efficiency Planar-Heterojunction Perovskite Solar Cells via One-Step Method

One-step solution process is the simplest method to fabricate organic-inorganic metal halide perovskite thin films, which however does not work well when employed in the planar-heterojunction (PHJ) solar cells due to the generally poor film morphology. Here we show that hydrazinium chloride can be used as an additive in the precursor solution to produce perovskite films featuring higher coverage and better crystallinity. The light absorption ability and charge carrier lifetime are both significantly improved accordingly. Under the optimal additive ratio, the average power conversion efficiency (PCE) of the inverted PHJ perovskite solar cells greatly increases by as much as 70%, and the champion device shows a satisfying PCE of 12.66%. These results suggest that N2H5Cl is a promising additive for fabricating high-efficiency perovskite solar cells via one-step method, which could be of interest in the future commercial solar cell industry.status: publishe

C-Cbl reverses HER2-mediated tamoxifen resistance in human breast cancer cells

Abstract Background Tamoxifen is a frontline therapy for estrogen receptor (ER)-positive breast cancer in premenopausal women. However, many patients develop resistance to tamoxifen, and the mechanism underlying tamoxifen resistance is not well understood. Here we examined whether ER-c-Src-HER2 complex formation is involved in tamoxifen resistance. Methods MTT and colony formation assays were used to measure cell viability and proliferation. Western blot was used to detect protein expression and protein complex formations were detected by immunoprecipitation and immunofluorescence. SiRNA was used to examine the function of HER2 in of BT474 cells. An in vivo xenograft animal model was established to examine the role of c-Cbl in tumor growth. Results MTT and colony formation assay showed that BT474 cells are resistant to tamoxifen and T47D cells are sensitive to tamoxifen. Immunoprecipitation experiments revealed ER-c-Src-HER2 complex formation in BT474 cells but not in T47D cells. However, ER-c-Src-HER2 complex formation was detected after overexpressing HER2 in T47D cells and these cells were more resistant to tamoxifen. HER2 knockdown by siRNA in BT474 cells reduced ER-c-Src-HER2 complex formation and reversed tamoxifen resistance. ER-c-Src-HER2 complex formation was also disrupted and tamoxifen resistance was reversed in BT474 cells by the c-Src inhibitor PP2 and HER2 antibody trastuzumab. Nystatin, a lipid raft inhibitor, reduced ER-c-Src-HER2 complex formation and partially reversed tamoxifen resistance. ER-c-Src-HER2 complex formation was disrupted by overexpression of c-Cbl but not by the c-Cbl ubiquitin ligase mutant. In addition, c-Cbl could reverse tamoxifen resistance in BT474 cells, but the ubiquitin ligase mutant had no effect. The effect of c-Cbl was validated in BT474 tumor-bearing nude mice in vivo. Immunofluorescence also revealed ER-c-Src-HER2 complex formation was reduced in tumor tissues of nude mice with c-Cbl overexpression. Conclusions Our results suggested that c-Cbl can reverse tamoxifen resistance in HER2-overexpressing breast cancer cells by inhibiting the formation of the ER-c-Src-HER2 complex