DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

The rapid development of open-source large language models (LLMs) has been truly remarkable. However, the scaling law described in previous literature presents varying conclusions, which casts a dark cloud over scaling LLMs. We delve into the study of scaling laws and present our distinctive findings that facilitate scaling of large scale models in two commonly used open-source configurations, 7B and 67B. Guided by the scaling laws, we introduce DeepSeek LLM, a project dedicated to advancing open-source language models with a long-term perspective. To support the pre-training phase, we have developed a dataset that currently consists of 2 trillion tokens and is continuously expanding. We further conduct supervised fine-tuning (SFT) and Direct Preference Optimization (DPO) on DeepSeek LLM Base models, resulting in the creation of DeepSeek Chat models. Our evaluation results demonstrate that DeepSeek LLM 67B surpasses LLaMA-2 70B on various benchmarks, particularly in the domains of code, mathematics, and reasoning. Furthermore, open-ended evaluations reveal that DeepSeek LLM 67B Chat exhibits superior performance compared to GPT-3.5

Biomechanical and tissue reaction: the effects of varying sutures size on canine abdominal wall stitching

ObjectiveLarger diameter sutures can provide sufficient tensile strength to surgical incisions but may exacerbate the inflammatory response caused by the amount of implanted foreign material. This experiment aims to investigate the differences in biomechanical stability and tissue reactivity after suturing canine midline abdominal incisions with different suture sizes.MethodAssessing the biomechanical differences between USP 2-0, 3-0, and 4-0 PGA sutures using uniaxial tensile testing on ex vivo canine midline skin and fascial muscle tissues using either a simple continuous or simple interrupted technique. mRNA and protein expression levels of inflammatory factors were measured through RT-PCR and ELISA. Tissue reactivity was evaluated using a semi-quantitative scoring system.ResultFor strains below 30% in skin and below 50% in muscle, there were no significant differences among groups. The results of skin biomechanical testing showed that the USP 4-0 PGA suture group demonstrated significantly lower maximum tensile strength compared to the USP 2-0 PGA or USP 3-0 PGA suture groups. However, it remained capable of providing at least 56.3 N (1.03 MPa) tensile strength for canine skin incisions, matching the tensile strength requirements of general canine abdominal wall surgical incisions. In addition, there were no statistically significant differences observed in the maximum tensile strength among different size of sutures according to the data of biomechanical testing in muscle. Larger diameter sutures led to increased levels of inflammatory factors (IL-1β, IL-6, TNF-ɑ) and tissue reactivity. Simple interrupted sutures caused higher levels of inflammatory factors in muscular tissue compared to simple continuous sutures.ConclusionUSP 4-0 PGA sutures provide sufficient biomechanical stability for suturing canine abdominal skin and linea alba. Suture size significantly influences tissue reactivity after suturing, with smaller gauge sutures reducing early tissue inflammatory response. Thus, USP 4-0 PGA suture has more advantages to suturing canine abdominal surgical incisions

Molecular Identification of the Glutaredoxin 5 Gene That Plays Important Roles in Antioxidant Defense in <i>Arma chinensis</i> (Fallou)

Glutaredoxin (Grx) is a group of redox enzymes that control reactive oxygen species (ROS), traditionally defined as redox regulators. Recent research suggested that members of the Grx family may be involved in more biological processes than previously thought. Therefore, we cloned the AcGrx5 gene and identified its role in A. chinensis diapause. Sequence analysis revealed the ORF of AcGrx5 was 432 bp, encoding 143 amino acids, which was consistent with the homologous sequence of Halyomorpha halys. RT-qPCR results showed that AcGrx5 expression was the highest in the head, and compared with non-diapause conditions, diapause conditions significantly increased the expression of AcGrx5 in the developmental stages. Further, we found that 15 °C low-temperature stress significantly induced AcGrx5 expression, and the expression of antioxidant enzyme genes AcTrx2 and AcTrx-like were significantly increased after AcGrx5 knockdown. Following AcGrx5 silencing, there was a considerable rise in the levels of VC content, CAT activity, and hydrogen peroxide content, indicating that A. chinensis was exposed to high levels of reactive oxygen species. These results suggested that the AcGrx5 gene may play a key role in antioxidant defense

Morphology of the male reproductive system and sperm ultrastructure of the green lacewing, Chrysopa pallens (Rambur, 1838) (Neuroptera: Chrysopidae)

Abstract Background Chrysopa pallens is one of the most beneficial and effective natural predators, and is famous for its extensive distribution, wide prey spectrum, and excellent reproductive performance. This study examined the anatomy and fine structure of the C. pallens reproductive system and spermatogenesis. Results The male reproductive system of C. pallens comprises a pair of testes, a vas deferens, seminal vesicles, accessory glands, and short ejaculatory ducts. The testes were already mature on the day of emergence, but the accessory glands did not mature until 5 days post-emergence. In early spermatids, the flagellum had an axoneme on one side of the two mitochondrial derivatives. The nucleus was surrounded by parallel crystalline and paracrystalline materials. The spermatid envelope extends towards the paracrystalline material in a tail-shaped wing. In mature spermatids, the axoneme is located between the two accessory bodies and mitochondrial derivative sets. The parallel-crystalline and paracrystalline materials disappeared. In the testes, the wall of seminal cysts consists of a layer of epithelium, a muscular-connective sheath, and several vesicles of different sizes. The mature seminal cysts contained 128 spermatozoa. The accessory gland is composed of six parts: ventral papilla-like protuberance, anterior glandular lobe, lateral glandular lobe, seminal cyst, posterior kidney-shaped lobe, and posterior papilla-like protuberance. Muscle fibers and secretory granules are extensive. Conclusions This study provides information on the reproductive system of C. pallens and offers a resource for taxonomy and reproductive biology

Reactive Oxygen Species Mediate Low Back Pain by Upregulating Substance P in Intervertebral Disc Degeneration

Reactive oxygen species (ROS) are thought to have a strong correlation with a number of intervertebral disc (IVD) diseases. Here, we aimed to determine whether ROS represent an etiology of low back pain (LBP) during IVD degeneration. Thirty degenerated intervertebral disc samples were obtained from patients, and ROS levels were quantified using dihydroethidium (DHE) staining. The results suggested a significant correlation between the ROS level and the severity of LBP. Subsequently, a puncture-induced LBP model was established in rats, and ROS levels significantly increased compared with those in the sham surgery group, accompanied with severe puncture-induced IVD degeneration. In addition, when ROS levels were increased by H2O2 administration or decreased by NAC treatment, the rats showed increased or decreased LBP, respectively. Based on this evidence, we further determined that stimulation with H2O2 in nucleus pulposus cells (NPCs) in vivo or in vitro resulted in upregulation of substance P (SP), a peptide thought to be involved in the synaptic transmission of pain, and that the severity of LBP decreased when SP levels were increased by exogenous SP administration or neutralized via aprepitant treatment in the IVDs of rats. In conclusion, ROS are primary inducers of LBP based on clinical and animal data, and the mechanism involves ROS stimulation of NPCs to secrete SP, which is a critical neurotransmitter peptide, to promote LBP in IVDs. Therefore, reducing the level of ROS with specific drugs and inhibiting SP may be alternative methods to treat LBP in the clinic

Optimization of the Natural Gas Purification Process Based on Exergy Analysis

This study is aimed at carrying out investigations on a domestic gas field, located in Yanchang, China, with a view to optimize the natural gas purification process. The main objectives of this work are (i) to reduce the natural gas purification system’s energy consumption and (ii) improve the existing purification levels. Process simulations were carried out using Aspen Plus™ software, and a comprehensive technical and economic analysis was carried out. The single-factor sensitivity analysis method was used to determine the parameters of absorption, such as the reflux ratio and number of stages. The heat transfer process was analyzed using the energy-saving method of the energy system, and a modified process was recommended. The optimization results show that the recommended system has better purification performance, the comprehensive energy consumption is effectively reduced, and the energy efficiency is improved by 9%

Analysis of LRRK2, SNCA, and ITGA8 Gene Variants with Sporadic Parkinson’s Disease Susceptibility in Chinese Han Population

Background. Parkinson’s disease (PD) is an age-related neurodegenerative disease affected by multiple genetic and environmental factors. We performed a case-control study on candidate gene to scrutinize whether genetic variants in LRRK2, SNCA, and ITGA8 genes could be associated with sporadic PD in Chinese Han population. Methods. Five single-nucleotide polymorphisms (SNPs) of LRRK2 (rs1491942), SNCA (rs2301134, rs2301135, and rs356221), and ITGA8 (rs7077361) were selected and genotyped among 583 unrelated PD patients and 558 healthy controls. Results. Rs1491942 of LRRK2 gene had a significantly higher genotype frequency (P=3.543E-09) and allelic G/C frequencies (P=2.601E-10) in PD patients than controls. Rs2301135 of SNCA gene also showed an obvious difference in genotype frequency (P=4.394E-07) and allelic G/C frequencies (P=9.116E-13) between PD patients and controls. SNPs rs2301134 and rs356221 of SNCA gene and rs7077361 of ITGA8 gene lacked the significant association with the susceptibility of PD in Chinese Han population. Conclusions. Our study firstly expresses that rs1491942 of LRRK2 and rs2301135 of SNCA gene are substantially associated with sporadic Parkinson’s disease in Chinese Han population

A Mechanism Exploration for the Yi-Fei-San-Jie Formula against Non-Small-Cell Lung Cancer Based on UPLC-MS/MS, Network Pharmacology, and In Silico Verification

Non-small-cell lung cancer (NSCLC) is one of the most prevalent cancers worldwide. A Yi-Fei-San-Jie formula (YFSJF), widely used in NSCLC treatment in south China, has been validated in clinical studies. However, the pharmacological mechanism behind it remains unclear. In this study, 73 compounds were identified using ultraperformance liquid chromatography-tandem mass spectrometry (UPLC-MS/MS), with 58 enrolled in network pharmacology. The protein-protein interaction network, functional enrichment analysis, and compound-target-pathway network were constructed using 74 overlapping targets from 58 drugs and NSCLC. YFSJF has many targets and pathways in the fight against NSCLC. PIK3R1, PIK3CA, and AKT1 were identified as key targets, and the PI3K/AKT pathway was identified as the key pathway. According to the Human Protein Atlas (THPA) database and the Kaplan–Meier Online website, the three key targets had varying expression levels in normal and abnormal tissues and were linked to prognosis. Molecular docking and dynamics simulations verified that hub compounds have a strong affinity with three critical targets. This study revealed multiple compounds, targets, and pathways for YFSJF against NSCLC and suggested that YFSJF might inhibit PIK3R1, PIK3CA, and AKT1 to suppress the PI3K/AKT pathway and play its pharmacological role

Soybean Root-Derived Hierarchical Porous Carbon as Electrode Material for High-Performance Supercapacitors in Ionic Liquids

Soybeans are extensively cultivated worldwide as human food. However, large quantities of soybean roots (SRs), which possess an abundant three-dimensional (3D) structure, remain unused and produce enormous pressure on the environment. Here, 3D hierarchical porous carbon was prepared by the facile carbonization of SRs followed by chemical activation. The as-prepared material, possessing large specific surface area (2143 m² g^–1), good electrical conductivity, and unique 3D hierarchical porosity, shows outstanding electrochemical performance as an electrode material for supercapacitors, such as a high capacitance (276 F g^–1 at 0.5 A g^–1), superior cycle stability (98% capacitance retention after 10,000 cycles at 5 A g^–1), and good rate capability in a symmetric two-electrode supercapacitor in 6 M KOH. Furthermore, the maximum energy density of as-assembled symmetric supercapacitor can reach 100.5 Wh kg^–1 in neat EMIM BF₄. Moreover, a value of 40.7 Wh kg^–1 is maintained at ultrahigh power density (63000 W kg^–1). These results show that the as-assembled supercapacitor can simultaneously deliver superior energy and power density