DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

The rapid development of open-source large language models (LLMs) has been truly remarkable. However, the scaling law described in previous literature presents varying conclusions, which casts a dark cloud over scaling LLMs. We delve into the study of scaling laws and present our distinctive findings that facilitate scaling of large scale models in two commonly used open-source configurations, 7B and 67B. Guided by the scaling laws, we introduce DeepSeek LLM, a project dedicated to advancing open-source language models with a long-term perspective. To support the pre-training phase, we have developed a dataset that currently consists of 2 trillion tokens and is continuously expanding. We further conduct supervised fine-tuning (SFT) and Direct Preference Optimization (DPO) on DeepSeek LLM Base models, resulting in the creation of DeepSeek Chat models. Our evaluation results demonstrate that DeepSeek LLM 67B surpasses LLaMA-2 70B on various benchmarks, particularly in the domains of code, mathematics, and reasoning. Furthermore, open-ended evaluations reveal that DeepSeek LLM 67B Chat exhibits superior performance compared to GPT-3.5

Research Progress on Controlled Low-Strength Materials: Metallurgical Waste Slag as Cementitious Materials

Increasing global cement and steel consumption means that a significant amount of greenhouse gases and metallurgical wastes are discharged every year. Using metallurgical waste as supplementary cementitious materials (SCMs) shows promise as a strategy for reducing greenhouse gas emissions by reducing cement production. This strategy also contributes to the utilization and management of waste resources. Controlled low-strength materials (CLSMs) are a type of backfill material consisting of industrial by-products that do not meet specification requirements. The preparation of CLSMs using metallurgical waste slag as the auxiliary cementing material instead of cement itself is a key feature of the sustainable development of the construction industry. Therefore, this paper reviews the recent research progress on the use of metallurgical waste residues (including blast furnace slag, steel slag, red mud, and copper slag) as SCMs to partially replace cement, as well as the use of alkali-activated metallurgical waste residues as cementitious materials to completely replace cement for the production of CLSMs. The general background information, mechanical features, and properties of pozzolanic metallurgical slag are introduced, and the relationship and mechanism of metallurgical slag on the performance and mechanical properties of CLSMs are analyzed. The analysis and observations in this article offer a new resource for SCM development, describe a basis for using metallurgical waste slag as a cementitious material for CLSM preparation, and offer a strategy for reducing the environmental problems associated with the treatment of metallurgical waste

Isolation and Characterization of the First Freshwater Cyanophage Infecting Pseudanabaena

10.1128/JVI.00682-20JOURNAL OF VIROLOGY941

Occurrence and Fate of Benzophenone-Type UV Filters in a Tropical Urban Watershed

The study investigated the occurrence and fate of seven benzophenone-type UV filters (i.e., 2,4-dihydroxybenzophenone (2,4OH-BP), 2,2′,4,4′-tetrahydroxybenzophenone (2,2′,4,4′OH-BP), 2-hydroxy-4-methoxybenzophenone (2OH-4MeO-BP), 2,2′-Dihydroxy-4,4′-dimethoxybenzophenone (2,2′OH-4,4′MeO-BP), 2,2′-dihydroxy-4-methoxybenzophenone (2,2′OH-4MeO-BP), 4-hydroxybenzophenone (4OH-BP), and 4,4′-dihyroxybenzophenone (4DHB)) in a tropical urban watershed consisting of five major tributaries that discharge into a well-managed basin. Total benzophenone concentrations (∑C_BPs) varied from 19−230.8 ng L^–1 in overlying bulk water, 48–115 ng L^–1 in pore water, 295–5813 ng g^–1 dry weight (d.w.) in suspended solids, and 6−37 ng g^–1 d.w. in surficial sediments, respectively. The tributaries (∑C_BPs: 19–231 ng L^–1) were the main source of benzophenone compounds entering the basin (∑C_BPs: 20–81 ng L^–1). In the water column, the vertical concentration profile in the aqueous phase was uniform while concentrations in the suspended solids decreased with depth. Different distribution profiles were also identified for benzophenones in suspended solids and sediments. A preliminary risk assessment suggested that the seven BPs were unlikely to pose ecotoxicological risks to local aquatic organisms except for 2OH-4MeO-BP in the case of an intermittent release