Aurora:Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning

Existing research has demonstrated that refining large language models (LLMs) through the utilization of machine-generated instruction-following data empowers these models to exhibit impressive zero-shot capabilities for novel tasks, without requiring human-authored instructions. In this paper, we systematically investigate, preprocess, and integrate three Chinese instruction-following datasets with the aim of enhancing the Chinese conversational capabilities of Mixtral-8x7B sparse Mixture-of-Experts model. Through instruction fine-tuning on this carefully processed dataset, we successfully construct the Mixtral-8x7B sparse Mixture-of-Experts model named "Aurora." To assess the performance of Aurora, we utilize three widely recognized benchmark tests: C-Eval, MMLU, and CMMLU. Empirical studies validate the effectiveness of instruction fine-tuning applied to Mixtral-8x7B sparse Mixture-of-Experts model. This work is pioneering in the execution of instruction fine-tuning on a sparse expert-mixed model, marking a significant breakthrough in enhancing the capabilities of this model architecture. Our code, data and model are publicly available at https://github.com/WangRongsheng/AuroraComment: 10 pages, 2 figure

Effectiveness of neoadjuvant immunochemotherapy compared to neoadjuvant chemotherapy in non-small cell lung cancer patients: Real-world data of a retrospective, dual-center study

BackgroundStudying the application of neoadjuvant immunochemotherapy (NICT) in the real world and evaluating its effectiveness and safety in comparison with neoadjuvant chemotherapy (NCT) are critically important.MethodsThis study included the II-IIIB stage non-small cell lung cancer (NSCLC) patients receiving NCT with or without PD-1 inhibitors and undergoing surgery after neoadjuvant treatments between January 2019 to August 2022. The clinical characteristics and treatment outcomes were retrospectively reviewed and analyzed.ResultsA total of 66 patients receiving NICT and 101 patients receiving NCT were included in this study. As compared to NCT, NICT showed similar safety while not increasing the surgical difficulty. The ORR in the NICT and NCT groups was 74.2% and 53.5%, respectively, P = 0.009. A total of 44 patients (66.7%) in the NICT group and 21 patients (20.8%) in the NCT group showed major pathology response (MPR) (P <0.001). The pathology complete response (pCR) rate was also significantly higher in NICT group than that in NCT group (45.5% vs. 10.9%, P <0.001). After Propensity Score Matching (PSM), 42 pairs of patients were included in the analysis. The results showed no significant difference in the ORR between the two groups (52.3% vs. 43.2%, P = 0.118), and the proportions of MPR (76.2%) and pCR (50.0%) in NICT group were significantly higher than those of MPR (11.9%) and pCR (4.7%) in the NCT group (P <0.001). The patients with driver mutations might also benefit from NICT.ConclusionsAs compared to NCT, the NICT could significantly increase the proportions of patients with pCR and MPR without increasing the operation-related bleeding and operation time

Detecting causal relationships between fine particles and ozone based on observations in four typical cities of China

As the concentration of fine particles (PM _2.5 ) is declining, ozone (O _3 ) concentration has been increasing in China in recent years. To collaboratively control PM _2.5 and O _3 , it is critical to understand the relationship between the two and identify major controlling factors. We use a convergent cross-mapping method to detect the causal relationship between daily PM _2.5 and maximum daily 8 h average (MDA8) O _3 concentrations in Beijing, Taizhou, Shenzhen and Chengdu, China, in the four seasons in 2015–2021. In addition, we also examined causal effects of atmospheric oxidation capacity, precursors and meteorological elements on PM _2.5 and MDA8 O _3 in the four cities. PM _2.5 and MDA8 O _3 are strongly positively correlated and show bidirectional causal relationships during the Beijing and Taizhou summer and in the four seasons in Shenzhen, due mainly to the strong photochemical reactions in the daytime. During the Beijing winter, PM _2.5 and MDA8 O _3 show bidirectional causal relationships, but the two are significantly negatively correlated, driven by NO _2 and relative humidity. Weak bidirectional, unidirectional and no causal effects between PM _2.5 and MDA8 O _3 are detected in other seasons in the four cities. In these seasons and cities, the top three causal factors of PM _2.5 differ from those of MDA8 O _3 . Season-, city- and pollutant-specific control measures of PM _2.5 and MDA8 O _3 are required

A Bi-Level Programming Model for the Railway Express Cargo Service Network Design Problem

Service network design is fundamentally crucial for railway express cargo transportation. The main challenge is to strike a balance between two conflicting objectives: low network setup costs and high expected operational incomes. Different configurations of these objectives will have different impacts on the quality of freight transportation services. In this paper, a bi-level programming model for the railway express cargo service network design problem is proposed. The upper-level model forms the optimal decisions in terms of the service characteristics, and the low-level model selects the service arcs for each commodity. The rail express cargo is strictly subject to the service commitment, the capacity restriction, flow balance constraints, and logical relationship constraints among the decisions variables. Moreover, linearization techniques are used to convert the lower-level model to a linear one so that it can be directly solved by a standard optimization solver. Finally, a real-world case study based on the Beijing–Guangzhou Railway Line is carried out to demonstrate the effectiveness and efficiency of the proposed solution approach

Hydrologic Evaluation of TRMM and GPM IMERG Satellite-based Precipitation in a Humid Basin of China

Tropical Rainfall Measurement Mission (TRMM) is one of the most popular global high resolution satellite-based precipitation products with a goal of measuring precipitation over the oceans and tropics. However, in recent years, the TRMM mission has come to an end. Its successor, Global Precipitation Measurement (GPM) mission was launched to measure the earth’s precipitation structure, with an aim to improve upon the TRMM project. Both of the precipitation products have their own strengths and weaknesses in resolution, accuracy, and availability. The aim of this study is to evaluate the hydrologic utilization of the TRMM and GPM products in a humid basin of China. The main findings of this study can be summarized as follows: (1) 3B42V7 generally outperforms 3B42V6 in terms of hydrologic performance. Meanwhile, 3B42RTV7 significantly outperforms 3B42RTV6, and showed close performance with the bias-adjusted TRMM Multi-satellite Precipitation Analysis (TMPA) products. (2) The GPM showed better agreement with gauge observation than the TMPA products with lower RB and higher correlation coefficient (CC) values at different time scales. (3) The VIC hydrological model generally outperformed the XAJ hydrological model with lower RB, higher Nash–Sutcliffe Coefficient of Efficiency (NSCE) and CC values; though the 3B42RTV6 and 3B42RTV7 showed higher CC values in simulating the streamflow hydrograph by using the VIC and XAJ hydrological models. It can be found that the conceptual hydrological model was enough for the hydrologic evaluation of TRMM and GPM IMERG satellite-based precipitation in a humid basin of China. This study provides a reference for the comparison of multiple models on watershed scale

Evaluation of TMPA satellite precipitation in driving VIC hydrological model over the upper Yangtze river basin

Although the Tropical Rainfall Measurement Mission (TRMM) has come to an end, the evaluation of TRMM satellite precipitation is still of great significance for the improvement of the Global Precipitation Measurement (GPM). In this paper, the hydrological utility of TRMM Multi-satellite Precipitation Analysis (TMPA) 3B42 RTV7/V7 precipitation products was evaluated using the variable infiltration capacity (VIC) hydrological model in the upper Yangtze River basin. The main results show that (1) TMPA 3B42V7 had a reliable performance in precipitation estimation compared with the gauged precipitation on both spatial and temporal scales over the upper Yangtze River basin. Although TMPA 3B42V7 slightly underestimated precipitation, TMPA 3B42RTV7 significantly overestimated precipitation at daily and monthly time scales; (2) the simulated runoff by the VIC hydrological model showed a high correlation with the gauged runoff and lower bias at daily and monthly time scales. The Nash–Sutcliffe coefficient of efficiency (NSCE) value was as high as 0.85, the relative bias (RB) was −6.36% and the correlation coefficient (CC) was 0.93 at the daily scale; (3) the accuracy of the 3B42RTV7-driven runoff simulation had been greatly improved by using the hydrological calibration parameters obtained from 3B42RTV7 compared with that of gauged precipitation. A lower RB (14.38% vs. 66.58%) and a higher CC (0.87 vs. 0.85) and NSCE (0.71 vs. −0.92) can be found at daily time scales when we use satellite data instead of gauged precipitation data to calibrate the VIC model. However, the performance of the 3B42V7-driven runoff simulation did not improve in the same operation accordingly. The cause might be that the 3B42V7 satellite products have been adjusted by gauged precipitation. This study suggests that it might be better to calibrate the parameters using satellite data in hydrological simulations, especially for unadjusted satellite data. This study is not only helpful for understanding the assessment of multi-satellite precipitation products in large-scale and complex areas in the upper reaches of the Yangtze River, but also can provide a reference for the hydrological utility of the satellite precipitation products in other river basins of the world

A study of the car-to-train assignment problem for rail express cargos in the scheduled and unscheduled train services network.

A freight train service network generally involves two categories of trains: unscheduled trains, whose operating frequencies fluctuate with the freight demand, and scheduled trains, which are operated based on regular timetables similar to passenger trains. The timetables for scheduled trains are released to the public once determined, and they are not influenced by the freight demand. Typically, the total capacity of scheduled trains can satisfy the predicted average demand of express cargos. However, in practice, the demand always changes. Therefore, a method to assign the shipments to scheduled and unscheduled train services has become an important issue faced in railway transportation. This paper focuses on the coordinated optimization of rail express cargo assignment in a hybrid train services network. On the premise of fully utilizing the capacity of scheduled train services, we propose a car-to-train assignment model to reasonably assign rail express cargos to scheduled and unscheduled trains. The objective aims to maximize the profit of transporting the rail express cargos. The constraints include the capacity restriction on the service arcs, flow balance constraints, transportation due date constraints and logical relationship constraints among the decision variables. Furthermore, we discuss a linearization technique to convert the nonlinear transportation due date constraint into a linear constraint, making it possible to solve by a standard optimization solver. Finally, an illustrative case study based on the Beijing-Guangzhou Railway Line is carried out to demonstrate the effectiveness and efficiency of the proposed solution approach

Prevalence and characteristics of COPD among pneumoconiosis patients at an occupational disease prevention institute: a cross-sectional study

Abstract Background Pneumoconiosis may play an important role in the development of chronic obstructive pulmonary disease (COPD), and the complication of COPD may impose a heavy burden of illness. Methods The study was conducted in Hunan Province in China from December 1, 2015, to December 1, 2016. Consecutive underground male pneumoconiosis patients employed for at least 1 year were recruited from the Hunan Occupational Disease Prevention Institute. Patient information, respiratory symptoms and clinical data were collected using a structured questionnaire. The diagnosis of COPD were assessed using the Global Initiative for Chronic Obstructive Lung Disease (GOLD) criteria. Logistic regression analyses were conducted to examine the clinical and demographic risk factors of COPD among pneumoconiosis patients. Results The prevalence of COPD in our sample of pneumoconiosis patients was 18.65% (119/638). In pneumoconiosis patients with and without smoking history, the prevalence of COPD was 19.32 and 16.77%. Compared with non-COPD patients, those with COPD are older in age, have longer exposure time, have lower body mass index (BMI), have a higher smoking index and have worse pulmonary function (all p < 0.05). For the five respiratory symptoms (cough, sputum, wheeze, dyspnea, and chest tightness), only the presence of wheeze and the severity scores for wheeze or dyspnea showed significant differences between the COPD and non-COPD groups (p < 0.01). Multivariate logistic regression analysis revealed that advanced pneumoconiosis category, older age and the presence of wheeze symptoms were significant risk factors for the development of COPD among pneumoconiosis patients. Conclusion Pneumoconiosis patients are at a high risk of COPD, and pneumoconiosis patients with COPD may suffer more severe respiratory symptoms, such as wheeze and dyspnea, than patients without COPD. Advanced pneumoconiosis category, older age and the presence of wheeze symptoms are associated with an increased risk of COPD in pneumoconiosis. We proposed that a routine assessment of lung function is necessary for timely and adequate clinical management