CodeApex: A Bilingual Programming Evaluation Benchmark for Large Language Models

With the emergence of Large Language Models (LLMs), there has been a significant improvement in the programming capabilities of models, attracting growing attention from researchers. We propose CodeApex, a bilingual benchmark dataset focusing on the programming comprehension and code generation abilities of LLMs. CodeApex comprises three types of multiple-choice questions: conceptual understanding, commonsense reasoning, and multi-hop reasoning, designed to evaluate LLMs on programming comprehension tasks. Additionally, CodeApex utilizes algorithmic questions and corresponding test cases to assess the code quality generated by LLMs. We evaluate 14 state-of-the-art LLMs, including both general-purpose and specialized models. GPT exhibits the best programming capabilities, achieving approximate accuracies of 50% and 56% on the two tasks, respectively. There is still significant room for improvement in programming tasks. We hope that CodeApex can serve as a reference for evaluating the coding capabilities of LLMs, further promoting their development and growth. Datasets are released at https://github.com/APEXLAB/CodeApex.git. CodeApex submission website is https://apex.sjtu.edu.cn/codeapex/.Comment: 21 page

Assessment of the Relationship between Land Use and Flood Risk Based on a Coupled Hydrological–Hydraulic Model: A Case Study of Zhaojue River Basin in Southwestern China

As an ecological consequence of intensified anthropogenic activities, more frequent extreme rainfalls have resulted in significant increases in water levels and discharge in southwestern China. This phenomenon presents a significant challenge in flood risk and ecological management. Land use is one of the major factors significantly affecting the flooding process, and it is inextricably tied to the ecological risk of floods. Hence, flood risk estimates based on land use are essential for flood control and land use planning. In this study, a coupled hydrologic–hydraulic model was developed to analyze the relationship between flood ecological risk and land use in order to provide new insights into current flood risk management practices. Ten real flood events (of different magnitudes) in the Zhaojue river basin (650 km2) were chosen to evaluate the credibility and performance of the coupled model’s application. Promising results were obtained, with sufficient reliability for flood risk assessment purposes. The results of our flood risk analysis also indicated that the model effectively reproduced overland flow and competently accounted for flood evolution. This work is significant in the understanding of the mechanism of the flood process and its relationship with land use, and it can be used in decision support for the prevention and mitigation of flood disasters and for land use planning

Land-Use-Based Runoff Yield Method to Modify Hydrological Model for Flood Management: A Case in the Basin of Simple Underlying Surface

The study of runoff under the influence of human activities is a research hot spot in the field of water science. Land-use change is one of the main forms of human activities and it is also the major driver of changes to the runoff process. As for the relationship between land use and the runoff process, runoff yield theories pointed out that the runoff yield capacity is spatially heterogeneous. The present work hypothesizes that the distribution of the runoff yield can be divided by land use, which is, areas with the same land-use type are similar in runoff yield, while areas of different land uses are significantly different. To prove it, we proposed a land-use-based framework for runoff yield calculations based on a conceptual rainfall–runoff model, the Xin’anjiang (XAJ) model. Based on the framework, the modified land-use-based Xin’anjiang (L-XAJ) model was constructed by replacing the yielding area (f/F) in the water storage capacity curve of the XAJ model with the area ratio of different land-use types (L/F; L is the area of specific land-use types, F is the whole basin area). The L-XAJ model was then applied to the typical cultivated–urban binary land-use-type basin (Taipingchi basin) to evaluate its performance. Results showed great success of the L-XAJ model, which demonstrated the area ratio of different land-use types can represent the corresponding yielding area in the XAJ model. The L-XAJ model enhanced the physical meaning of the runoff generation in the XAJ model and was expected to be used in the sustainable development of basin water resources

Land-Use-Based Runoff Yield Method to Modify Hydrological Model for Flood Management: A Case in the Basin of Simple Underlying Surface

The study of runoff under the influence of human activities is a research hot spot in the field of water science. Land-use change is one of the main forms of human activities and it is also the major driver of changes to the runoff process. As for the relationship between land use and the runoff process, runoff yield theories pointed out that the runoff yield capacity is spatially heterogeneous. The present work hypothesizes that the distribution of the runoff yield can be divided by land use, which is, areas with the same land-use type are similar in runoff yield, while areas of different land uses are significantly different. To prove it, we proposed a land-use-based framework for runoff yield calculations based on a conceptual rainfall–runoff model, the Xin’anjiang (XAJ) model. Based on the framework, the modified land-use-based Xin’anjiang (L-XAJ) model was constructed by replacing the yielding area (f/F) in the water storage capacity curve of the XAJ model with the area ratio of different land-use types (L/F; L is the area of specific land-use types, F is the whole basin area). The L-XAJ model was then applied to the typical cultivated–urban binary land-use-type basin (Taipingchi basin) to evaluate its performance. Results showed great success of the L-XAJ model, which demonstrated the area ratio of different land-use types can represent the corresponding yielding area in the XAJ model. The L-XAJ model enhanced the physical meaning of the runoff generation in the XAJ model and was expected to be used in the sustainable development of basin water resources