Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard

This paper presents a performance comparison of three large language models (LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard, on the VNHSGE English dataset. The results show that BingChat is better than ChatGPT and Bard. Therefore, BingChat and Bard can replace ChatGPT while ChatGPT is not yet officially available in Vietnam. The results also indicate that ChatGPT, Bing Chat, and Bard outperform Vietnamese students in English language proficiency. The findings of this study contribute to the understanding of the potential of LLMs in English language education. The remarkable performance of ChatGPT, Bing Chat, and Bard demonstrates their potential as effective tools for teaching and learning English at the high school level.Comment: 11 pages, 8 figures. arxiv admin note: substantial text overlap with arXiv: 2305.1219

ChatGPT is Good but Bing Chat is Better for Vietnamese Students

This study examines the efficacy of two SOTA large language models (LLMs), namely ChatGPT and Microsoft Bing Chat (BingChat), in catering to the needs of Vietnamese students. Although ChatGPT exhibits proficiency in multiple disciplines, Bing Chat emerges as the more advantageous option. We conduct a comparative analysis of their academic achievements in various disciplines, encompassing mathematics, literature, English language, physics, chemistry, biology, history, geography, and civic education. The results of our study suggest that BingChat demonstrates superior performance compared to ChatGPT across a wide range of subjects, with the exception of literature, where ChatGPT exhibits better performance. Additionally, BingChat utilizes the more advanced GPT-4 technology in contrast to ChatGPT, which is built upon GPT-3.5. This allows BingChat to improve to comprehension, reasoning and generation of creative and informative text. Moreover, the fact that BingChat is accessible in Vietnam and its integration of hyperlinks and citations within responses serve to reinforce its superiority. In our analysis, it is evident that while ChatGPT exhibits praiseworthy qualities, BingChat presents a more apdated solutions for Vietnamese students.Comment: 13 pages; 6 figure

Investigating the Effectiveness of ChatGPT in Mathematical Reasoning and Problem Solving: Evidence from the Vietnamese National High School Graduation Examination

This study offers a complete analysis of ChatGPT's mathematics abilities in responding to multiple-choice questions for the Vietnamese National High School Graduation Examination (VNHSGE) on a range of subjects and difficulty levels. The dataset included 250 questions divided into four levels: knowledge (K), comprehension (C), application (A), and high application (H), and it included ten themes that covered diverse mathematical concepts. The outcomes demonstrate that ChatGPT's performance varies depending on the difficulty level and subject. It performed best on questions at Level (K), with an accuracy rate of $83\%$; but, as the difficulty level rose, it scored poorly, with an accuracy rate of $10\%$. The study has also shown that ChatGPT significantly succeeds in providing responses to questions on subjects including exponential and logarithmic functions, geometric progression, and arithmetic progression. The study found that ChatGPT had difficulty correctly answering questions on topics including derivatives and applications, spatial geometry, and Oxyz spatial calculus. Additionally, this study contrasted ChatGPT outcomes with Vietnamese students in VNHSGE and in other math competitions. ChatGPT dominated in the SAT Math competition with a success rate of $70\%$, followed by VNHSGE mathematics ($58.8\%)$. However, its success rates were lower on other exams, such as AP Statistics, the GRE Quantitative, AMC 10, AMC 12, and AP Calculus BC. These results suggest that ChatGPT has the potential to be an effective teaching tool for mathematics, but more work is needed to enhance its handling of graphical data and address the challenges presented by questions that are getting more challenging.Comment: 17 pages, 14 image

Réduction de la traînée de l'écoulement de Poiseuille 2D par asservissement visuel partitionné

International audienceCet article propose une nouvelle approche de la commande en boucle fermée d'un écoulement fluide. Elle repose sur une estimation de l'état de l'écoulement via un capteur de vision, comme nous l'avons initialement proposé dans des travaux précédents. Puisque cette façon de faire repose sur l'utilisation d'informations visuelles, nous nous proposons ici d'utiliser les techniques dites d'asservissement visuel que nous appliquons au problème de la minimisation de la traînée de l'écoulement de Poiseuille 2D. Cependant, contrairement à la littérature du domaine, nous minimisons aussi la densité d'énergie cinétique de l'écoulement. Cela est de toute importance puisqu'une augmentation de cette densité d'énergie peut amener l'écoulement à devenir turbulent. Le schéma de commande est basé sur une synthèse de la loi de commande par asservissement visuel partitionné. Des résultats de simulation valident l'approche proposée. Nous comparons également nos résultats avec les techniques les plus pertinentes proposées dans la littérature

Minimisation de l'énergie cinétique transitoire dans l'écoulement 3D plan de Poiseuille commandé

La commande d’un écoulement fluide vise, d’une façon générale, à modifier son état courant pour l’amener à un état désiré ou, plus simplement, de le maintenir dans cet état désiré quelles que soient les perturbations extérieures et cela dans un but clairement identifié. Les retombées potentielles sont extrêmement nombreuses, et ce dans divers domaines d’activités, en particulier dans le domaine des transports qu’ils soient routiers, maritimes ou aériens. En effet, limiter la traînée lors du déplacement d’un engin motorisé permet de limiter significativement sa consommation de carburant. Des retombées importantes sont également attendues dans d’autres secteurs d’activité comme en génie chimique, dans le domaine militaire, ou encore dans le domaine de l’agriculture raisonnée. Dans cet article nous nous intéressons à la minimisation de l’énergie cinétique transitoire, due à une perturbation extérieure, d’un écoulement supposé en régime laminaire instable. Il s’agit là d’un problème générique de toute importance. En effet, une augmentation substantielle de l’énergie cinétique de la perturbation peut conduire à une transition vers la turbulence, ce qui est à proscrire totalement dans ce cas de figure. Toutefois, ce problème est très complexe dans le cas d’un système sous-actionné [1], comme c’est le cas de l’écoulement plan de Poiseuille 2D [2]. Dans ce contexte, nous montrons tout d’abord comment il est possible d’augmenter le nombre de degrés de liberté commandés d’un tel écoulement, puis nous proposons une loi de commande localement découplante permettant d’assurer une décroissance stricte de l’énergie cinétique. [1] J. F. Whidborne and J. McKernan, “On the minimization of Maximum Transient Energy Growth”, IEEE Trans. on Automatic Control, 52(9): 1762-1767, 2007. [2] S. Joshi, J. Speyer, and J. Kim, “A systems theory approach to the feedback stabilization on infinitesimal and finite amplitude disturbances in plane Poiseuille flow”, Journal of Fluid Mechanics, vol. 332, pp. 157-184, 199

Simultaneous Drag Reduction and Kinetic Energy Density of the Plane Poiseuille Flow

[Departement_IRSTEA]Ecotechnologies [TR1_IRSTEA]SPEEInternational audienceWe present in this paper a closed-loop approach to control the 2D plane Poiseuille flow in an unstable state. To do that, we propose to use a vision-based approach as proposed in our previous paper on this subject to estimate the state of the flow. The first step is based on the evaluation of the 2D velocity field from optical flow measurements. These measurements are next used into a visual servo control scheme. However, since we are interested in the simultaneous minimization of two quantities, that is the drag and kinetic energy density of the flow, we propose to design a control law based on an advanced visual servo control approach, the so-called partitioned visual servo control, first proposed in the robotics community. Simulations results validate our control scheme, including the case where noisy measurements are considered. We also compare our approaches with the most relevant ones

Can ChatGPT pass the Vietnamese National High School Graduation Examination?

This research article highlights the potential of AI-powered chatbots in education and presents the results of using ChatGPT, a large language model, to complete the Vietnamese National High School Graduation Examination (VNHSGE). The study dataset included 30 essays in the literature test case and 1,700 multiple-choice questions designed for other subjects. The results showed that ChatGPT was able to pass the examination with an average score of 6-7, demonstrating the technology's potential to revolutionize the educational landscape. The analysis of ChatGPT performance revealed its proficiency in a range of subjects, including mathematics, English, physics, chemistry, biology, history, geography, civic education, and literature, which suggests its potential to provide effective support for learners. However, further research is needed to assess ChatGPT performance on more complex exam questions and its potential to support learners in different contexts. As technology continues to evolve and improve, we can expect to see the use of AI tools like ChatGPT become increasingly common in educational settings, ultimately enhancing the educational experience for both students and educators.Comment: 9 pages, 13 figures, 4 table

VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models

The VNHSGE (VietNamese High School Graduation Examination) dataset, developed exclusively for evaluating large language models (LLMs), is introduced in this article. The dataset, which covers nine subjects, was generated from the Vietnamese National High School Graduation Examination and comparable tests. 300 literary essays have been included, and there are over 19,000 multiple-choice questions on a range of topics. The dataset assesses LLMs in multitasking situations such as question answering, text generation, reading comprehension, visual question answering, and more by including both textual data and accompanying images. Using ChatGPT and BingChat, we evaluated LLMs on the VNHSGE dataset and contrasted their performance with that of Vietnamese students to see how well they performed. The results show that ChatGPT and BingChat both perform at a human level in a number of areas, including literature, English, history, geography, and civics education. They still have space to grow, though, especially in the areas of mathematics, physics, chemistry, and biology. The VNHSGE dataset seeks to provide an adequate benchmark for assessing the abilities of LLMs with its wide-ranging coverage and variety of activities. We intend to promote future developments in the creation of LLMs by making this dataset available to the scientific community, especially in resolving LLMs' limits in disciplines involving mathematics and the natural sciences.Comment: 74 pages, 44 figure

Impact of Education and Network for Avian Influenza H5N1 in Human: Knowledge, Clinical Practice, and Motivation on Medical Providers in Vietnam

BACKGROUND: Knowledge, clinical practice, and professional motivation of medical providers relating to H5N1 infection have an important influence on care for H5N1 patients who require early diagnosis and early medical intervention. METHODS/PRINCIPAL FINDINGS: Novel educational programs including training and workshops for medical providers relating to H5N1 infection in Vietnam were originally created and implemented in 18 provincial hospitals in northern Vietnam between 2008 and 2010. A self-administered, structured questionnaire survey was conducted in 8 provincial hospitals where both educational training and workshops were previously provided. A total of 326 medical providers, including physicians, nurses, and laboratory technicians who attended or did not attend original programs were enrolled in the survey. Knowledge, clinical attitudes and practice (KAP), including motivation surrounding caring for H5N1 patients, were evaluated. The study indicated a high level of knowledge and motivation in all professional groups, with especially high levels in laboratory technicians. Conferences and educational programs were evaluated to be the main scientific information resources for physicians, along with information from colleagues. The chest radiographs and the initiation of antiviral treatment in the absence of RT-PCR result were identified as gaps in education. Factors possibly influencing professional motivation for caring for H5N1 patients included healthcare profession, the hospital where the respondents worked, age group, attendance at original educational programs and at educational programs which were conducted by international health-related organizations. CONCLUSIONS: Educational programs provide high knowledge and motivation for medical providers in Vietnam caring for H5N1 patients. Additional educational programs related to chest radiographs and an initiation of treatment in the absence of RT-PCR are needed. Networking is also necessary for sharing updated scientific information and practical experiences. These enhanced KAPs by educational programs and integrated systems among hospitals should result in appropriate care for H5N1 patients and may reduce morbidity and mortality