29 research outputs found
Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard
This paper presents a performance comparison of three large language models
(LLMs), namely OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard, on the
VNHSGE English dataset. The results show that BingChat is better than ChatGPT
and Bard. Therefore, BingChat and Bard can replace ChatGPT while ChatGPT is not
yet officially available in Vietnam. The results also indicate that ChatGPT,
Bing Chat, and Bard outperform Vietnamese students in English language
proficiency. The findings of this study contribute to the understanding of the
potential of LLMs in English language education. The remarkable performance of
ChatGPT, Bing Chat, and Bard demonstrates their potential as effective tools
for teaching and learning English at the high school level.Comment: 11 pages, 8 figures. arxiv admin note: substantial text overlap with
arXiv: 2305.1219
ChatGPT is Good but Bing Chat is Better for Vietnamese Students
This study examines the efficacy of two SOTA large language models (LLMs),
namely ChatGPT and Microsoft Bing Chat (BingChat), in catering to the needs of
Vietnamese students. Although ChatGPT exhibits proficiency in multiple
disciplines, Bing Chat emerges as the more advantageous option. We conduct a
comparative analysis of their academic achievements in various disciplines,
encompassing mathematics, literature, English language, physics, chemistry,
biology, history, geography, and civic education. The results of our study
suggest that BingChat demonstrates superior performance compared to ChatGPT
across a wide range of subjects, with the exception of literature, where
ChatGPT exhibits better performance. Additionally, BingChat utilizes the more
advanced GPT-4 technology in contrast to ChatGPT, which is built upon GPT-3.5.
This allows BingChat to improve to comprehension, reasoning and generation of
creative and informative text. Moreover, the fact that BingChat is accessible
in Vietnam and its integration of hyperlinks and citations within responses
serve to reinforce its superiority. In our analysis, it is evident that while
ChatGPT exhibits praiseworthy qualities, BingChat presents a more apdated
solutions for Vietnamese students.Comment: 13 pages; 6 figure
Investigating the Effectiveness of ChatGPT in Mathematical Reasoning and Problem Solving: Evidence from the Vietnamese National High School Graduation Examination
This study offers a complete analysis of ChatGPT's mathematics abilities in
responding to multiple-choice questions for the Vietnamese National High School
Graduation Examination (VNHSGE) on a range of subjects and difficulty levels.
The dataset included 250 questions divided into four levels: knowledge (K),
comprehension (C), application (A), and high application (H), and it included
ten themes that covered diverse mathematical concepts. The outcomes demonstrate
that ChatGPT's performance varies depending on the difficulty level and
subject. It performed best on questions at Level (K), with an accuracy rate of
; but, as the difficulty level rose, it scored poorly, with an accuracy
rate of . The study has also shown that ChatGPT significantly succeeds in
providing responses to questions on subjects including exponential and
logarithmic functions, geometric progression, and arithmetic progression. The
study found that ChatGPT had difficulty correctly answering questions on topics
including derivatives and applications, spatial geometry, and Oxyz spatial
calculus. Additionally, this study contrasted ChatGPT outcomes with Vietnamese
students in VNHSGE and in other math competitions. ChatGPT dominated in the SAT
Math competition with a success rate of , followed by VNHSGE mathematics
(. However, its success rates were lower on other exams, such as AP
Statistics, the GRE Quantitative, AMC 10, AMC 12, and AP Calculus BC. These
results suggest that ChatGPT has the potential to be an effective teaching tool
for mathematics, but more work is needed to enhance its handling of graphical
data and address the challenges presented by questions that are getting more
challenging.Comment: 17 pages, 14 image
Réduction de la traînée de l'écoulement de Poiseuille 2D par asservissement visuel partitionné
International audienceCet article propose une nouvelle approche de la commande en boucle fermée d'un écoulement fluide. Elle repose sur une estimation de l'état de l'écoulement via un capteur de vision, comme nous l'avons initialement proposé dans des travaux précédents. Puisque cette façon de faire repose sur l'utilisation d'informations visuelles, nous nous proposons ici d'utiliser les techniques dites d'asservissement visuel que nous appliquons au problème de la minimisation de la traînée de l'écoulement de Poiseuille 2D. Cependant, contrairement à la littérature du domaine, nous minimisons aussi la densité d'énergie cinétique de l'écoulement. Cela est de toute importance puisqu'une augmentation de cette densité d'énergie peut amener l'écoulement à devenir turbulent. Le schéma de commande est basé sur une synthèse de la loi de commande par asservissement visuel partitionné. Des résultats de simulation valident l'approche proposée. Nous comparons également nos résultats avec les techniques les plus pertinentes proposées dans la littérature
Minimisation de l'énergie cinétique transitoire dans l'écoulement 3D plan de Poiseuille commandé
La commande d’un écoulement fluide vise, d’une façon générale, à modifier son état courant pour l’amener à un état désiré ou, plus simplement, de le maintenir dans cet état désiré quelles que soient les perturbations extérieures et cela dans un but clairement identifié. Les retombées potentielles sont extrêmement nombreuses, et ce dans divers domaines d’activités, en particulier dans le domaine des transports qu’ils soient routiers, maritimes ou aériens. En effet, limiter la traînée lors du déplacement d’un engin motorisé permet de limiter significativement sa consommation de carburant. Des retombées importantes sont également attendues dans d’autres secteurs d’activité comme en génie chimique, dans le domaine militaire, ou encore dans le domaine de l’agriculture raisonnée. Dans cet article nous nous intéressons à la minimisation de l’énergie cinétique transitoire, due à une perturbation extérieure, d’un écoulement supposé en régime laminaire instable. Il s’agit là d’un problème générique de toute importance. En effet, une augmentation substantielle de l’énergie cinétique de la perturbation peut conduire à une transition vers la turbulence, ce qui est à proscrire totalement dans ce cas de figure. Toutefois, ce problème est très complexe dans le cas d’un système sous-actionné [1], comme c’est le cas de l’écoulement plan de Poiseuille 2D [2]. Dans ce contexte, nous montrons tout d’abord comment il est possible d’augmenter le nombre de degrés de liberté commandés d’un tel écoulement, puis nous proposons une loi de commande localement découplante permettant d’assurer une décroissance stricte de l’énergie cinétique. [1] J. F. Whidborne and J. McKernan, “On the minimization of Maximum Transient Energy Growth”, IEEE Trans. on Automatic Control, 52(9): 1762-1767, 2007. [2] S. Joshi, J. Speyer, and J. Kim, “A systems theory approach to the feedback stabilization on infinitesimal and finite amplitude disturbances in plane Poiseuille flow”, Journal of Fluid Mechanics, vol. 332, pp. 157-184, 199
Simultaneous Drag Reduction and Kinetic Energy Density of the Plane Poiseuille Flow
[Departement_IRSTEA]Ecotechnologies [TR1_IRSTEA]SPEEInternational audienceWe present in this paper a closed-loop approach to control the 2D plane Poiseuille flow in an unstable state. To do that, we propose to use a vision-based approach as proposed in our previous paper on this subject to estimate the state of the flow. The first step is based on the evaluation of the 2D velocity field from optical flow measurements. These measurements are next used into a visual servo control scheme. However, since we are interested in the simultaneous minimization of two quantities, that is the drag and kinetic energy density of the flow, we propose to design a control law based on an advanced visual servo control approach, the so-called partitioned visual servo control, first proposed in the robotics community. Simulations results validate our control scheme, including the case where noisy measurements are considered. We also compare our approaches with the most relevant ones
Can ChatGPT pass the Vietnamese National High School Graduation Examination?
This research article highlights the potential of AI-powered chatbots in
education and presents the results of using ChatGPT, a large language model, to
complete the Vietnamese National High School Graduation Examination (VNHSGE).
The study dataset included 30 essays in the literature test case and 1,700
multiple-choice questions designed for other subjects. The results showed that
ChatGPT was able to pass the examination with an average score of 6-7,
demonstrating the technology's potential to revolutionize the educational
landscape. The analysis of ChatGPT performance revealed its proficiency in a
range of subjects, including mathematics, English, physics, chemistry, biology,
history, geography, civic education, and literature, which suggests its
potential to provide effective support for learners. However, further research
is needed to assess ChatGPT performance on more complex exam questions and its
potential to support learners in different contexts. As technology continues to
evolve and improve, we can expect to see the use of AI tools like ChatGPT
become increasingly common in educational settings, ultimately enhancing the
educational experience for both students and educators.Comment: 9 pages, 13 figures, 4 table
VNHSGE: VietNamese High School Graduation Examination Dataset for Large Language Models
The VNHSGE (VietNamese High School Graduation Examination) dataset, developed
exclusively for evaluating large language models (LLMs), is introduced in this
article. The dataset, which covers nine subjects, was generated from the
Vietnamese National High School Graduation Examination and comparable tests.
300 literary essays have been included, and there are over 19,000
multiple-choice questions on a range of topics. The dataset assesses LLMs in
multitasking situations such as question answering, text generation, reading
comprehension, visual question answering, and more by including both textual
data and accompanying images. Using ChatGPT and BingChat, we evaluated LLMs on
the VNHSGE dataset and contrasted their performance with that of Vietnamese
students to see how well they performed. The results show that ChatGPT and
BingChat both perform at a human level in a number of areas, including
literature, English, history, geography, and civics education. They still have
space to grow, though, especially in the areas of mathematics, physics,
chemistry, and biology. The VNHSGE dataset seeks to provide an adequate
benchmark for assessing the abilities of LLMs with its wide-ranging coverage
and variety of activities. We intend to promote future developments in the
creation of LLMs by making this dataset available to the scientific community,
especially in resolving LLMs' limits in disciplines involving mathematics and
the natural sciences.Comment: 74 pages, 44 figure
Impact of Education and Network for Avian Influenza H5N1 in Human: Knowledge, Clinical Practice, and Motivation on Medical Providers in Vietnam
BACKGROUND: Knowledge, clinical practice, and professional motivation of medical providers relating to H5N1 infection have an important influence on care for H5N1 patients who require early diagnosis and early medical intervention. METHODS/PRINCIPAL FINDINGS: Novel educational programs including training and workshops for medical providers relating to H5N1 infection in Vietnam were originally created and implemented in 18 provincial hospitals in northern Vietnam between 2008 and 2010. A self-administered, structured questionnaire survey was conducted in 8 provincial hospitals where both educational training and workshops were previously provided. A total of 326 medical providers, including physicians, nurses, and laboratory technicians who attended or did not attend original programs were enrolled in the survey. Knowledge, clinical attitudes and practice (KAP), including motivation surrounding caring for H5N1 patients, were evaluated. The study indicated a high level of knowledge and motivation in all professional groups, with especially high levels in laboratory technicians. Conferences and educational programs were evaluated to be the main scientific information resources for physicians, along with information from colleagues. The chest radiographs and the initiation of antiviral treatment in the absence of RT-PCR result were identified as gaps in education. Factors possibly influencing professional motivation for caring for H5N1 patients included healthcare profession, the hospital where the respondents worked, age group, attendance at original educational programs and at educational programs which were conducted by international health-related organizations. CONCLUSIONS: Educational programs provide high knowledge and motivation for medical providers in Vietnam caring for H5N1 patients. Additional educational programs related to chest radiographs and an initiation of treatment in the absence of RT-PCR are needed. Networking is also necessary for sharing updated scientific information and practical experiences. These enhanced KAPs by educational programs and integrated systems among hospitals should result in appropriate care for H5N1 patients and may reduce morbidity and mortality