ChatGPT Assisting Diagnosis of Neuro-ophthalmology Diseases Based on Case Reports

Objective: To evaluate the efficiency of large language models (LLMs) such as ChatGPT to assist in diagnosing neuro-ophthalmic diseases based on detailed case descriptions. Methods: We selected 22 different case reports of neuro-ophthalmic diseases from a publicly available online database. These cases included a wide range of chronic and acute diseases that are commonly seen by neuro-ophthalmic sub-specialists. We inserted the text from each case as a new prompt into both ChatGPT v3.5 and ChatGPT Plus v4.0 and asked for the most probable diagnosis. We then presented the exact information to two neuro-ophthalmologists and recorded their diagnoses followed by comparison to responses from both versions of ChatGPT. Results: ChatGPT v3.5, ChatGPT Plus v4.0, and the two neuro-ophthalmologists were correct in 13 (59%), 18 (82%), 19 (86%), and 19 (86%) out of 22 cases, respectively. The agreement between the various diagnostic sources were as follows: ChatGPT v3.5 and ChatGPT Plus v4.0, 13 (59%); ChatGPT v3.5 and the first neuro-ophthalmologist, 12 (55%); ChatGPT v3.5 and the second neuro-ophthalmologist, 12 (55%); ChatGPT Plus v4.0 and the first neuro-ophthalmologist, 17 (77%); ChatGPT Plus v4.0 and the second neuro-ophthalmologist, 16 (73%); and first and second neuro-ophthalmologists 17 (17%). Conclusions: The accuracy of ChatGPT v3.5 and ChatGPT Plus v4.0 in diagnosing patients with neuro-ophthalmic diseases was 59% and 82%, respectively. With further development, ChatGPT Plus v4.0 may have potential to be used in clinical care settings to assist clinicians in providing quick, accurate diagnoses of patients in neuro-ophthalmology. The applicability of using LLMs like ChatGPT in clinical settings that lack access to subspeciality trained neuro-ophthalmologists deserves further research

THE USE OF CHATGPT FOR PARAPHRASING IN THESIS WRITING CLASS AT ENGLISH PROGRAM 2023

This research investigated the use of ChatGPT for paraphrasing in the scope of thesis writing class at English study program. The informants for this research are six students in thesis writing class who used ChatGPT as their paraphrasing tool. The researcher used descriptive qualitative research design. To collect the data, the researcher uses semi-structured interviews and documentations. Interview were conducted in 6 students who take thesis writing class in semester 6 at University of Muhammadiyah Malang and continued with the screenshots documentation to obtain further data. Based on the findings, ChatGPT is utilized in three phases namely pre-using while-using and post-using. In the pre-using stage, the comparison between ChatGPT and student’s previous paraphrasing tools show that ChatGPT is dominant. In the while-using stage, it is indicated the implementation, strategy, the accuracy and fluency. In the post-using stage, ChatGPT can change student’s habit while it’s challenge. As it benefits, ChatGPT can serve as an option tool. ChatGPT Overall, with it’s ability ChatGPT has the potential to assist students in their study especially in paraphrasing

When ChatGPT is gone: Creativity reverts and homogeneity persists

ChatGPT has been evidenced to enhance human performance in creative tasks. Yet, it is still unclear if this boosting effect sustains with and without ChatGPT. In a pre-registered seven-day lab experiment and a follow-up survey after 30 days of experiment completion, we examined the impacts of ChatGPT presence and absence on sustained creativity using a text dataset of 3302 creative ideas and 427 creative solutions from 61 college students. Participants in the treatment group used ChatGPT in creative tasks, while those in the control group completed the tasks by themselves. The findings show that although the boosting effect of ChatGPT was consistently observed over a five-day creative journey, human creative performance reverted to baseline when ChatGPT was down on the 7th and the 30th day. More critically, the use of ChatGPT in creative tasks resulted in increasingly homogenized contents, and this homogenization effect persisted even when ChatGPT was absence. These findings pose a challenge to the prevailing argument that ChatGPT can enhance human creativity. In fact, generative AI like ChatGPT lends to human with a temporary rise in creative performance but boxes human creative capability in the long run, highlighting the imperative for cautious generative AI integration in creative endeavors.Comment: 30pages,6figure

LEARNING ABOUT CONCRETE-FILLED TUBE USING CHATGPT

ChatGPT is an artificial intelligence that can understand context and respond appropriately. It could be used for research on a topic. However, ChatGPT does not always provide accurate information. Its performance has not been tested in engineering fields. In this study, ChatGPT was consulted about concrete-filled tubes (CFT), which is a structural element primarily subjected to axial load. Fifty-eight questions were posted to ChatGPT. ChatGPT’s responses (370 sentences) were evaluated. ChatGPT generated plagiarism-free statements, with only a 12% Turnitin similarity index. 78.6% of ChatGPT’s sentences were long and complex. Thus, Hemingway Editor gave them a Grade 14 for poor readability. The information given by ChatGPT can be classified as correct, erroneous, contradictory, and unverified. ChatGPT could be used as a research tool, but with limitations. It can explain the basic concepts of CFT but also provide inaccurate and contradictory information. A researcher needs to be cautious while using ChatGPT in research. ChatGPT could be used to test some hypotheses or theories. However, the quality of the output is dependent on the user’s critical inputs and an in-depth conversation with ChatGPT

A Study on the Vulnerability of Test Questions against ChatGPT-based Cheating

ChatGPT is a chatbot that can answer text prompts fairly accurately, even performing very well on postgraduate-level questions. Many educators have found that their take-home or remote tests and exams are vulnerable to ChatGPT-based cheating because students may directly use answers provided by tools like ChatGPT. In this paper, we try to provide an answer to an important question: how well ChatGPT can answer test questions and how we can detect whether the questions of a test can be answered correctly by ChatGPT. We generated ChatGPT's responses to the MedMCQA dataset, which contains over 10,000 medical school entrance exam questions. We analyzed the responses and uncovered certain types of questions ChatGPT answers more inaccurately than others. In addition, we have created a basic natural language processing model to single out the most vulnerable questions to ChatGPT in a collection of questions or a sample exam. Our tool can be used by test-makers to avoid ChatGPT-vulnerable test questions.Comment: 2023 International Conference on Machine Learning and Applications (ICMLA

Analysing Chatgpt's Potential Through the Lens of Creating Research Papers

This paper analyses ChatGPT 3.5 Turbo, the latest free version of the ChatGPT service. By using ChatGPT to create theoretical papers on itself, further insights are gained into the potential of ChatGPT and other generative artificial intelligence services as well as their weaknesses. Through this analysis presented, potential future avenues of research are suggested alongside necessary changes if services like ChatGPT wish to be used as a tool in academic works

"ChatGPT, a Friend or Foe for Education?" Analyzing the User's Perspectives on the Latest AI Chatbot Via Reddit

Latest developments in Artificial Intelligence (AI) and big data gave rise to Artificial Intelligent agents like Open AI's ChatGPT, which has recently become the fastest growing application since Facebook and WhatsApp. ChatGPT has demonstrated its ability to impact students' classroom learning experience and exam outcomes. However, there is evidence that ChatGPT provides biased and erroneous information, yet students use ChatGPT in academic tasks. Therefore, an accurate understanding of ChatGPT user perception is crucial. This study has analyzed 247 Reddit top posts related to the educational use of ChatGPT from a prominent subreddit called "ChatGPT" for user perception analysis. Descriptive statistics, sentiment analysis using NLP techniques, and LDA topic modeling were used for analysis to gather a contextual understanding of the data. Results show that the majority of the users took a neutral viewpoint. However, there was more positive perception than negative regarding the usefulness of ChatGPT in education

Chatbot-supported Thesis Writing: An Autoethnographic Report

The release of the large language model based chatbot ChatGPT in November 2022 has brought considerable attention to the subject of artificial intelligence, not only in the public. From the perspective of higher education, ChatGPT challenges various learning and assessment formats as it significantly reduces the effectiveness of their learning and assessment functionalities. In particular, ChatGPT might be applied to formats that require learners to generate text, such as bachelor theses or student research papers. Accordingly, the research question arises to what extent writing of bachelor theses is still a valid learning and assessment format. Correspondingly, in this study, the first author was asked to write his bachelor's thesis exploiting ChatGPT. For tracing the impact of ChatGPT, methodically an autoethnographic approach was used. First, all considerations on the potential use of ChatGPT were documented in logs and secondly, all ChatGPT chats were logged. Both logs and chat histories were analyzed and are presented along to the recommendations for students regarding the use of ChatGPT suggested by Gimpel et al. (2023). In conclusion, ChatGPT is beneficial in thesis writing during various activities, such as brainstorming, structuring and text revision. However, there arise limitations, e.g., in referencing. Thus, ChatGPT requires a continuous validation of the outcomes generated fostering learning. Currently, ChatGPT is to be valued as a beneficial tool in thesis writing. However, writing a conclusive thesis still requires the learner's meaningful engagement. Accordingly, writing a thesis is still a valid learning and assessment format. With further releases of ChatGPT, an increase in capabilities is to be expected and the research question needs to be reevaluated from time to time.Comment: 26 page

The Impact Of Using Chatgpt On University Students’ Ability To Write Lecture Assignment

ChatGPT (Generative Pre-Training Transformer) is one of the media that is often used and accessed by students to get information and facilitate students in learning. In addition, the use of ChatGPT helps students in writing and facilitates students in the writing process. This study aims to find the impact of using ChatGPT on students' writing skills. This study used a quantitative approach by involving the use of questionnaires as one of the data collection techniques. The questionnaire used to collect data in the form of responses and views of students who were intended as respondents in this study was the impact of using ChatGPT on students' writing skills. In research stated that the use of ChatGPT has an impact on students' writing skills, so ChatGPT can be one of the tools or media that can help students in writing and become a medium that helps students to improve writing skills. However, the use of ChatGPT in writing also has a negative impact behind it, which can make students spoiled and lazy to think when writing, this is because ChatGPT technology is able to understand human language so that it can meet what students want

An Empirical Study of Using ChatGPT for Fact Verification Task

ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about its usability for sensitive tasks like fact verification. This study investigates three key research questions: (1) Can ChatGPT be used for fact verification tasks? (2) What are different prompts performance using ChatGPT for fact verification tasks? (3) For the best-performing prompt, what common mistakes does ChatGPT make? Specifically, this study focuses on conducting a comprehensive and systematic analysis by designing and comparing the performance of three different prompts for fact verification tasks on the benchmark FEVER dataset using ChatGPT