ChatGPT Assisting Diagnosis of Neuro-ophthalmology Diseases Based on Case Reports

Objective: To evaluate the efficiency of large language models (LLMs) such as ChatGPT to assist in diagnosing neuro-ophthalmic diseases based on detailed case descriptions. Methods: We selected 22 different case reports of neuro-ophthalmic diseases from a publicly available online database. These cases included a wide range of chronic and acute diseases that are commonly seen by neuro-ophthalmic sub-specialists. We inserted the text from each case as a new prompt into both ChatGPT v3.5 and ChatGPT Plus v4.0 and asked for the most probable diagnosis. We then presented the exact information to two neuro-ophthalmologists and recorded their diagnoses followed by comparison to responses from both versions of ChatGPT. Results: ChatGPT v3.5, ChatGPT Plus v4.0, and the two neuro-ophthalmologists were correct in 13 (59%), 18 (82%), 19 (86%), and 19 (86%) out of 22 cases, respectively. The agreement between the various diagnostic sources were as follows: ChatGPT v3.5 and ChatGPT Plus v4.0, 13 (59%); ChatGPT v3.5 and the first neuro-ophthalmologist, 12 (55%); ChatGPT v3.5 and the second neuro-ophthalmologist, 12 (55%); ChatGPT Plus v4.0 and the first neuro-ophthalmologist, 17 (77%); ChatGPT Plus v4.0 and the second neuro-ophthalmologist, 16 (73%); and first and second neuro-ophthalmologists 17 (17%). Conclusions: The accuracy of ChatGPT v3.5 and ChatGPT Plus v4.0 in diagnosing patients with neuro-ophthalmic diseases was 59% and 82%, respectively. With further development, ChatGPT Plus v4.0 may have potential to be used in clinical care settings to assist clinicians in providing quick, accurate diagnoses of patients in neuro-ophthalmology. The applicability of using LLMs like ChatGPT in clinical settings that lack access to subspeciality trained neuro-ophthalmologists deserves further research

THE USE OF CHATGPT FOR PARAPHRASING IN THESIS WRITING CLASS AT ENGLISH PROGRAM 2023

This research investigated the use of ChatGPT for paraphrasing in the scope of thesis writing class at English study program. The informants for this research are six students in thesis writing class who used ChatGPT as their paraphrasing tool. The researcher used descriptive qualitative research design. To collect the data, the researcher uses semi-structured interviews and documentations. Interview were conducted in 6 students who take thesis writing class in semester 6 at University of Muhammadiyah Malang and continued with the screenshots documentation to obtain further data. Based on the findings, ChatGPT is utilized in three phases namely pre-using while-using and post-using. In the pre-using stage, the comparison between ChatGPT and student’s previous paraphrasing tools show that ChatGPT is dominant. In the while-using stage, it is indicated the implementation, strategy, the accuracy and fluency. In the post-using stage, ChatGPT can change student’s habit while it’s challenge. As it benefits, ChatGPT can serve as an option tool. ChatGPT Overall, with it’s ability ChatGPT has the potential to assist students in their study especially in paraphrasing

When ChatGPT is gone: Creativity reverts and homogeneity persists

ChatGPT has been evidenced to enhance human performance in creative tasks. Yet, it is still unclear if this boosting effect sustains with and without ChatGPT. In a pre-registered seven-day lab experiment and a follow-up survey after 30 days of experiment completion, we examined the impacts of ChatGPT presence and absence on sustained creativity using a text dataset of 3302 creative ideas and 427 creative solutions from 61 college students. Participants in the treatment group used ChatGPT in creative tasks, while those in the control group completed the tasks by themselves. The findings show that although the boosting effect of ChatGPT was consistently observed over a five-day creative journey, human creative performance reverted to baseline when ChatGPT was down on the 7th and the 30th day. More critically, the use of ChatGPT in creative tasks resulted in increasingly homogenized contents, and this homogenization effect persisted even when ChatGPT was absence. These findings pose a challenge to the prevailing argument that ChatGPT can enhance human creativity. In fact, generative AI like ChatGPT lends to human with a temporary rise in creative performance but boxes human creative capability in the long run, highlighting the imperative for cautious generative AI integration in creative endeavors.Comment: 30pages,6figure

Chat GPT Impact Analysis on API Testing: A Controlled Experiment

This research examines the impact of ChatGPT as a learning aid for students in API testing. A controlled experiment compared two groups: one utilizing ChatGPT and the other relying on traditional documentation. The findings indicate that participants using ChatGPT scored significantly higher in both exam tests compared to the documentation group, despite taking longer to complete tasks. Statistical analysis using t-tests confirmed these differences as significant. Post-test surveys revealed an increase in participants confidence and effectiveness in understanding and using APIs after interacting with ChatGPT. However, potential downsides, such as over-reliance on ChatGPT and insufficient deep conceptual understanding, were also observed. The results suggest that while ChatGPT can greatly enhance the quality of learning and productivity in API-related tasks, users must balance AI assistance with independent problem-solving skills. This study underscores the potential of ChatGPT as a valuable educational tool, provided it is integrated thoughtfully into the learning process.This research examines the impact of ChatGPT as a learning aid for students in API testing. A controlled experiment compared two groups: one utilizing ChatGPT and the other relying on traditional documentation. The findings indicate that participants using ChatGPT scored significantly higher in both exam tests compared to the documentation group, despite taking longer to complete tasks. Statistical analysis using t-tests confirmed these differences as significant. Post-test surveys revealed an increase in participants confidence and effectiveness in understanding and using APIs after interacting with ChatGPT. However, potential downsides, such as over-reliance on ChatGPT and insufficient deep conceptual understanding, were also observed. The results suggest that while ChatGPT can greatly enhance the quality of learning and productivity in API-related tasks, users must balance AI assistance with independent problem-solving skills. This study underscores the potential of ChatGPT as a valuable educational tool, provided it is integrated thoughtfully into the learning process

LEARNING ABOUT CONCRETE-FILLED TUBE USING CHATGPT

ChatGPT is an artificial intelligence that can understand context and respond appropriately. It could be used for research on a topic. However, ChatGPT does not always provide accurate information. Its performance has not been tested in engineering fields. In this study, ChatGPT was consulted about concrete-filled tubes (CFT), which is a structural element primarily subjected to axial load. Fifty-eight questions were posted to ChatGPT. ChatGPT’s responses (370 sentences) were evaluated. ChatGPT generated plagiarism-free statements, with only a 12% Turnitin similarity index. 78.6% of ChatGPT’s sentences were long and complex. Thus, Hemingway Editor gave them a Grade 14 for poor readability. The information given by ChatGPT can be classified as correct, erroneous, contradictory, and unverified. ChatGPT could be used as a research tool, but with limitations. It can explain the basic concepts of CFT but also provide inaccurate and contradictory information. A researcher needs to be cautious while using ChatGPT in research. ChatGPT could be used to test some hypotheses or theories. However, the quality of the output is dependent on the user’s critical inputs and an in-depth conversation with ChatGPT

A Study on the Vulnerability of Test Questions against ChatGPT-based Cheating

ChatGPT is a chatbot that can answer text prompts fairly accurately, even performing very well on postgraduate-level questions. Many educators have found that their take-home or remote tests and exams are vulnerable to ChatGPT-based cheating because students may directly use answers provided by tools like ChatGPT. In this paper, we try to provide an answer to an important question: how well ChatGPT can answer test questions and how we can detect whether the questions of a test can be answered correctly by ChatGPT. We generated ChatGPT's responses to the MedMCQA dataset, which contains over 10,000 medical school entrance exam questions. We analyzed the responses and uncovered certain types of questions ChatGPT answers more inaccurately than others. In addition, we have created a basic natural language processing model to single out the most vulnerable questions to ChatGPT in a collection of questions or a sample exam. Our tool can be used by test-makers to avoid ChatGPT-vulnerable test questions.Comment: 2023 International Conference on Machine Learning and Applications (ICMLA

"ChatGPT, a Friend or Foe for Education?" Analyzing the User's Perspectives on the Latest AI Chatbot Via Reddit

Latest developments in Artificial Intelligence (AI) and big data gave rise to Artificial Intelligent agents like Open AI's ChatGPT, which has recently become the fastest growing application since Facebook and WhatsApp. ChatGPT has demonstrated its ability to impact students' classroom learning experience and exam outcomes. However, there is evidence that ChatGPT provides biased and erroneous information, yet students use ChatGPT in academic tasks. Therefore, an accurate understanding of ChatGPT user perception is crucial. This study has analyzed 247 Reddit top posts related to the educational use of ChatGPT from a prominent subreddit called "ChatGPT" for user perception analysis. Descriptive statistics, sentiment analysis using NLP techniques, and LDA topic modeling were used for analysis to gather a contextual understanding of the data. Results show that the majority of the users took a neutral viewpoint. However, there was more positive perception than negative regarding the usefulness of ChatGPT in education

Chatbot-supported Thesis Writing: An Autoethnographic Report

The release of the large language model based chatbot ChatGPT in November 2022 has brought considerable attention to the subject of artificial intelligence, not only in the public. From the perspective of higher education, ChatGPT challenges various learning and assessment formats as it significantly reduces the effectiveness of their learning and assessment functionalities. In particular, ChatGPT might be applied to formats that require learners to generate text, such as bachelor theses or student research papers. Accordingly, the research question arises to what extent writing of bachelor theses is still a valid learning and assessment format. Correspondingly, in this study, the first author was asked to write his bachelor's thesis exploiting ChatGPT. For tracing the impact of ChatGPT, methodically an autoethnographic approach was used. First, all considerations on the potential use of ChatGPT were documented in logs and secondly, all ChatGPT chats were logged. Both logs and chat histories were analyzed and are presented along to the recommendations for students regarding the use of ChatGPT suggested by Gimpel et al. (2023). In conclusion, ChatGPT is beneficial in thesis writing during various activities, such as brainstorming, structuring and text revision. However, there arise limitations, e.g., in referencing. Thus, ChatGPT requires a continuous validation of the outcomes generated fostering learning. Currently, ChatGPT is to be valued as a beneficial tool in thesis writing. However, writing a conclusive thesis still requires the learner's meaningful engagement. Accordingly, writing a thesis is still a valid learning and assessment format. With further releases of ChatGPT, an increase in capabilities is to be expected and the research question needs to be reevaluated from time to time.Comment: 26 page

Analysing Chatgpt's Potential Through the Lens of Creating Research Papers

This paper analyses ChatGPT 3.5 Turbo, the latest free version of the ChatGPT service. By using ChatGPT to create theoretical papers on itself, further insights are gained into the potential of ChatGPT and other generative artificial intelligence services as well as their weaknesses. Through this analysis presented, potential future avenues of research are suggested alongside necessary changes if services like ChatGPT wish to be used as a tool in academic works

TEKNOLOGI KECERDASAN BUATAN CHATGPT SEBAGAI MEDIA KOMUNIKASI ANTARA KOMPUTER DENGAN MANUSIA

Pada saat ini kecerdasan buatan (artificial intelligence) telah memasuki banyak aspek kehidupan manusia, dimana dengan kemampuan teknologi yang semakin meningkat memungkinkan komputer dapat berkomunikasi dengan manusia, salah satunya yaitu kemampuan komputer memberikan tanggapan yang signifikan atas perintah manusia. Sebagai teknologi kecerdasan buatan ChatGPT banyak menarik perhatian, dikarenakan ChatGPT mempunyai kemampuan untuk berkomunikasi secara alami, spontan dan lancar antara manusia dan komputer. ChatGPT memiliki kemampuan didalam menerima, mengerti serta menanggapi dalam interaksi verbal pembicaraan manusia dan dapat menjembatani komunikasi antara komputer dengan manusia. Semakin sering digunakan ChatGPT akan semakin cerdas dikarenakan teknologi ini memiliki kemampuan belajar dari kontaknya dengan manusia. Dalam penerapannya ChatGPT dapat digunakan dalam berbagai aplikasi, sebagai assisten virtual dan dapat menjadi sumber informasi. ChatGPT sebagai teknologi kecerdasan buatan memberikan kolaborasi ke dalam berbagai sektor industri, layanan pelanggan, layanan keuangan dan lain sebagainya. Teknologi ChatGPT menjanjikan peningkatan dalam memecahkan masalah, memungkinkan terjadinya komunikasi yang lancar antara komputer dan manusia. Kata Kunci: ChatGPT; Kecerdasan Buatan; Komunikasi; Teknologi