Benchmarking ChatGPT-4 on ACR Radiation Oncology In-Training (TXIT) Exam and Red Journal Gray Zone Cases: Potentials and Challenges for AI-Assisted Medical Education and Decision Making in Radiation Oncology

The potential of large language models in medicine for education and decision making purposes has been demonstrated as they achieve decent scores on medical exams such as the United States Medical Licensing Exam (USMLE) and the MedQA exam. In this work, we evaluate the performance of ChatGPT-4 in the specialized field of radiation oncology using the 38th American College of Radiology (ACR) radiation oncology in-training (TXIT) exam and the 2022 Red Journal gray zone cases. For the TXIT exam, ChatGPT-3.5 and ChatGPT-4 have achieved the scores of 63.65% and 74.57%, respectively, highlighting the advantage of the latest ChatGPT-4 model. Based on the TXIT exam, ChatGPT-4's strong and weak areas in radiation oncology are identified to some extent. Specifically, ChatGPT-4 demonstrates good knowledge of statistics, CNS & eye, pediatrics, biology, and physics but has limitations in bone & soft tissue and gynecology, as per the ACR knowledge domain. Regarding clinical care paths, ChatGPT-4 performs well in diagnosis, prognosis, and toxicity but lacks proficiency in topics related to brachytherapy and dosimetry, as well as in-depth questions from clinical trials. For the gray zone cases, ChatGPT-4 is able to suggest a personalized treatment approach to each case with high correctness and comprehensiveness. Most importantly, it provides novel treatment aspects for many cases, which are not suggested by any human experts. Both evaluations demonstrate the potential of ChatGPT-4 in medical education for the general public and cancer patients, as well as the potential to aid clinical decision-making, while acknowledging its limitations in certain domains. Because of the risk of hallucination, facts provided by ChatGPT always need to be verified

Benchmarking ChatGPT-4 on a radiation oncology in-training exam and Red Journal Gray Zone cases: potentials and challenges for ai-assisted medical education and decision making in radiation oncology

PurposeThe potential of large language models in medicine for education and decision-making purposes has been demonstrated as they have achieved decent scores on medical exams such as the United States Medical Licensing Exam (USMLE) and the MedQA exam. This work aims to evaluate the performance of ChatGPT-4 in the specialized field of radiation oncology.MethodsThe 38th American College of Radiology (ACR) radiation oncology in-training (TXIT) exam and the 2022 Red Journal Gray Zone cases are used to benchmark the performance of ChatGPT-4. The TXIT exam contains 300 questions covering various topics of radiation oncology. The 2022 Gray Zone collection contains 15 complex clinical cases.ResultsFor the TXIT exam, ChatGPT-3.5 and ChatGPT-4 have achieved the scores of 62.05% and 78.77%, respectively, highlighting the advantage of the latest ChatGPT-4 model. Based on the TXIT exam, ChatGPT-4’s strong and weak areas in radiation oncology are identified to some extent. Specifically, ChatGPT-4 demonstrates better knowledge of statistics, CNS & eye, pediatrics, biology, and physics than knowledge of bone & soft tissue and gynecology, as per the ACR knowledge domain. Regarding clinical care paths, ChatGPT-4 performs better in diagnosis, prognosis, and toxicity than brachytherapy and dosimetry. It lacks proficiency in in-depth details of clinical trials. For the Gray Zone cases, ChatGPT-4 is able to suggest a personalized treatment approach to each case with high correctness and comprehensiveness. Importantly, it provides novel treatment aspects for many cases, which are not suggested by any human experts.ConclusionBoth evaluations demonstrate the potential of ChatGPT-4 in medical education for the general public and cancer patients, as well as the potential to aid clinical decision-making, while acknowledging its limitations in certain domains. Owing to the risk of hallucinations, it is essential to verify the content generated by models such as ChatGPT for accuracy

Performance of gimbal-based dynamic tumor tracking for treating liver carcinoma

Abstract Background Since the introduction of tumor tracking in radiotherapy, it is possible to ensure a precise irradiation of moving targets. To follow the tumor movement, most systems rely on the detection of implanted markers and correlation models between the internal and external patient movement. This study reports the clinical workflow and first results of the dynamic tumor tracking (DTT) performance for patients with liver carcinoma at the Vero SBRT system of the University Hospital Erlangen regarding the detection of the internal marker and the changes of the determined correlation models. Methods So far 13 liver patients were treated with DTT. For each patient, two fiducial markers (FM), which are monitored with X-rays during treatment, were implanted in the vicinity of the tumor. All patients received a fraction dose of 4–6 Gy with 8 to 12 fractions. Treatment and patient data is evaluated by processing the acquired log-files of the DTT treatment. Based on this, the marker detection and the changes of the correlation model between the internal and external movement is investigated. Results The median treatment time was 19:42 min. During treatment a median of 173 X-ray stereoscopic images were acquired. The marker detection was successful in 64.6% of the images. The FM detection is independent of the relative angle between the marker and the imager, but shows a dependency on the average intensity surrounding the FM position within the kV images. The number of correlation models needed during treatment increases in the presence of baseline shifts. The comparison of the correlation models shows large differences in the internal-external correlation between the different models acquired for one patient. Conclusion Thirteen liver patients were treated with DTT at the Vero SBRT system and the marker detection was analyzed. Furthermore, the importance of regularly monitoring the internal target motion could be shown, since the correlation between the internal and external motion changes considerably over the course of the treatment

Should salvage surgery be considered for local recurrence after definitive chemoradiation in locally advanced non-small cell lung cancer?

Background Incidence of local relapse after definitive chemoradiation (>59 Gy) for locally advanced non-small-cell lung cancer (NSCLC) is high, irrespective of high dose radiation applied. Experience with salvage lung resections in patients with locally relapsed NSCLC after definitive chemoradiation is limited. We present our series of salvage lung resections for local NSCLC relapse after curative–intent chemoradiation for locally advanced tumor. Methods Nine consecutive patients with local tumor recurrence or persistence following definitive chemoradiation were reviewed. Kaplan-Meier analysis was used to assess patient survival. Results All patients received definitive radiation (median dose 66.2 Gy) with concurrent chemotherapy. Tumor stage prior to chemoradiation was IIIA in 8 patients and IV in 1. In 4 patients tumor invaded the chest wall, in 2 the spine and in 1 the aorta. Median interval between chemoradiation and salvage resection was 30.2 weeks. Nine patients underwent 9 resections (6 lobectomies, 1 bilobectomy, 1 pneumonectomy and 1 bi-segmentectomy). One death occurred on the 12th postoperative day. Median overall survival was 23 months; postoperative 3-year survival was 47 %. Median progression-free survival was 21 months. Conclusion Salvage lung resection for locally recurrent or persisted NSCLC in selected patients with locally advanced NSCLC following definitive chemoradiation is a worthwhile treatment option

Quantification of an External Motion Surrogate for Quality Assurance in Lung Cancer Radiation Therapy

The purpose of this work was to validate the stability of the end exhale position in deep expiration breath hold (DEBH) technique for quality assurance in stereotactic lung tumor radiation therapy. Furthermore, a motion analysis was performed for 20 patients to evaluate breathing periods and baseline drifts based on an external surrogate. This trajectory was detected using stereo infrared (IR) cameras and reflective body markers. The respiratory waveform showed large interpatient differences in the end exhale position during irradiation up to 18.8 mm compared to the global minimum. This position depends significantly on the tumor volume. Also the baseline drifts, which occur mostly in posterior direction, are affected by the tumor size. Breathing periods, which depend mostly on the patient age, were in a range between 2.4 s and 7.0 s. Fifteen out of 20 patients, who showed a reproducible end exhale position with a deviation of less than 5 mm, might benefit from DEBH due to smaller planning target volumes (PTV) compared to free breathing irradiation and hence sparing of healthy tissue. Patients with larger uncertainties should be treated with more complex motion compensation techniques

Adaptive radiotherapy and the dosimetric impact of inter- and intrafractional motion on the planning target volume for prostate cancer patients

Purpose!#!To investigate the dosimetric influence of daily interfractional (inter) setup errors and intrafractional (intra) target motion on the planning target volume (PTV) and the possibility of an offline adaptive radiotherapy (ART) method to correct larger patient positioning uncertainties in image-guided radiotherapy for prostate cancer (PCa).!##!Materials and methods!#!A CTV (clinical target volume)-to-PTV margin ranging from 15 mm in LR (left-right) and SI (superior-inferior) and 5-10 mm in AP (anterior-posterior) direction was applied to all patients. The dosimetric influence of this margin was retrospectively calculated by analysing systematic and random components of inter and intra errors of 31 consecutive intermediate- and high-risk localized PCa patients using daily cone beam computed tomography and kV/kV (kilo-Voltage) imaging. For each patient inter variation was assessed by observing the first 4 treatment days, which led to an offline ART-based treatment plan in case of larger variations.!##!Results!#!Systematic inter uncertainties were larger (1.12 in LR, 2.28 in SI and 1.48 mm in AP) than intra systematic errors (0.44 in LR, 0.69 in SI and 0.80 mm in AP). Same findings for the random error in SI direction with 3.19 (inter) and 2.30 mm (intra), whereas in LR and AP results were alike with 1.89 (inter) and 1.91 mm (intra) and 2.10 (inter) and 2.27 mm (intra), respectively. The calculated margin revealed dimensions of 4-5 mm in LR, 8-9 mm in SI and 6-7 mm in AP direction. Treatment plans which had to be adapted showed smaller variations with 1.12 (LR) and 1.72 mm (SI) for Σ and 4.17 (LR) and 3.75 mm (SI) for σ compared to initial plans with 1.77 and 2.62 mm for Σ and 4.46 and 5.39 mm for σ in LR and SI, respectively.!##!Conclusion!#!The currently clinically used margin of 15 mm in LR and SI and 5-10 mm in AP direction includes inter and intra uncertainties. The results show that offline ART is feasible which becomes a necessity with further reductions in PTV margins

Targeted Therapy, Chemotherapy, Immunotherapy and Novel Treatment Options for Different Subtypes of Salivary Gland Cancer

Surgical resection remains the first line treatment for salivary gland cancer (SGC). In the case of locally advanced disease, surgery is followed by adjuvant radiotherapy. Surgical resection should be favored in resectable locoregional recurrent disease as well, and even the complete resection of all distant oligometastases has clinical benefit for the patients. For inoperable and disseminated metastatic disease, a multitude of systemic therapies including chemotherapy, targeted therapy, and immunotherapy are available. In this review, the current therapeutic options for inoperable recurrent or metastatic SGCs are summarized. Systemic treatment can achieve prolonged progression-free and overall survival, while the overall prognosis remains poor. Current clinical trials include only a limited number of patients and mostly combine different histologic subtypes. Additionally, no randomized controlled trial comparing different therapeutic options has been performed. In the future, further studies with a larger patient cohort and ideally only one histologic subtype are needed in order to improve the outcome for SGC patients. However, this may be difficult to accomplish due to the rarity and diversity of the disease. Additionally, molecular analyses need to be performed routinely in order to individualize treatment and to go one step further towards precision medicine

Salivary gland carcinoma (SGC) with perineural spread and/or positive resection margin – high locoregional control rates after photon (chemo) radiotherapy - experience from a monocentric analysis

Abstract Background The aim was to evaluate the outcome, especially locoregional control of patients with locally advanced salivary gland carcinoma (SGC) with perineural spread (Pn1) and/or positive resection margins (R1/2) after postoperative photon (chemo) radiotherapy in a single centre. Methods We retrospectively reviewed data of 65 patients with newly diagnosed locally advanced SGC without distant metastases who underwent radio (chemo) therapy in the department of radiation oncology of the university hospital of Erlangen from January 2000 until April 2017. Kaplan Meier method was used to calculate survival and recurrence rates. In univariate analysis the log-rank test was used to correlate patient−/tumor- and treatment-related parameters to survival and recurrence rates. Results Median follow-up was 45 months (range: 6; 215). After 1, 3, 5 years cumulative incidence of local and locoregional failure was 3.1, 7.0, 7.0% and 3.1, 9.7, 12.9%, whereas cumulative incidence of distant metastases (DM) was 15.6, 36.0, 44.0%. After 1,3, 5 years cumulative Overall (OS) and Disease-free survival (DFS) was 90.5, 74.9, 63.9% and 83.0, 54.8, 49.4%. The only significant predictor for decreased local and locoregional control was a macroscopic resection margin(R2) (p = 0.002 and p = 0.04). High-grade histology (p = 0.006), lymph node metastases with extracapsular spread (p = 0.044) and an advanced T-stage (p = 0.031) were associated with an increased rate of DM. High-grade histology was the only factor predicting for a decreased DFS (p = 0.014). Conclusion Photon radiotherapy leads to high local and locoregional control rates in a high-risk patient population with SGC with microscopically positive resection margins and/or perineural spread. The most common site of disease recurrence was distant metastases. Therefore the real challenge for the future should be to prevent distant metastases