The reporting quality of natural language processing studies: systematic review of studies of radiology reports.

BACKGROUND: Automated language analysis of radiology reports using natural language processing (NLP) can provide valuable information on patients' health and disease. With its rapid development, NLP studies should have transparent methodology to allow comparison of approaches and reproducibility. This systematic review aims to summarise the characteristics and reporting quality of studies applying NLP to radiology reports. METHODS: We searched Google Scholar for studies published in English that applied NLP to radiology reports of any imaging modality between January 2015 and October 2019. At least two reviewers independently performed screening and completed data extraction. We specified 15 criteria relating to data source, datasets, ground truth, outcomes, and reproducibility for quality assessment. The primary NLP performance measures were precision, recall and F1 score. RESULTS: Of the 4,836 records retrieved, we included 164 studies that used NLP on radiology reports. The commonest clinical applications of NLP were disease information or classification (28%) and diagnostic surveillance (27.4%). Most studies used English radiology reports (86%). Reports from mixed imaging modalities were used in 28% of the studies. Oncology (24%) was the most frequent disease area. Most studies had dataset size > 200 (85.4%) but the proportion of studies that described their annotated, training, validation, and test set were 67.1%, 63.4%, 45.7%, and 67.7% respectively. About half of the studies reported precision (48.8%) and recall (53.7%). Few studies reported external validation performed (10.8%), data availability (8.5%) and code availability (9.1%). There was no pattern of performance associated with the overall reporting quality. CONCLUSIONS: There is a range of potential clinical applications for NLP of radiology reports in health services and research. However, we found suboptimal reporting quality that precludes comparison, reproducibility, and replication. Our results support the need for development of reporting standards specific to clinical NLP studies

Subarachnoid haemorrhage with negative initial neurovascular imaging: a systematic review and meta-analysis

Abstract: Background: In patients with spontaneous subarachnoid haemorrhage (SAH), a vascular cause for the bleed is not always found on initial investigations. This study aimed to systematically evaluate the delayed investigation strategies and clinical outcomes in these cases, often described as “non-aneurysmal” SAH (naSAH). Methods: A systematic review was performed in concordance with the PRISMA checklist. Pooled proportions of primary outcome measures were estimated using a random-effects model. Results: Fifty-eight studies were included (4473 patients). The cohort was split into perimesencephalic naSAH (PnaSAH) (49.9%), non-PnaSAH (44.7%) and radiologically negative SAH identified on lumbar puncture (5.4%). The commonest initial vascular imaging modality was digital subtraction angiography. A vascular abnormality was identified during delayed investigation in 3.9% [95% CI 1.9–6.6]. There was no uniform strategy for the timing or modality of delayed investigations. The pooled proportion of a favourable modified Rankin scale outcome (0–2) at 3–6 months following diagnosis was 92.0% [95% CI 86.0–96.5]. Complications included re-bleeding (3.1% [95% CI 1.5–5.2]), hydrocephalus (16.0% [95% CI 11.2–21.4]), vasospasm (9.6% [95% CI 6.5–13.3]) and seizure (3.5% [95% CI 1.7–5.8]). Stratified by bleeding pattern, we demonstrate a higher rate of delayed diagnoses (13.6% [95% CI 7.4–21.3]), lower proportion of favourable functional outcome (87.2% [95% CI 80.1–92.9]) and higher risk of complications for non-PnaSAH patients. Conclusion: This study highlights the heterogeneity in delayed investigations and outcomes for patients with naSAH, which may be influenced by the initial pattern of bleeding. Further multi-centre prospective studies are required to clarify optimal tailored management strategies for this heterogeneous group of patients

Presentation, management, and outcomes of cauda equina syndrome up to one year after surgery, using clinician and participant reporting: A multi-centre prospective cohort study.

BACKGROUND: Cauda equina syndrome (CES) results from nerve root compression in the lumbosacral spine, usually due to a prolapsed intervertebral disc. Evidence for management of CES is limited by its infrequent occurrence and lack of standardised clinical definitions and outcome measures. METHODS: This is a prospective multi-centre observational cohort study of adults with CES in the UK. We assessed presentation, investigation, management, and all Core Outcome Set domains up to one year post-operatively using clinician and participant reporting. Univariable and multivariable associations with the Oswestry Disability Index (ODI) and urinary outcomes were investigated. FINDINGS: In 621 participants with CES, catheterisation for urinary retention was required pre-operatively in 31% (191/615). At discharge, only 13% (78/616) required a catheter. Median time to surgery from symptom onset was 3 days (IQR:1-8) with 32% (175/545) undergoing surgery within 48 h. Earlier surgery was associated with catheterisation (OR:2.2, 95%CI:1.5-3.3) but not with admission ODI or radiological compression. In multivariable analyses catheter requirement at discharge was associated with pre-operative catheterisation (OR:10.6, 95%CI:5.8-20.4) and one-year ODI was associated with presentation ODI (r = 0.3, 95%CI:0.2-0.4), but neither outcome was associated with time to surgery or radiological compression. Additional healthcare services were required by 65% (320/490) during one year follow up. INTERPRETATION: Post-operative functional improvement occurred even in those presenting with urinary retention. There was no association between outcomes and time to surgery in this observational study. Significant healthcare needs remained post-operatively. FUNDING: DCN Endowment Fund funded study administration. Castor EDC provided database use. No other study funding was received

More questions than answers to the diagnosis and management of cauda equina syndrome—Authors’ reply

No abstract available

CovidNeuroOnc: A UK multicenter, prospective cohort study of the impact of the COVID-19 pandemic on the neuro-oncology service

BackgroundThe COVID-19 pandemic has profoundly affected cancer services. Our objective was to determine the effect of the COVID-19 pandemic on decision making and the resulting outcomes for patients with newly diagnosed or recurrent intracranial tumors.MethodsWe performed a multicenter prospective study of all adult patients discussed in weekly neuro-oncology and skull base multidisciplinary team meetings who had a newly diagnosed or recurrent intracranial (excluding pituitary) tumor between 01 April and 31 May 2020. All patients had at least 30-day follow-up data. Descriptive statistical reporting was used.ResultsThere were 1357 referrals for newly diagnosed or recurrent intracranial tumors across 15 neuro-oncology centers. Of centers with all intracranial tumors, a change in initial management was reported in 8.6% of cases (n = 104/1210). Decisions to change the management plan reduced over time from a peak of 19% referrals at the start of the study to 0% by the end of the study period. Changes in management were reported in 16% (n = 75/466) of cases previously recommended for surgery and 28% of cases previously recommended for chemotherapy (n = 20/72). The reported SARS-CoV-2 infection rate was similar in surgical and non-surgical patients (2.6% vs. 2.4%, P > .9).ConclusionsDisruption to neuro-oncology services in the UK caused by the COVID-19 pandemic was most marked in the first month, affecting all diagnoses. Patients considered for chemotherapy were most affected. In those recommended surgical treatment this was successfully completed. Longer-term outcome data will evaluate oncological treatments received by these patients and overall survival

Outcomes following surgery in subgroups of comatose and very elderly patients with chronic subdural hematoma

Increasing age and lower pre-operative Glasgow coma score (GCS) are associated with worse outcome after surgery for chronic subdural haematoma (CSDH). Only few studies have quantified outcomes specific to the very elderly or comatose patients. We aim to examine surgical outcomes in these patient groups. We analysed data from a prospective multicentre cohort study, assessing the risk of recurrence, death, and unfavourable functional outcome of very elderly (≥ 90 years) patients and comatose (pre-operative GCS ≤ 8) patients following surgical treatment of CSDH. Seven hundred eighty-five patients were included in the study. Thirty-two (4.1%) patients had pre-operative GCS ≤ 8 and 70 (8.9%) patients were aged ≥ 90 years. A higher proportion of comatose patients had an unfavourable functional outcome (38.7 vs 21.7%; p = 0.03), although similar proportion of comatose (64.5%) and non-comatose patients (61.8%) functionally improved after surgery (p = 0.96). Compared to patients aged < 90 years, a higher proportion of patients aged ≥ 90 years had unfavourable functional outcome (41.2 vs 20.5%; p < 0.01), although approximately half had functional improvement following surgery. Mortality risk was higher in both comatose (6.3 vs 1.9%; p = 0.05) and very elderly (8.8 vs 1.1%; p < 0.01) groups. There was a trend towards a higher recurrence risk in the comatose group (19.4 vs 9.5%; p = 0.07). Surgery can still provide considerable benefit to very elderly and comatose patients despite their higher risk of morbidity and mortality. Further research would be needed to better identify those most likely to benefit from surgery in these groups