Random-effects meta-analysis of the clinical utility of tests and prediction models

The use of data from multiple studies or centers for the validation of a clinical test or a multivariable prediction model allows researchers to investigate the test's/model's performance in multiple settings and populations. Recently, meta-analytic techniques have been proposed to summarize discrimination and calibration across study populations. Here, we rather consider performance in terms of net benefit, which is a measure of clinical utility that weighs the benefits of true positive classifications against the harms of false positives. We posit that it is important to examine clinical utility across multiple settings of interest. This requires a suitable meta-analysis method, and we propose a Bayesian trivariate random-effects meta-analysis of sensitivity, specificity, and prevalence. Across a range of chosen harm-to-benefit ratios, this provides a summary measure of net benefit, a prediction interval, and an estimate of the probability that the test/model is clinically useful in a new setting. In addition, the prediction interval and probability of usefulness can be calculated conditional on the known prevalence in a new setting. The proposed methods are illustrated by 2 case studies: one on the meta-analysis of published studies on ear thermometry to diagnose fever in children and one on the validation of a multivariable clinical risk prediction model for the diagnosis of ovarian cancer in a multicenter dataset. Crucially, in both case studies the clinical utility of the test/model was heterogeneous across settings, limiting its usefulness in practice. This emphasizes that heterogeneity in clinical utility should be assessed before a test/model is routinely implemented

Recommendations for implementing stereotactic radiotherapy in peripheral stage IA non-small cell lung cancer: report from the Quality Assurance Working Party of the randomised phase III ROSEL study

<p>Abstract</p> <p>Background</p> <p>A phase III multi-centre randomised trial (ROSEL) has been initiated to establish the role of stereotactic radiotherapy in patients with operable stage IA lung cancer. Due to rapid changes in radiotherapy technology and evolving techniques for image-guided delivery, guidelines had to be developed in order to ensure uniformity in implementation of stereotactic radiotherapy in this multi-centre study.</p> <p>Methods/Design</p> <p>A Quality Assurance Working Party was formed by radiation oncologists and clinical physicists from both academic as well as non-academic hospitals that had already implemented stereotactic radiotherapy for lung cancer. A literature survey was conducted and consensus meetings were held in which both the knowledge from the literature and clinical experience were pooled. In addition, a planning study was performed in 26 stage I patients, of which 22 were stage 1A, in order to develop and evaluate the planning guidelines. Plans were optimised according to parameters adopted from RTOG trials using both an algorithm with a simple homogeneity correction (Type A) and a more advanced algorithm (Type B). Dose conformity requirements were then formulated based on these results.</p> <p>Conclusion</p> <p>Based on current literature and expert experience, guidelines were formulated for this phase III study of stereotactic radiotherapy versus surgery. These guidelines can serve to facilitate the design of future multi-centre clinical trials of stereotactic radiotherapy in other patient groups and aid a more uniform implementation of this technique outside clinical trials.</p

Strategies to diagnose ovarian cancer: new evidence from phase 3 of the multicentre international IOTA study

Background: To compare different ultrasound-based international ovarian tumour analysis (IOTA) strategies and risk of malignancy index (RMI) for ovarian cancer diagnosis using a meta-analysis approach of centre-specific data from IOTA3. Methods: This prospective multicentre diagnostic accuracy study included 2403 patients with 1423 benign and 980 malignant adnexal masses from 2009 until 2012. All patients underwent standardised transvaginal ultrasonography. Test performance of RMI, subjective assessment (SA) of ultrasound findings, two IOTA risk models (LR1 and LR2), and strategies involving combinations of IOTA simple rules (SRs), simple descriptors (SDs) and LR2 with and without SA was estimated using a meta-analysis approach. Reference standard was histology after surgery. Results: The areas under the receiver operator characteristic curves of LR1, LR2, SA and RMI were 0.930 (0.917–0.942), 0.918 (0.905–0.930), 0.914 (0.886–0.936) and 0.875 (0.853–0.894). Diagnostic one-step and two-step strategies using LR1, LR2, SR and SD achieved summary estimates for sensitivity 90–96%, specificity 74–79% and diagnostic odds ratio (DOR) 32.8–50.5. Adding SA when IOTA methods yielded equivocal results improved performance (DOR 57.6–75.7). Risk of Malignancy Index had sensitivity 67%, specificity 91% and DOR 17.5. Conclusions: This study shows all IOTA strategies had excellent diagnostic performance in comparison with RMI. The IOTA strategy chosen may be determined by clinical preference

Normal tissue toxicity after small field hypofractionated stereotactic body radiation

Stereotactic body radiation (SBRT) is an emerging tool in radiation oncology in which the targeting accuracy is improved via the detection and processing of a three-dimensional coordinate system that is aligned to the target. With improved targeting accuracy, SBRT allows for the minimization of normal tissue volume exposed to high radiation dose as well as the escalation of fractional dose delivery. The goal of SBRT is to minimize toxicity while maximizing tumor control. This review will discuss the basic principles of SBRT, the radiobiology of hypofractionated radiation and the outcome from published clinical trials of SBRT, with a focus on late toxicity after SBRT. While clinical data has shown SBRT to be safe in most circumstances, more data is needed to refine the ideal dose-volume metrics

Radical stereotactic radiosurgery with real-time tumor motion tracking in the treatment of small peripheral lung tumors

<p>Abstract</p> <p>Background</p> <p>Recent developments in radiotherapeutic technology have resulted in a new approach to treating patients with localized lung cancer. We report preliminary clinical outcomes using stereotactic radiosurgery with real-time tumor motion tracking to treat small peripheral lung tumors.</p> <p>Methods</p> <p>Eligible patients were treated over a 24-month period and followed for a minimum of 6 months. Fiducials (3–5) were placed in or near tumors under CT-guidance. Non-isocentric treatment plans with 5-mm margins were generated. Patients received 45–60 Gy in 3 equal fractions delivered in less than 2 weeks. CT imaging and routine pulmonary function tests were completed at 3, 6, 12, 18, 24 and 30 months.</p> <p>Results</p> <p>Twenty-four consecutive patients were treated, 15 with stage I lung cancer and 9 with single lung metastases. Pneumothorax was a complication of fiducial placement in 7 patients, requiring tube thoracostomy in 4. All patients completed radiation treatment with minimal discomfort, few acute side effects and no procedure-related mortalities. Following treatment transient chest wall discomfort, typically lasting several weeks, developed in 7 of 11 patients with lesions within 5 mm of the pleura. Grade III pneumonitis was seen in 2 patients, one with prior conventional thoracic irradiation and the other treated with concurrent Gefitinib. A small statistically significant decline in the mean % predicted DLCO was observed at 6 and 12 months. All tumors responded to treatment at 3 months and local failure was seen in only 2 single metastases. There have been no regional lymph node recurrences. At a median follow-up of 12 months, the crude survival rate is 83%, with 3 deaths due to co-morbidities and 1 secondary to metastatic disease.</p> <p>Conclusion</p> <p>Radical stereotactic radiosurgery with real-time tumor motion tracking is a promising well-tolerated treatment option for small peripheral lung tumors.</p

Bilateral Sensory Abnormalities in Patients with Unilateral Neuropathic Pain; A Quantitative Sensory Testing (QST) Study

In patients who experience unilateral chronic pain, abnormal sensory perception at the non-painful side has been reported. Contralateral sensory changes in these patients have been given little attention, possibly because they are regarded as clinically irrelevant. Still, bilateral sensory changes in these patients could become clinically relevant if they challenge the correct identification of their sensory dysfunction in terms of hyperalgesia and allodynia. Therefore, we have used the standardized quantitative sensory testing (QST) protocol of the German Research Network on Neuropathic Pain (DFNS) to investigate somatosensory function at the painful side and the corresponding non-painful side in unilateral neuropathic pain patients using gender- and age-matched healthy volunteers as a reference cohort. Sensory abnormalities were observed across all QST parameters at the painful side, but also, to a lesser extent, at the contralateral, non-painful side. Similar relative distributions regarding sensory loss/gain for non-nociceptive and nociceptive stimuli were found for both sides. Once a sensory abnormality for a QST parameter at the affected side was observed, the prevalence of an abnormality for the same parameter at the non-affected side was as high as 57% (for Pressure Pain Threshold). Our results show that bilateral sensory dysfunction in patients with unilateral neuropathic pain is more rule than exception. Therefore, this phenomenon should be taken into account for appropriate diagnostic evaluation in clinical practice. This is particularly true for mechanical stimuli where the 95% Confidence Interval for the prevalence of sensory abnormalities at the non-painful side ranges between 33% and 50%

Implications of a high-definition multileaf collimator (HD-MLC) on treatment planning techniques for stereotactic body radiation therapy (SBRT): a planning study

<p>Abstract</p> <p>Purpose</p> <p>To assess the impact of two multileaf collimator (MLC) systems (2.5 and 5 mm leaf widths) on three-dimensional conformal radiotherapy, intensity-modulated radiotherapy, and dynamic conformal arc techniques for stereotactic body radiation therapy (SBRT) of liver and lung lesions.</p> <p>Methods</p> <p>Twenty-nine SBRT plans of primary liver (n = 11) and lung (n = 18) tumors were the basis of this study. Five-millimeter leaf width 120-leaf Varian Millennium (M120) MLC-based plans served as reference, and were designed using static conformal beams (3DCRT), sliding-window intensity-modulated beams (IMRT), or dynamic conformal arcs (DCA). Reference plans were either re-optimized or recomputed, with identical planning parameters, for a 2.5-mm width 120-leaf BrainLAB/Varian high-definition (HD120) MLC system. Dose computation was based on the anisotropic analytical algorithm (AAA, Varian Medical Systems) with tissue heterogeneity taken into account. Each plan was normalized such that 100% of the prescription dose covered 95% of the planning target volume (PTV). Isodose distributions and dose-volume histograms (DVHs) were computed and plans were evaluated with respect to target coverage criteria, normal tissue sparing criteria, as well as treatment efficiency.</p> <p>Results</p> <p>Dosimetric differences achieved using M120 and the HD120 MLC planning were generally small. Dose conformality improved in 51.7%, 62.1% and 55.2% of the IMRT, 3DCRT and DCA cases, respectively, with use of the HD120 MLC system. Dose heterogeneity increased in 75.9%, 51.7%, and 55.2% of the IMRT, 3DCRT and DCA cases, respectively, with use of the HD120 MLC system. DVH curves demonstrated a decreased volume of normal tissue irradiated to the lower (90%, 50% and 25%) isodose levels with the HD120 MLC.</p> <p>Conclusion</p> <p>Data derived from the present comparative assessment suggest dosimetric merit of the high definition MLC system over the millennium MLC system. However, the clinical significance of these results warrants further investigation in order to determine whether the observed dosimetric advantages translate into outcome improvements.</p