Reproducibility in the absence of selective reporting : An illustration from large-scale brain asymmetry research

Altres ajuts: Max Planck Society (Germany).The problem of poor reproducibility of scientific findings has received much attention over recent years, in a variety of fields including psychology and neuroscience. The problem has been partly attributed to publication bias and unwanted practices such as p-hacking. Low statistical power in individual studies is also understood to be an important factor. In a recent multisite collaborative study, we mapped brain anatomical left-right asymmetries for regional measures of surface area and cortical thickness, in 99 MRI datasets from around the world, for a total of over 17,000 participants. In the present study, we revisited these hemispheric effects from the perspective of reproducibility. Within each dataset, we considered that an effect had been reproduced when it matched the meta-analytic effect from the 98 other datasets, in terms of effect direction and significance threshold. In this sense, the results within each dataset were viewed as coming from separate studies in an "ideal publishing environment," that is, free from selective reporting and p hacking. We found an average reproducibility rate of 63.2% (SD = 22.9%, min = 22.2%, max = 97.0%). As expected, reproducibility was higher for larger effects and in larger datasets. Reproducibility was not obviously related to the age of participants, scanner field strength, FreeSurfer software version, cortical regional measurement reliability, or regional size. These findings constitute an empirical illustration of reproducibility in the absence of publication bias or p hacking, when assessing realistic biological effects in heterogeneous neuroscience data, and given typically-used sample sizes

Diffusion-weighted MR imaging in primary rectal cancer staging demonstrates but does not characterise lymph nodes

OBJECTIVES: To evaluate the performance of diffusion-weighted MRI (DWI) detection of lymph nodes and for differentiating between benign and nodes during primary rectal cancer staging. METHODS: Twenty-one patients underwent 1.5-T MRI followed by surgery (+/- preoperative 5 x 5 Gy). consisted of T2-weighted MRI, DWI (b0, 500, 1000), and 3DT1-weighted MRI 1-mm isotropic voxels. The latter was used for accurate detection and histological validation of nodes. Two independent readers analysed the intensity on DWI and measured the mean apparent diffusion coefficient each node (ADCnode) and the ADC of each node relative to the mean tumour (ADCrel). RESULTS: DWI detected 6 % more nodes than T2W-MRI. The signal was not accurate for the differentiation of metastatic nodes (AUC 0.45- Interobserver reproducibility for the nodal ADC measurements was 0.93). Mean ADCnode was higher for benign than for malignant nodes (1.15 vs. 1.04 +/- 0.22 *10-3 mm2/s), though not statistically significant (P Area under the ROC curve/sensitivity/specificity for the assessment of nodes were 0.64/67 %/60 % for ADCnode and 0.67/75 %/61 % for ADCrel. DWI can facilitate lymph node detection, but alone it is not reliable differentiating between benign and malignant lymph nodes. KEY POINTS: * Diffusion-weighted (DW) magnetic resonance imaging (MRI) offers new in rectal cancer. * DW MRI demonstrates more lymph nodes than standard T2-weighted MRI. * Visual DWI assessment does not discriminate between metastatic nodes. * Apparent diffusion coefficients do not discriminate benign and metastatic nodes

T2 weighted signal intensity evolution may predict pathological complete response after treatment for rectal cancer.

OBJECTIVES: To determine the diagnostic value of T2-weighted signal intensity evolution in the tumour for detection of complete response to neoadjuvant chemoradiotherapy in patients with rectal cancer. METHODS: Thirty-nine patients diagnosed with locally advanced adenocarcinoma and treated with chemoradiotherapy (CRT), followed by surgery, underwent magnetic resonance imaging (MRI) before and after CRT on 1.5-T MRI using T2-weighted fast spin-echo (FSE) imaging. The relative T2-weighted signal intensity (rT2wSI) distribution in the tumour and post-CRT residual tissue was characterised by means of the descriptive statistical parameters, such as the mean, 95th percentile and standard deviation (SD). Receiver operating characteristic curves were used to determine the diagnostic potential of the CRT-induced alterations (Delta) in rT2wSI descriptives. The tumour regression grade (TRG) served as a histopathological reference standard. RESULTS: CRT induced a significant decrease of approximately 50% in all rT2wSI descriptives in complete responders (TRG1). This drop was significantly larger than for incomplete response groups (TRG2-TRG4). The DeltarT2wSI descriptives produced a high diagnostic performance for identification of complete responders, e.g. Delta95th percentile, DeltaSD and Deltamean resulted in accuracy of 92%, 90% and 82%, respectively. CONCLUSIONS: Quantitative assessment of the CRT-induced changes in the tumour T2-weighted signal intensity provides high diagnostic performance for selection of complete responders. KEY POINTS : * T2 weighted MRI helps predict response after chemoradiotherapy for rectal cancer. * Residual tumour and chemoradiotherapy-induced fibrosis have different T2 relaxation properties. * T2-weighted signal intensity evolution is a promising non-invasive marker of therapeutic response. * A pathologically complete response is associated with the largest signal intensity drop

Rectal Cancer: Assessment of Complete Response to Preoperative Combined Radiation Therapy with Chemotherapy--Conventional MR Volumetry versus Diffusion-weighted MR Imaging.

Purpose: To determine diagnostic performance of diffusion-weighted (DW) magnetic resonance (MR) imaging for assessment of complete tumor response (CR) after combined radiation therapy with chemotherapy (CRT) in patients with locally advanced rectal cancer (LARC) by means of volumetric signal intensity measurements and apparent diffusion coefficient (ADC) measurements and to compare the performance of DW imaging with that of T2-weighted MR volumetry. Materials and Methods: A retrospective analysis of 50 patients with LARC, for whom clinical and imaging data were retrieved from a previous imaging study approved by the local institutional ethical committee and for which all patients provided informed consent, was conducted. Patients underwent pre- and post-CRT standard T2-weighted MR and DW MR. Two independent readers placed free-hand regions of interest (ROIs) in each tumor-containing section on both data sets to determine pre- and post-CRT tumor volumes and tumor volume reduction rates (volume). ROIs were copied to an ADC map to calculate tumor ADCs. Histopathologic findings were the standard of reference. Receiver operating characteristic (ROC) curves were generated to compare performance of T2-weighted and DW MR volumetry and ADC. The intraclass correlation coefficient (ICC) was used to evaluate interobserver variability and the correlation between T2-weighted and DW MR volumetry. Results: Areas under the ROC curve (AUCs) for identification of a CR that was based on pre-CRT volume, post-CRT volume, and volume, respectively, were 0.57, 0.70, and 0.84 for T2-weighted MR versus 0.63, 0.93, and 0.92 for DW MR volumetry (P = .15, .02, .42). Pre- and post-CRT ADC and ADC AUCs were 0.55, 0.54, and 0.51, respectively. Interobserver agreement was excellent for all pre-CRT measurements (ICC, 0.91-0.96) versus good (ICC, 0.61-0.79) for post-CRT measurements. ICC between T2-weighted and DW MR volumetry was excellent (0.97) for pre-CRT measurements versus fair (0.25) for post-CRT measurements. Conclusion: Post-CRT DW MR volumetry provided high diagnostic performance in assessing CR and was significantly more accurate than T2-weighted MR volumetry. Post-CRT DW MR was equally as accurate as volume measurements of both T2-weighted and DW MR. Pre-CRT volumetry and ADC were not reliable. (c) RSNA, 2011

Prospective, Multicenter Validation Study of Magnetic Resonance Volumetry for Response Assessment After Preoperative Chemoradiation in Rectal Cancer: Can the Results in the Literature be Reproduced?

PURPOSE: To review the available literature on tumor size/volume measurements on magnetic resonance imaging for response assessment after chemoradiotherapy, and validate these cut-offs in an independent multicenter patient cohort. METHODS AND MATERIALS: The study included 2 parts. (1) REVIEW OF THE LITERATURE: articles were included that assessed the accuracy of tumor size/volume measurements on magnetic resonance imaging for tumor response assessment. Size/volume cut-offs were extracted; (2) Multicenter validation: extracted cut-offs from the literature were tested in a multicenter cohort (n=146). Accuracies were calculated and compared with reported results from the literature. RESULTS: The review included 14 articles, in which 3 different measurement methods were assessed: (1) tumor length; (2) 3-dimensonial tumor size; and (3) whole volume. Study outcomes consisted of (1) complete response (ypT0) versus residual tumor; (2) tumor regression grade 1 to 2 versus 3 to 5; and (3) T-downstaging (ypT<cT). In the multicenter cohort, best results were obtained for the validation of the whole-volume measurements, in particular for the outcome ypT0 (accuracy 44%-80%), with the optimal cut-offs being 1.6 cm(3) (after chemoradiation therapy) and a volume reduction of Delta80% to 86.6%. Accuracies for whole-volume measurements to assess tumor regression grade 1 to 2 were 52% to 61%, and for T-downstaging 51% to 57%. Overall accuracies for tumor length ranged between 48% and 53% and for 3D size measurement between 52% and 56%. CONCLUSIONS: Magnetic resonance volumetry using whole-tumor volume measurements can be helpful in rectal cancer response assessment with selected cut-off values. Measurements of tumor length or 3-dimensional tumor size are not helpful. Magnetic resonance volumetry is mainly accurate to assess a complete tumor response (ypT0) after chemoradiation therapy (accuracies up to 80%)

Gadofosveset-enhanced MRI for the assessment of rectal cancer lymph nodes: predictive criteria.

PURPOSE: To confirm the use of the nodal signal intensity (SI) and the 'chemical shift' artefact as diagnostic criteria for detecting nodal metastases from rectal cancer on gadofosveset contrast-enhanced MRI. METHODS: Thirty-three patients underwent a non-enhanced and gadofosveset-enhanced 3D-T1W GRE-MRI at 1.5T. For each lymph node, the SI of the middle part of the node (mSI) and white rim of the chemical shift artefact encircling the node (wSI) were measured on the non-enhanced and gadofosveset-enhanced images. Second, the aspect of the chemical shift artefact encircling the nodes was scored using a 4-point scale. Results were compared with histology on a node-by-node basis. RESULTS: 289 nodes (55 N+) were analysed. On gadofosveset-MRI, mSI and wSI were significantly higher for the benign than for the metastatic lymph nodes (p < 0.001). Areas under the ROC curve (AUC) for identification of metastases were 0.74 (mSI) and 0.73 (wSI). The chemical shift criterion rendered an AUC of 0.85. The combination of mSI and the chemical shift criterion resulted in an AUC of 0.88 and the rendered an AUC of 0.86-0.92 when subjectively (visually) assessed by two independent readers. CONCLUSIONS: Benign lymph nodes show significant contrast enhancement after gadofosveset injection, while metastatic nodes do not. The uptake of gadofosveset in the nodes also affects the chemical shift artefact encircling the nodes. Combined assessment of these two features on gadofosveset-enhanced MRI provides a high diagnostic performance for diagnosing metastatic lymph nodes in patients with rectal cancer

Whole-liver CT texture analysis in colorectal cancer: Does the presence of liver metastases affect the texture of the remaining liver?

BACKGROUND: Liver metastases limit survival in colorectal cancer. Earlier detection of (occult) metastatic disease may benefit treatment and survival. OBJECTIVE: The objective of this article is to evaluate the potential of whole-liver CT texture analysis of apparently disease-free liver parenchyma for discriminating between colorectal cancer (CRC) patients with and without hepatic metastases. METHODS: The primary staging CT examinations of 29 CRC patients were retrospectively analysed. Patients were divided into three groups: patients without liver metastases (n = 15), with synchronous liver metastases (n = 10) and metachronous liver metastases within 18 months following primary staging (n = 4). Whole-liver texture analysis was performed by delineation of the apparently non-diseased liver parenchyma (excluding metastases or other focal liver lesions) on portal phase images. Mean grey-level intensity (M), entropy (E) and uniformity (U) were derived with no filtration and different filter widths (0.5 = fine, 1.5 = medium, 2.5 = coarse). RESULTS: Mean E1.5 and E2.5 for the whole liver in patients with synchronous metastases were significantly higher compared with the non-metastatic patients (p = 0.02 and p = 0.01). Mean U1.5 and U2.5 were significantly lower in the synchronous metastases group compared with the non-metastatic group (p = 0.04 and p = 0.02). Texture parameters for the metachronous metastases group were not significantly different from the non-metastatic group or synchronous metastases group (p > 0.05), although - similar to the synchronous metastases group - there was a subtle trend towards increased E1.5, E2.5 and decreased U1.5, U2.5 values. Areas under the ROC curve for the diagnosis of synchronous metastatic disease based on the texture parameters E1.5,2.5 and U1.5,2.5 ranged between 0.73 and 0.78. CONCLUSION: Texture analysis of the apparently non-diseased liver holds promise to differentiate between CRC patients with and without metastatic liver disease. Further research is required to determine whether these findings may be used to benefit the prediction of metachronous liver disease

Wait-and-see policy for clinical complete responders after chemoradiation for rectal cancer

PURPOSENeoadjuvant chemoradiotherapy for rectal cancer can result in complete disappearance of tumor and involved nodes. In patients without residual tumor on imaging and endoscopy (clinical complete response [cCR]) a wait-and-see-policy (omission of surgery with follow-up) might be considered instead of surgery. The purpose of this prospective cohort study was to evaluate feasibility and safety of a wait-and-see policy with strict selection criteria and follow-up. PATIENTS AND METHODSPatients with a cCR after chemoradiotherapy were prospectively selected for the wait-and-see policy with magnetic resonance imaging (MRI) and endoscopy plus biopsies. Follow-up was performed 3 to 6 monthly and consisted of MRI, endoscopy, and computed tomography scans. A control group of patients with a pathologic complete response (pCR) after surgery was identified from a prospective cohort study. Functional outcome was measured with the Memorial Sloan-Kettering Cancer Center (MSKCC) bowel function questionnaire and Wexner incontinence score. Long-term outcome was estimated by using Kaplan-Meier curves.ResultsTwenty-one patients with cCR were included in the wait-and-see policy group. Mean follow-up was 25 +/- 19 months. One patient developed a local recurrence and had surgery as salvage treatment. The other 20 patients are alive without disease. The control group consisted of 20 patients with a pCR after surgery who had a mean follow-up of 35 +/- 23 months. For these patients with a pCR, cumulative probabilities of 2-year disease-free survival and overall survival were 93% and 91%, respectively. CONCLUSIONA wait-and-see policy with strict selection criteria, up-to-date imaging techniques, and follow-up is feasible and results in promising outcome at least as good as that of patients with a pCR after surgery. The proposed selection criteria and follow-up could form the basis for future randomized studies