Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses

Articles published in several prominent educational journals were examined to investigate the use of data-analysis tools by researchers in four research paradigms: between-subjects univariate designs, between-subjects multivariate designs, repeated measures designs, and covariance designs. In addition to examining specific details pertaining to the research design (e.g., sample size, group size equality/inequality) and methods employed for data analysis, we also catalogued whether: (a) validity assumptions were examined, (b) effect size indices were reported, (c) sample sizes were selected based on power considerations, and (d) appropriate textbooks and/or articles were cited to communicate the nature of the analyses that were performed. Our analyses imply that researchers rarely verify that validity assumptions are satisfied and accordingly typically use analyses that are nonrobust to assumption violations. In addition, researchers rarely report effect size statistics, nor do they routinely perform power analyses to determine sample size requirements. We offer many recommendations to rectify these shortcomings.Social Sciences and Humanities Research Counci

Academic performance of undergraduate dental students with learning disabilities

© 2017 British Dental Association. All rights reserved.Aims To compare the academic performance of undergraduate dental students with known learning disabilities (LDs) to their peers.Methods This study analysed the results of students in applied dental knowledge (ADK) progress tests across four cohorts of dental students. A mixed model analysis of variance (ANOVA) was conducted to compare the performance of students with known disability to their peers. ADK test sitting was treated as a repeated measures variable, and the outcome variable of interest was percentage score on the ADK.Results Students' performance data on five ADK test sittings (ADK15, ADK16, ADK17, ADK18, and ADK19) by disability showed a significant main effect of test but no significant effect of disability or any interaction between disability and test.Conclusions This is the first study that explores the academic performance of dental students with a diagnosis of disability. The findings give reassurance to all stakeholders that, within the study population, students with LDs are not disadvantaged in knowledge-based assessments, demonstrating compliance with the legal obligations. Further research is required to explore how generalisable these findings are, as well as assess academic, clinical, and behavioural attributes of students with learning disabilities

The effect of skewness and kurtosis on the robustness of linear mixed models

This study analyzes the robustness of the linear mixed model (LMM) with the Kenward–Roger (KR) procedure to violations of normality and sphericity when used in split-plot designs with small sample sizes. Specifically, it explores the independent effect of skewness and kurtosis on KR robustness for the values of skewness and kurtosis coefficients that are most frequently found in psychological and educational research data. To this end, a Monte Carlo simulation study was designed, considering a split-plot design with three levels of the between-subjects grouping factor and four levels of the within-subjects factor. Robustness is assessed in terms of the probability of type I error. The results showed that (1) the robustness of the KR procedure does not differ as a function of the violation or satisfaction of the sphericity assumption when small samples are used; (2) the LMM with KR can be a good option for analyzing total sample sizes of 45 or larger when their distributions are normal, slightly or moderately skewed, and with different degrees of kurtosis violation; (3) the effect of skewness on the robustness of the LMM with KR is greater than the corresponding effect of kurtosis for common values; and (4) when data are not normal and the total sample size is 30, the procedure is not robust. Alternative analyses should be performed when the total sample size is 30

Temporal estimation with two moving objects: overt and covert pursuit

The current study examined temporal estimation in a prediction motion task where participants were cued to overtly pursue one of two moving objects, which could either arrive first, i.e., shortest [time to contact (TTC)] or second (i.e., longest TTC) after a period of occlusion. Participants were instructed to estimate TTC of the first-arriving object only, thus making it necessary to overtly pursue the cued object while at the same time covertly pursuing the other (non-cued) object. A control (baseline) condition was also included in which participants had to estimate TTC of a single, overtly pursued object. Results showed that participants were able to estimate the arrival order of the two objects with very high accuracy irrespective of whether they had overtly or covertly pursued the first-arriving object. However, compared to the single-object baseline, participants’ temporal estimation of the covert object was impaired when it arrived 500 ms before the overtly pursued object. In terms of eye movements, participants exhibited significantly more switches in gaze location during occlusion from the cued to the non-cued object but only when the latter arrived first. Still, comparison of trials with and without a switch in gaze location when the non-cued object arrived first indicated no advantage for temporal estimation. Taken together, our results indicate that overt pursuit is sufficient but not necessary for accurate temporal estimation. Covert pursuit can enable representation of a moving object’s trajectory and thereby accurate temporal estimation providing the object moves close to the overt attentional focus

Alcohol policy enforcement and changes in student drinking rates in a statewide public college system: a follow-up study

<p>Abstract</p> <p>Background</p> <p>Heavy alcohol use among U.S. college students is a major contributor to young adult morbidity and mortality. The aim of this study was to examine whether college alcohol policy enforcement levels predict changes in student drinking and related behaviors in a state system of public colleges and universities, following a system-wide change to a stricter policy.</p> <p>Methods</p> <p>Students and administrators at 11 Massachusetts public colleges/universities completed surveys in 1999 (N of students = 1252), one year after the policy change, and again in 2001 (N = 1074). We calculated policy enforcement scores for each school based on the reports of deans of students, campus security chiefs, and students, and examined the correlations between perceived enforcement levels and the change in student drinking rates over the subsequent two year period, after weighting the 2001 data to adjust for demographic changes in the student body.</p> <p>Results</p> <p>Overall rates of any past-30-days drinking, heavy episodic drinking, and usual heavy drinking among past-30-days drinkers were all lower in 2001 compared to 1999. School-level analyses (N = 11) found deans' baseline reports of stricter enforcement were strongly correlated with subsequent declines in heavy episodic drinking (Pearson's r = -0.73, p = 0.011). Moreover, consistently high enforcement levels across time, as reported by deans, were associated with greater declines in heavy episodic drinking. Such relationships were not found for students' and security chiefs' reports of enforcement. Marijuana use did not rise during this period of decline in heavy drinking.</p> <p>Conclusions</p> <p>Study findings suggest that stronger enforcement of a stricter alcohol policy may be associated with reductions in student heavy drinking rates over time. An aggressive enforcement stance by deans may be an important element of an effective college alcohol policy.</p

MEG Can Map Short and Long-Term Changes in Brain Activity following Deep Brain Stimulation for Chronic Pain

Deep brain stimulation (DBS) has been shown to be clinically effective for some forms of treatment-resistant chronic pain, but the precise mechanisms of action are not well understood. Here, we present an analysis of magnetoencephalography (MEG) data from a patient with whole-body chronic pain, in order to investigate changes in neural activity induced by DBS for pain relief over both short- and long-term. This patient is one of the few cases treated using DBS of the anterior cingulate cortex (ACC). We demonstrate that a novel method, null-beamforming, can be used to localise accurately brain activity despite the artefacts caused by the presence of DBS electrodes and stimulus pulses. The accuracy of our source localisation was verified by correlating the predicted DBS electrode positions with their actual positions. Using this beamforming method, we examined changes in whole-brain activity comparing pain relief achieved with deep brain stimulation (DBS ON) and compared with pain experienced with no stimulation (DBS OFF). We found significant changes in activity in pain-related regions including the pre-supplementary motor area, brainstem (periaqueductal gray) and dissociable parts of caudal and rostral ACC. In particular, when the patient reported experiencing pain, there was increased activity in different regions of ACC compared to when he experienced pain relief. We were also able to demonstrate long-term functional brain changes as a result of continuous DBS over one year, leading to specific changes in the activity in dissociable regions of caudal and rostral ACC. These results broaden our understanding of the underlying mechanisms of DBS in the human brain

Age, extent and carbon storage of the central Congo Basin peatland complex

Peatlands are carbon-rich ecosystems that cover just three per cent of Earth's land surface, but store one-third of soil carbon. Peat soils are formed by the build-up of partially decomposed organic matter under waterlogged anoxic conditions. Most peat is found in cool climatic regions where unimpeded decomposition is slower, but deposits are also found under some tropical swamp forests. Here we present field measurements from one of the world's most extensive regions of swamp forest, the Cuvette Centrale depression in the central Congo Basin. We find extensive peat deposits beneath the swamp forest vegetation (peat defined as material with an organic matter content of at least 65 per cent to a depth of at least 0.3 metres). Radiocarbon dates indicate that peat began accumulating from about 10,600 years ago, coincident with the onset of more humid conditions in central Africa at the beginning of the Holocene. The peatlands occupy large interfluvial basins, and seem to be largely rain-fed and ombrotrophic-like (of low nutrient status) systems. Although the peat layer is relatively shallow (with a maximum depth of 5.9 metres and a median depth of 2.0 metres), by combining in situ and remotely sensed data, we estimate the area of peat to be approximately 145,500 square kilometres (95 per cent confidence interval of 131,900-156,400 square kilometres), making the Cuvette Centrale the most extensive peatland complex in the tropics. This area is more than five times the maximum possible area reported for the Congo Basin in a recent synthesis of pantropical peat extent. We estimate that the peatlands store approximately 30.6 petagrams (30.6 × 10(15) grams) of carbon belowground (95 per cent confidence interval of 6.3-46.8 petagrams of carbon)-a quantity that is similar to the above-ground carbon stocks of the tropical forests of the entire Congo Basin. Our result for the Cuvette Centrale increases the best estimate of global tropical peatland carbon stocks by 36 per cent, to 104.7 petagrams of carbon (minimum estimate of 69.6 petagrams of carbon; maximum estimate of 129.8 petagrams of carbon). This stored carbon is vulnerable to land-use change and any future reduction in precipitation