Internet gaming disorder as a formative construct : implications for conceptualization and measurement

Background. Some people have serious problems controlling their internet and video game use. The DSM-5 now includes a proposal for ‘Internet Gaming Disorder’ as a condition in need of further study. Various studies aim to validate the proposed diagnostic criteria for Internet Gaming Disorder and multiple new scales have been introduced that cover the suggested criteria. Approach. Using a structured approach, we demonstrate that Internet Gaming Disorder might be better interpreted as a formative construct, as opposed to the current practice of conceptualizing it as a reflective construct. Incorrectly approaching a formative construct as a reflective one causes serious problems in scale development including (a) incorrect reliance on item-to-total scale correlation to exclude items and incorrectly relying on indices of inter-item reliability that do not fit the measurement model (e.g., Cronbach’s α) (b) incorrect interpretation of composite or mean scores that assume all items are equal in contributing value to a sum score, and (c) biased estimation of model parameters in statistical models. Implications. We show that these issues are impacting current validation efforts through two recent examples. A reinterpretation of Internet Gaming Disorder as a formative construct has broad consequences for current validation efforts and provides opportunities to reanalyze existing data. We discuss three broad implications for current research: (1) Composite latent constructs should be defined and used in models, (2) Item exclusion and selection should not rely on item-to-total scale correlations, and (3) Existing definitions of Internet Gaming Disorder should be enriched further

Development and Psychometric Properties of A Screening Tool for Assessing Developmental Coordination Disorder in Adults

Background: Developmental Coordination Disorder (DCD) is a neurodevelopmental disorder affecting motor coordination. Evidence suggests this disorder persists into adulthood and may be associated with biomechanical dysfunction and pain. We report on the development and initial validation of a questionnaire to assess for DCD in adults. Methods: An initial item pool (13 items) was derived from the American Psychiatric Association criteria and World Health Organisation definition for DCD. An expert panel assessed face and content validity which led to a 9-item Functional Difficulties Questionnaire (FDQ-9) with possible scores ranging from 9-36 (higher scores indicating greater functional difficulties). The FDQ-9 was piloted on individuals recruited from convenience samples. The underlying factor structure and aspects of reliability, validity and accuracy were tested. The Receiver Operating Characteristic Curve was employed to evaluate the diagnostic accuracy of the test using self-reported dyspraxia as the reference standard. Results: Principal Axis Factoring yielded a two factor solution relating to gross and fine motor skills; for conceptual parsimony these were combined. Internal reliability was high (0.81), the mean inter-item correlation was 0.51 and preliminary findings suggested satisfactory construct validity. The Area under the Curve was 0.918 [95% CI 0.84-1.00] indicating a diagnostic test with high accuracy. A cut-off score was established with a sensitivity and specificity of 86% [95% CI 78%-89%] and 81% [95 % CI 73%-89%] respectively. Test-retest reliability was good (ICC 0.96 [95% CI 0.92 to 0.98]. Conclusion: The psychometric properties of the FDQ-9 appear promising. Work is required to conduct further psychometric evaluations on new samples and apply the scale to clinical practice

Quality and validity of large animal experiments in stroke : a systematic review

An important factor for successful translational stroke research is study quality. Low-quality studies are at risk of biased results and effect overestimation, as has been intensely discussed for small animal stroke research. However, little is known about the methodological rigor and quality in large animal stroke models, which are becoming more frequently used in the field. Based on research in two databases, this systematic review surveys and analyses the methodological quality in large animal stroke research. Quality analysis was based on the Stroke Therapy Academic Industry Roundtable and the Animals in Research: Reporting In Vivo Experiments guidelines. Our analysis revealed that large animal models are utilized with similar shortcomings as small animal models. Moreover, translational benefits of large animal models may be limited due to lacking implementation of important quality criteria such as randomization, allocation concealment, and blinded assessment of outcome. On the other hand, an increase of study quality over time and a positive correlation between study quality and journal impact factor were identified. Based on the obtained findings, we derive recommendations for optimal study planning, conducting, and data analysis/reporting when using large animal stroke models to fully benefit from the translational advantages offered by these models

Psychometrics in Practice at RCEC

A broad range of topics is dealt with in this volume: from combining the psychometric generalizability and item response theories to the ideas for an integrated formative use of data-driven decision making, assessment for learning and diagnostic testing. A number of chapters pay attention to computerized (adaptive) and classification testing. Other chapters treat the quality of testing in a general sense, but for topics like maintaining standards or the testing of writing ability, the quality of testing is dealt with more specifically.\ud All authors are connected to RCEC as researchers. They present one of their current research topics and provide some insight into the focus of RCEC. The selection of the topics and the editing intends that the book should be of special interest to educational researchers, psychometricians and practitioners in educational assessment

Development of a multivariable risk model integrating urinary cell DNA methylation and cell-free RNA data for the detection of significant prostate cancer

Background: Prostate cancer exhibits severe clinical heterogeneity and there is a critical need for clinically implementable tools able to precisely and noninvasively identify patients that can either be safely removed from treatment pathways or those requiring further follow up. Our objectives were to develop a multivariable risk prediction model through the integration of clinical, urine-derived cell-free messenger RNA (cf-RNA) and urine cell DNA methylation data capable of noninvasively detecting significant prostate cancer in biopsy naïve patients. Methods: Post-digital rectal examination urine samples previously analyzed separately for both cellular methylation and cf-RNA expression within the Movember GAP1 urine biomarker cohort were selected for a fully integrated analysis (n = 207). A robust feature selection framework, based on bootstrap resampling and permutation, was utilized to find the optimal combination of clinical and urinary markers in a random forest model, deemed ExoMeth. Out-of-bag predictions from ExoMeth were used for diagnostic evaluation in men with a clinical suspicion of prostate cancer (PSA ≥ 4 ng/mL, adverse digital rectal examination, age, or lower urinary tract symptoms). Results: As ExoMeth risk score (range, 0-1) increased, the likelihood of high-grade disease being detected on biopsy was significantly greater (odds ratio = 2.04 per 0.1 ExoMeth increase, 95% confidence interval [CI]: 1.78-2.35). On an initial TRUS biopsy, ExoMeth accurately predicted the presence of Gleason score ≥3 + 4, area under the receiver-operator characteristic curve (AUC) = 0.89 (95% CI: 0.84-0.93) and was additionally capable of detecting any cancer on biopsy, AUC = 0.91 (95% CI: 0.87-0.95). Application of ExoMeth provided a net benefit over current standards of care and has the potential to reduce unnecessary biopsies by 66% when a risk threshold of 0.25 is accepted. Conclusion: Integration of urinary biomarkers across multiple assay methods has greater diagnostic ability than either method in isolation, providing superior predictive ability of biopsy outcomes. ExoMeth represents a more holistic view of urinary biomarkers and has the potential to result in substantial changes to how patients suspected of harboring prostate cancer are diagnosed

How do impulsivity traits influence problem gambling through gambling motives? The role of perceived gambling risk/benefits.

Although substantial research suggests that motivations have been found to mediate the relationships between impulsivity traits and various forms of substance use, no studies have examined how gambling motives may mediate the relationships between impulsivity traits and problem gambling. The primary purpose of this study was to test an integrative model linking impulsivity traits and gambling problems, evaluating the mediating effects of gambling motives. Participants were 594 students (73% male; mean age =19.92; SD=2.91) enrolled in public high schools or universities. Young people who tend to act rashly in response to extremely positive moods, showed higher enhancement and coping motives, which in turn were positively related to gambling problems. Individuals with higher levels of sensation seeking were more likely to have higher levels of enhancement motives, which in turn were also positively related to gambling problems. The model was examined in several groups, separately for the level of perceived gambling risk/benefits (lower perceived gambling risk, higher perceived gambling risk, lower perceived gambling benefits, and higher perceived gambling benefits). There were significant differences between these groups for this division. These findings suggest that prevention and/or treatment strategies might want to consider the model’s variables, including impulsivity traits and gambling motives, in accordance with individual levels of perceived gambling risk/benefits

Assessment of sexual difficulties associated with multi-modal treatment for cervical or endometrial cancer: A systematic review of measurement instruments

Background: Practitioners and researchers require an outcome measure that accurately identifies the range of common treatment-induced changes in sexual function and well-being experienced by women after cervical or endometrial cancer. This systematic review critically appraised the measurement properties and clinical utility of instruments validated for the measurement of female sexual dysfunction (FSD) in this clinical population. Methods: A bibliographic database search for questionnaire development or validation papers was completed and methodological quality and measurement properties of selected studies rated using the Consensus-based Standards for the selection of health Measurement Instrument (COSMIN) checklist. Results: 738 articles were screened, 13 articles retrieved for full text assessment and 7 studies excluded, resulting in evaluation of 6 papers; 2 QoL and 4 female sexual morbidity measures. Five of the six instruments omitted one or more dimension of female sexual function and only one instrument explicitly measured distress associated with sexual changes as per DSM V (APA 2013) diagnostic criteria. None of the papers reported measurement error, responsiveness data was available for only two instruments, three papers failed to report on criterion validity, and test-retest reliability reporting was inconsistent. Heterosexual penile-vaginal intercourse remains the dominant sexual activity focus for sexual morbidity PROMS terminology and instruments lack explicit reference to solo or non-coital sexual expression or validation in a non-heterosexual sample. Four out of six instruments included mediating treatment or illness items such as vaginal changes, menopause or altered body image. Conclusions: Findings suggest that the Female Sexual Function Index (FSFI) remains the most robust sexual morbidity outcome measure, for research or clinical use, in sexually active women treated for cervical or endometrial cancer