Evaluating an automated number series item generator using linear logistic test models

This study investigates the item properties of a newly developed Automatic Number Series Item Generator (ANSIG). The foundation of the ANSIG is based on five hypothesised cognitive operators. Thirteen item models were developed using the numGen R package and eleven were evaluated in this study. The 16-item ICAR (International Cognitive Ability Resource1) short form ability test was used to evaluate construct validity. The Rasch Model and two Linear Logistic Test Model(s) (LLTM) were employed to estimate and predict the item parameters. Results indicate that a single factor determines the performance on tests composed of items generated by the ANSIG. Under the LLTM approach, all the cognitive operators were significant predictors of item difficulty. Moderate to high correlations were evident between the number series items and the ICAR test scores, with high correlation found for the ICAR Letter-Numeric-Series type items, suggesting adequate nomothetic span. Extended cognitive research is, nevertheless, essential for the automatic generation of an item pool with predictable psychometric propertie

Development of the Knowledge of Genome Sequencing (KOGS) questionnaire

OBJECTIVE: Whole-genome sequencing is being implemented in research and clinical care, yet tools to assess patients' knowledge are lacking. Our aim was to develop a robust measure of whole-genome sequencing knowledge suitable for patients and other stakeholders including research participants, public, students, and healthcare professionals. METHODS: An initial set of 17 items was developed via an iterative process including literature review, expert consultation, focus groups, and cognitive interviews with patients, and then administered to 243 individuals. We used exploratory factor analysis and item-response theory to confirm the psychometric suitability of the candidate items for assessing whole-genome sequencing knowledge. RESULTS: There was a strong main component after removing 5 items with low factor loadings. Item and scale homogeneity was achieved using Mokken scale analysis. Three further items were removed because they were misfits, inverse duplicates or resulted in local dependency. The remaining nine items fitted the two-parameter logistic IRT model which achieved excellent fit to the observed data. Cronbach's alpha was 0.79 indicating acceptable reliability. CONCLUSION: The KOGS, developed using a rigorous psychometric approach, is a brief and reliable tool. PRACTICE IMPLICATIONS: The KOGS may prove useful for researchers and healthcare professionals using whole-genome sequencing with patients and other stakeholders

Medio-Frontal and Anterior Temporal abnormalities in children with attention deficit hyperactivity disorder (ADHD) during an acoustic antisaccade task as revealed by electro-cortical source reconstruction

<p>Abstract</p> <p>Background</p> <p>Attention Deficit Hyperactivity Disorder (ADHD) is one of the most prevalent disorders in children and adolescence. Impulsivity is one of three core symptoms and likely associated with inhibition difficulties. To date the neural correlate of the antisaccade task, a test of response inhibition, has not been studied in children with (or without) ADHD.</p> <p>Methods</p> <p>Antisaccade responses to visual and acoustic cues were examined in nine unmedicated boys with ADHD (mean age 122.44 ± 20.81 months) and 14 healthy control children (mean age 115.64 ± 22.87 months, three girls) while an electroencephalogram (EEG) was recorded. Brain activity before saccade onset was reconstructed using a 23-source-montage.</p> <p>Results</p> <p>When cues were acoustic, children with ADHD had a higher source activity than control children in Medio-Frontal Cortex (MFC) between -230 and -120 ms and in the left-hemispheric Temporal Anterior Cortex (TAC) between -112 and 0 ms before saccade onset, despite both groups performing similarly behaviourally (antisaccades errors and saccade latency). When visual cues were used EEG-activity preceding antisaccades did not differ between groups.</p> <p>Conclusion</p> <p>Children with ADHD exhibit altered functioning of the TAC and MFC during an antisaccade task elicited by acoustic cues. Children with ADHD need more source activation to reach the same behavioural level as control children.</p

Developing a sentence level fairness metric using word embeddings

Fairness is a principal social value that is observable in civilisations around the world. Yet, a fairness metric for digital texts that describe even a simple social interaction, e.g., ‘The boy hurt the girl’ has not been developed. We address this by employing word embeddings that use factors found in a new social psychology literature review on the topic. We use these factors to build fairness vectors. These vectors are used as sentence level measures, whereby each dimension reflects a fairness component. The approach is employed to approximate human perceptions of fairness. The method leverages a pro-social bias within word embeddings, for which we obtain an F1 = 79.8 on a list of sentences using the Universal Sentence Encoder (USE). A second approach, using principal component analysis (PCA) and machine learning (ML), produces an F1 = 86.2. Repeating these tests using Sentence Bidirectional Encoder Representations from Transformers (SBERT) produces an F1 = 96.9 and F1 = 100 respectively. Improvements using subspace representations are further suggested. By proposing a first-principles approach, the paper contributes to the analysis of digital texts along an ethical dimension.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the NGI TRUST grant agreement no. 825618. The Psychometrics Centre, Cambridge Judge Business School Small Grants Scheme, and Isaac Newton Trus

Adolescent paranoia: Prevalence, structure, and causal mechanisms

Background: Adolescence can be a challenging time, characterised by self-consciousness, heightened regard for peer acceptance, and fear of rejection. Interpersonal concerns are amplified by unpredictable social interactions, both online and offline. This developmental and social context is potentially conducive to the emergence of paranoia. However, research on paranoia during adolescence is scarce. Method: Our aim was to examine the prevalence, structure, and probabilistic causal mechanisms of adolescent paranoia. A representative school cohort of 801 adolescents (11-15 years) completed measures of paranoia and a range of affective, cognitive, and social factors. A Bayesian approach with Directed Acyclic Graphs (DAGs) was used to assess the causal interactions with paranoia. Results: Paranoid thoughts were very common, followed a continuous distribution, and were hierarchically structured. There was an overall paranoia factor, with sub-factors of social fears, physical threat fears, and conspiracy concerns. With all other variables controlled, DAG analysis identified paranoia had dependent relationships with negative affect, peer difficulties, bullying, and cognitive-affective responses to social media. The causal directions could not be fully determined, but it was more likely that negative affect contributed to paranoia and paranoia impacted peer relationships. Problematic social media use did not causally influence paranoia. Conclusions: There is a continuum of paranoia in adolescence and occasional suspicions are common at this age. Anxiety and depression are closely connected with paranoia and may causally contribute to its development. Paranoia may negatively impact adolescent peer relationships. The clinical significance of paranoia in adolescents accessing mental health services must now be established

Adolescent paranoia: Prevalence, structure, and causal mechanisms

Background: Adolescence can be a challenging time, characterised by self-consciousness, heightened regard for peer acceptance, and fear of rejection. Interpersonal concerns are amplified by unpredictable social interactions, both online and offline. This developmental and social context is potentially conducive to the emergence of paranoia. However, research on paranoia during adolescence is scarce. Method: Our aim was to examine the prevalence, structure, and probabilistic causal mechanisms of adolescent paranoia. A representative school cohort of 801 adolescents (11-15 years) completed measures of paranoia and a range of affective, cognitive, and social factors. A Bayesian approach with Directed Acyclic Graphs (DAGs) was used to assess the causal interactions with paranoia. Results: Paranoid thoughts were very common, followed a continuous distribution, and were hierarchically structured. There was an overall paranoia factor, with sub-factors of social fears, physical threat fears, and conspiracy concerns. With all other variables controlled, DAG analysis identified paranoia had dependent relationships with negative affect, peer difficulties, bullying, and cognitive-affective responses to social media. The causal directions could not be fully determined, but it was more likely that negative affect contributed to paranoia and paranoia impacted peer relationships. Problematic social media use did not causally influence paranoia. Conclusions: There is a continuum of paranoia in adolescence and occasional suspicions are common at this age. Anxiety and depression are closely connected with paranoia and may causally contribute to its development. Paranoia may negatively impact adolescent peer relationships. The clinical significance of paranoia in adolescents accessing mental health services must now be established

The meaning in grandiose delusions: measure development and cohort studies in clinical psychosis and non-clinical general population groups in the UK and Ireland

Background The content of grandiose delusions—inaccurate beliefs that one has special powers, wealth, mission, or identity—is likely to be highly meaningful. The meaning, for example providing a sense of purpose, could prove to be a key factor in the delusion taking hold. We aimed to empirically define and develop measures of the experience of meaning in grandiose delusions and the sources of this meaning, and to test whether severity of grandiosity in clinical and non-clinical populations is associated with level of meaning. Methods We did a cross-sectional self-report questionnaire study in two cohorts: non-clinical participants aged 18 years and older, with UK or Irish nationality or residence; and patients with affective or non-affective psychosis diagnoses, aged 16 years and older, and accessing secondary care mental health services in 39 National Health Service providers in England and Wales. Participants with high grandiosity completed two large item pools: one assessing the experience of meaning in grandiose delusions (Grandiosity Meaning Measure [termed gram]) and one assessing the sources of meaning (Grandiosity Meaning Measure–Sources [termed grams]). The Grandiosity Meaning Measure and Grandiosity Meaning Measure–Sources were developed using exploratory factor analysis and confirmatory factor analysis. Structural equation modelling was used to test the associations of meaning with the severity of grandiosity. The primary outcome measure for grandiosity was the Specific Psychotic Experiences Questionnaire (grandiosity subscale) and associations were tested with the Grandiosity Meaning Measure and the Grandiosity Meaning Measure–Sources. Findings From Aug 30, 2019, to Nov 21, 2020, 13 323 non-clinical participants were enrolled. 2821 (21%) were men and 10 134 (76%) were women, 11 974 (90%) were White, and the mean age was 39·5 years (SD 18·6 [range 18–93]). From March 22, 2021, to March 3, 2022, 798 patients with psychosis were enrolled. 475 (60%) were men and 313 (39%) were women, 614 (77%) were White, and the mean age was 43·4 years (SD 13·8 [range 16–81]). The experience of meaning in relation to grandiose delusions had three components: coherence, purpose, and significance. The sources of meaning had seven components: positive social perceptions, spirituality, overcoming adversity, confidence in self among others, greater good, supporting loved ones, and happiness. The measurement of meaning was invariant across clinical and non-clinical populations. In the clinical population, each person typically endorsed multiple meanings and sources of meaning for the grandiose delusion. Meaning in grandiose delusions was strongly associated with severity of grandiosity, explaining 53·5% of variance, and with grandiose delusion conviction explaining 27·4% of variance. Grandiosity was especially associated with sense of purpose, and grandiose delusion conviction with coherence. Similar findings were found for the non-clinical population. Interpretation Meaning is inherently tied to grandiose delusions. This study provides a framework for research and clinical practice to understand the different types of meaning of grandiosity. The framework is likely to have clinical use in psychological therapy to help guide patients to find sources of equivalent meaning from other areas of their lives and thereby reduce the extent to which the grandiose delusion is needed. Funding Health Education England and National Institute for Health and Care Research

The assessment of paranoia in young people: Item and test properties of the Bird Checklist of Adolescent Paranoia

Background Precise assessment tools for psychotic experiences in young people may help identify symptoms early and facilitate advances in treatment. In this study we provide an exemplar - with a paranoia scale for youth – for improving measurement precision for psychotic experiences using item response theory (IRT). We evaluate the psychometric properties of the new measure, test for measurement invariance, and assess its potential for computerised adaptive testing (CAT). Method The 18-item Bird Checklist of Adolescent Paranoia (B-CAP) was completed by 1102 adolescents including 301 patients with mental health problems and 801 from the general population. After excluding outliers (n = 10), IRT was used to examine item properties, test reliability, and measurement invariance. The properties of an adaptive B-CAP were assessed using a simulation of 10,000 responses. Results All B-CAP items were highly discriminative (a = 1.14–2.77), whereby small shifts in paranoia led to a higher probability of item endorsement. Test reliability was high (a > 0.90) across a wide range of paranoia severity (θ = −0.45–3.36), with the greatest precision at elevated levels. All items were invariant for gender, age, and population groups. The simulated adaptive B-CAP performed with high accuracy and required only 5–6 items at higher levels of paranoia severity. Conclusions The B-CAP is a reliable assessment tool with excellent psychometric properties to assess both non-clinical and clinical levels of paranoia in young people, with potential as an efficient adaptive test. In future, these approaches could be used to develop a multidimensional CAT to assess the full range of psychotic experiences in youth.</p