Network Psychometrics

This chapter provides a general introduction of network modeling in psychometrics. The chapter starts with an introduction to the statistical model formulation of pairwise Markov random fields (PMRF), followed by an introduction of the PMRF suitable for binary data: the Ising model. The Ising model is a model used in ferromagnetism to explain phase transitions in a field of particles. Following the description of the Ising model in statistical physics, the chapter continues to show that the Ising model is closely related to models used in psychometrics. The Ising model can be shown to be equivalent to certain kinds of logistic regression models, loglinear models and multi-dimensional item response theory (MIRT) models. The equivalence between the Ising model and the MIRT model puts standard psychometrics in a new light and leads to a strikingly different interpretation of well-known latent variable models. The chapter gives an overview of methods that can be used to estimate the Ising model, and concludes with a discussion on the interpretation of latent variables given the equivalence between the Ising model and MIRT.Comment: In Irwing, P., Hughes, D., and Booth, T. (2018). The Wiley Handbook of Psychometric Testing, 2 Volume Set: A Multidisciplinary Reference on Survey, Scale and Test Development. New York: Wile

Psychological and other aspects of the sign arbitrariness

I confront arbitrariness of the sign to a criterion assessing the quality of language, logical system, psychometrics and art

CHALLENGES ASSOCIATED WITH THE DEVELOPMENT OF LOCALLY MADE PSYCHOLOGICAL TESTS IN NIGERIA

Psychological tests are essential to the study and practice of psychology and are used for recruitment, selection, placement, and classification in commerce, industries, and the military. They are scientifica lly constructed following careful and detailed procedures based on sound theoretical approach. Psychologists in Nigeria have constructed culturally relevant tests to assess personality in various settings. However, the number of psychological tests in Nigeria is grossly in adequate. Most of the tests used by psychologists in Nigeria are foreign and not suitable for African cultural background. The scarcity of local tests in Nigeria may be as a result of the challenges psychologists in Nigeria face in the process of test construction. This paper therefore discusses some of these challenges which include the shortage of manpower in the field of psychometrics; financial and time constraints; work overload; lack of mentoring and training programmes; and the lack of attraction to psychometrics as a career in psychology. It was recommended among others that Universities in Nigeria should offer psychometrics as an area of specialization in psychology at the postgraduate level and also, that Psychometricians in Nigeria should encourage young psychologists in the field through mentoring, coaching, and by forming and financing research clusters towards the development of psychological tests

Psychometrics in Practice at RCEC

A broad range of topics is dealt with in this volume: from combining the psychometric generalizability and item response theories to the ideas for an integrated formative use of data-driven decision making, assessment for learning and diagnostic testing. A number of chapters pay attention to computerized (adaptive) and classification testing. Other chapters treat the quality of testing in a general sense, but for topics like maintaining standards or the testing of writing ability, the quality of testing is dealt with more specifically.\ud All authors are connected to RCEC as researchers. They present one of their current research topics and provide some insight into the focus of RCEC. The selection of the topics and the editing intends that the book should be of special interest to educational researchers, psychometricians and practitioners in educational assessment

What is embodiment? a psychometric approach

What is it like to have a body? The present study takes a psychometric approach to this question. We collected structured introspective reports of the rubber hand illusion, to systematically investigate the structure of bodily self-consciousness. Participants observed a rubber hand that was stroked either synchronously or asynchronously with their own hand and then made proprioceptive judgments of the location of their own hand and used Likert scales to rate their agreement or disagreement with 27 statements relating to their subjective experience of the illusion. Principal components analysis of this data revealed four major components of the experience across conditions, which we interpret as: embodiment of rubber hand, loss of own hand, movement, and affect. In the asynchronous condition, an additional fifth component, deafference, was found. Secondary analysis of the embodiment of runner hand component revealed three subcomponents in both conditions: ownership, location, and agency. The ownership and location components were independent significant predictors of proprioceptive biases induced by the illusion. These results suggest that psychometric tools may provide a rich method for studying the structure of conscious experience, and point the way towards an empirically rigorous phenomenology

Generalized Network Psychometrics: Combining Network and Latent Variable Models

We introduce the network model as a formal psychometric model, conceptualizing the covariance between psychometric indicators as resulting from pairwise interactions between observable variables in a network structure. This contrasts with standard psychometric models, in which the covariance between test items arises from the influence of one or more common latent variables. Here, we present two generalizations of the network model that encompass latent variable structures, establishing network modeling as parts of the more general framework of Structural Equation Modeling (SEM). In the first generalization, we model the covariance structure of latent variables as a network. We term this framework Latent Network Modeling (LNM) and show that, with LNM, a unique structure of conditional independence relationships between latent variables can be obtained in an explorative manner. In the second generalization, the residual variance-covariance structure of indicators is modeled as a network. We term this generalization Residual Network Modeling (RNM) and show that, within this framework, identifiable models can be obtained in which local independence is structurally violated. These generalizations allow for a general modeling framework that can be used to fit, and compare, SEM models, network models, and the RNM and LNM generalizations. This methodology has been implemented in the free-to-use software package lvnet, which contains confirmatory model testing as well as two exploratory search algorithms: stepwise search algorithms for low-dimensional datasets and penalized maximum likelihood estimation for larger datasets. We show in simulation studies that these search algorithms performs adequately in identifying the structure of the relevant residual or latent networks. We further demonstrate the utility of these generalizations in an empirical example on a personality inventory dataset.Comment: Published in Psychometrik

Towards Psychometrics-based Friend Recommendations in Social Networking Services

Two of the defining elements of Social Networking Services are the social profile, containing information about the user, and the social graph, containing information about the connections between users. Social Networking Services are used to connect to known people as well as to discover new contacts. Current friend recommendation mechanisms typically utilize the social graph. In this paper, we argue that psychometrics, the field of measuring personality traits, can help make meaningful friend recommendations based on an extended social profile containing collected smartphone sensor data. This will support the development of highly distributed Social Networking Services without central knowledge of the social graph.Comment: Accepted for publication at the 2017 International Conference on AI & Mobile Services (IEEE AIMS

The role of psychometrics in individual differences research in cognition: A case study of the AX-CPT

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task