Alternative Model-Based and Design-Based Frameworks for Inference From Samples to Populations: From Polarization to Integration

A model-based framework, due originally to R. A. Fisher, and a design-based framework, due originally to J. Neyman, offer alternative mechanisms for inference from samples to populations. We show how these frameworks can utilize different types of samples (nonrandom or random vs. only random) and allow different kinds of inference (descriptive vs. analytic) to different kinds of populations (finite vs. infinite). We describe the extent of each framework's implementation in observational psychology research. After clarifying some important limitations of each framework, we describe how these limitations are overcome by a newer hybrid model/design-based inferential framework. This hybrid framework allows both kinds of inference to both kinds of populations, given a random sample. We illustrate implementation of the hybrid framework using the High School and Beyond data set

Revealing the Form and Function of Self-Injurious Thoughts and Behaviors: A Real-Time Ecological Assessment Study among Adolescents and Young Adults

Self-injurious behaviors are among the leading causes of death worldwide. However, the basic nature of self-injurious thoughts and behaviors (SITBs) is not well understood because prior studies have relied on long-term, retrospective, aggregate, self-report assessment methods. The authors used ecological momentary assessment methods to measure suicidal and nonsuicidal SITBs as they naturally occur in real time. Participants were 30 adolescents and young adults with a recent history of self-injury who completed signal- and event-contingent assessments on handheld computers over a 14-day period, resulting in the collection of data on 1,262 thought and behavior episodes. Participants reported an average of 5.0 thoughts of nonsuicidal self-injury (NSSI) per week, most often of moderate intensity and short duration (1–30 min), and 1.6 episodes of NSSI per week. Suicidal thoughts occurred less frequently (1.1 per week), were of longer duration, and led to self-injurious behavior (i.e., suicide attempts) less often. Details are reported about the contexts in which SITBs most often occur (e.g., what participants were doing, who they were with, and what they were feeling before and after each episode). This study provides a first glimpse of how SITBs are experienced in everyday life and has significant implications for scientific and clinical work on self-injurious behaviors.Psycholog

Fitting multilevel models with ordinal outcomes: Performance of alternative specifications and methods of estimation.

Previous research has compared methods of estimation for multilevel models fit to binary data but there are reasons to believe that the results will not always generalize to the ordinal case. This paper thus evaluates (a) whether and when fitting multilevel linear models to ordinal outcome data is justified and (b) which estimator to employ when instead fitting multilevel cumulative logit models to ordinal data, Maximum Likelihood (ML) or Penalized Quasi-Likelihood (PQL). ML and PQL are compared across variations in sample size, magnitude of variance components, number of outcome categories, and distribution shape. Fitting a multilevel linear model to ordinal outcomes is shown to be inferior in virtually all circumstances. PQL performance improves markedly with the number of ordinal categories, regardless of distribution shape. In contrast to binary data, PQL often performs as well as ML when used with ordinal data. Further, the performance of PQL is typically superior to ML when the data includes a small to moderate number of clusters (i.e., ≤ 50 clusters)

Evaluating Group-Based Interventions When Control Participants Are Ungrouped

Individually randomized treatments are often administered within a group setting. As a consequence, outcomes for treated individuals may be correlated due to provider effects, common experiences within the group, and/or informal processes of socialization. In contrast, it is often reasonable to regard outcomes for control participants as independent, given that these individuals are not placed into groups. Although this kind of design is common in intervention research, the statistical models applied to evaluate the treatment effects are usually inconsistent with the resulting data structure, potentially leading to biased inferences. This article presents an alternative model that explicitly accounts for the fact that only treated participants are grouped. In addition to providing a useful test of the overall treatment effect, this approach also permits one to formally determine the extent to which treatment effects vary over treatment groups and whether there is evidence that individuals within treatment groups become similar to one another. This strategy is demonstrated with data from the Reconnecting Youth program for high school students at risk of school failure and behavioral disorders