Parameter Estimation in Diffusion Modeling: Guidelines on Requisite Trial Numbers and Estimation Procedures

The Diffusion Model (Ratcliff, 1978) is a mathematical model that allows the disentangling of several cognitive processes involved in binary decision tasks. Although the model has gained in popularity within the last decade, strikingly little is known about the prerequisites of diffusion modeling. In this thesis, based on both simulation studies and test-retest studies, the performance of different estimation procedures and numbers of trials was compared. The studies were based on fast-dm-30, the newest version of the program fast-dm, which has been extended to include three different optimization criteria (Kolmogorov-Smirnov, Maximum Likelihood, and Chi-Square). The three main guidelines that emerged from this research were: (1) Chi-Square performs worse than the other two criteria for small- to medium-sized trial numbers; (2) Increasing the number of trials beyond 500 is of limited advantage as the precision of parameter estimation improves only marginally; and (3) Fixing the intertrial variabilities of drift rate and starting point can bring about more reliable estimates of the four main diffusion model parameters (i.e., drift rate, threshold separation, starting point, and nondecision time)

Effects of implicit fear of failure on cognitive processing. A diffusion model analysis

Whereas previous studies suggest that individuals with high implicit fear of failure (FF) perform worse on various indicators of general performance, the underlying mechanisms of this effect have not yet been understood. In our experimental study, 280 participants worked on a binary color discrimination task. Half of the participants were frustrated by means of negative performance feedback, while the control group received mainly positive feedback. We employed a diffusion model analysis (Ratcliff in Psychol Rev 85(2):59-108, 1978) to disentangle the different components involved in the execution of the task. Results revealed that participants in the frustration condition adopted more conservative decision settings (threshold separation parameter of the diffusion model). Besides, high implicit FF was related to slow information accumulation (drift), and this relation was stronger in the frustration condition. Participants with higher FF further showed reduced learning rates during the task. Task related intrusive thoughts are discussed as mechanism for reduced performance of high FF individuals. We conclude that diffusion model analyses can contribute to a better understanding of the mechanisms underlying the effects of psychological motives. (DIPF/Orig.

Performance-contingent reward increases the use of congruent distracting information

In conflict tasks like the Simon task, participants are instructed to respond to a task-relevant target dimension while ignoring additional distracting information. In the Simon task the distracting spatial information can be congruent or incongruent with the task-relevant target information, causing a congruency effect. As seen in the proportion congruency effect and the congruency sequence effect, this congruency effect is larger in mostly congruent blocks and following congruent trials, respectively. Common theories suggest that when the proportion of incongruent trials is high or after an incongruent trial, focus on the task-relevant target information is increased and distracting information is inhibited. In two experiments, we investigated how reward modulates these phenomena. Specifically, performance-contingent reward – but not non-contingent reward – increased the usage of the distracting information in mostly congruent blocks or following congruent trials, while the adaptation to incongruency (i.e., mostly incongruent blocks or preceding incongruent trials) was the same in all conditions. Additional diffusion model analyses found that this effect of performance-contingent reward was captured by the drift rate parameter. These results suggest an increased focus on the target information by incongruent trials independent from reward, while the adaptation to (mostly) congruent trials characterized by increased usage of distracting information can be motivationally boosted. That is, performance-contingent reward increases the use of congruent distracting information beyond a mere relaxation of the increased target-focus following (mostly) congruent trials

What do you (think you) need? Perceived vs. experienced effects of need fulfillment on well-being

We compared two approaches towards assessing inter-individual differences in the effect of satisfaction and frustration of basic needs (autonomy, competence, relatedness) on well-being: perceived need effects (beliefs about the effect of need fulfillment on one\u27s well-being) and experienced need effects (the within-person coupling of need fulfillment and well-being). In two studies (total N = 1281), participants reported perceived need effects in a multidimensional way. In Study 2, daily need fulfillment and affective well-being were additionally assessed (daily-diary study; ten days). Associations between perceived and experienced need effects were significant (albeit small) for all three frustration dimensions, but only for one satisfaction dimension (relatedness), suggesting that they capture different constructs and might be related to different outcomes. (DIPF/Orig.

A global experiment on motivating social distancing during the COVID-19 pandemic

Finding communication strategies that effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic. This cross-country, preregistered experiment (n = 25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of social distancing messages that promoted personal agency and reflective choices (i.e., an autonomy-supportive message) or were restrictive and shaming (i.e., a controlling message) compared with no message at all. Results partially supported experimental hypotheses in that the controlling message increased controlled motivation (a poorly internalized form of motivation relying on shame, guilt, and fear of social consequences) relative to no message. On the other hand, the autonomy-supportive message lowered feelings of defiance compared with the controlling message, but the controlling message did not differ from receiving no message at all. Unexpectedly, messages did not influence autonomous motivation (a highly internalized form of motivation relying on one’s core values) or behavioral intentions. Results supported hypothesized associations between people’s existing autonomous and controlled motivations and self-reported behavioral intentions to engage in social distancing. Controlled motivation was associated with more defiance and less long-term behavioral intention to engage in social distancing, whereas autonomous motivation was associated with less defiance and more short- and long-term intentions to social distance. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication, with implications for the current and future global health challenges

The Quality of Response Time Data Inference: A Blinded, Collaborative Assessment of the Validity of Cognitive Models

Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression of latent variables including 1) ease of processing, 2) response caution, 3) response bias, and 4) non-decision time. Inferences about these psychological factors, hinge upon the validity of the models’ parameters. Here, we use a blinded, collaborative approach to assess the validity of such model-based inferences. Seventeen teams of researchers analyzed the same 14 data sets. In each of these two-condition data sets, we manipulated properties of participants’ behavior in a two-alternative forced choice task. The contributing teams were blind to the manipulations, and had to infer what aspect of behavior was changed using their method of choice. The contributors chose to employ a variety of models, estimation methods, and inference procedures. Our results show that, although conclusions were similar across different methods, these "modeler’s degrees of freedom" did affect their inferences. Interestingly, many of the simpler approaches yielded as robust and accurate inferences as the more complex methods. We recommend that, in general, cognitive models become a typical analysis tool for response time data. In particular, we argue that the simpler models and procedures are sufficient for standard experimental designs. We finish by outlining situations in which more complicated models and methods may be necessary, and discuss potential pitfalls when interpreting the output from response time models

A global experiment on motivating social distancing during the COVID-19 pandemic

Finding communication strategies that effectively motivate social distancing continues to be a global public health priority during the COVID-19 pandemic. This cross-country, preregistered experiment (n = 25,718 from 89 countries) tested hypotheses concerning generalizable positive and negative outcomes of social distancing messages that promoted personal agency and reflective choices (i.e., an autonomy-supportive message) or were restrictive and shaming (i.e. a controlling message) compared to no message at all. Results partially supported experimental hypotheses in that the controlling message increased controlled motivation (a poorly-internalized form of motivation relying on shame, guilt, and fear of social consequences) relative to no message. On the other hand, the autonomy-supportive message lowered feelings of defiance compared to the controlling message, but the controlling message did not differ from receiving no message at all. Unexpectedly, messages did not influence autonomous motivation (a highly-internalized form of motivation relying on one’s core values) or behavioral intentions. Results supported hypothesized associations between people’s existing autonomous and controlled motivations and self-reported behavioral intentions to engage in social distancing: Controlled motivation was associated with more defiance and less long-term behavioral intentions to engage in social distancing, whereas autonomous motivation was associated with less defiance and more short- and long-term intentions to social distance. Overall, this work highlights the potential harm of using shaming and pressuring language in public health communication, with implications for the current and future global health challenges

[FGME 2015] "Requisite Trial Numbers in Diffusion Model Analyses"

[FGME 2015

Model complexity in diffusion modeling: Benefits of making the model more parsimonious

The diffusion model (Ratcliff, 1978) takes into account the reaction time distributions of both correct and erroneous responses from binary decision tasks. This high degree of information usage allows the estimation of different parameters mapping cognitive components such as speed of information accumulation or decision bias. For three of the four main parameters (drift rate, starting point and non-decision time) trial-to-trial variability is allowed. We investigated the influence of these variability parameters both drawing on simulation studies and on data from an empirical test-retest study using different optimization criteria and different trial numbers. Our results suggest that less complex models (fixing intertrial variabilities of the drift rate and the starting point at zero) can improve the estimation of the psychologically most interesting parameters (drift rate, threshold separation, starting point and non-decision time)

Impact of Context Information on Metaphor Elaboration: A Diffusion Model Study

Project description and data analyses can be found in: Lerche, V., Christmann, U., & Voss, A. (in press). Impact of Context Information on Metaphor Elaboration: A Diffusion Model Study. Experimental Psychology. doi: https://doi.org/10.1027/1618-3169/a00042