Assessing and accounting for measurement in intensive longitudinal studies:Current Practices, Considerations, and Avenues for Improvement

Purpose: Intensive longitudinal studies, in which participants complete questionnaires multiple times a day over an extended period, are increasingly popular in the social sciences in general and quality-of-life research in particular. The intensive longitudinal methods allow for studying the dynamics of constructs (e.g., how much patient-reported outcomes vary across time). These methods promise higher ecological validity and lower recall bias than traditional methods that question participants only once, since the high frequency means that participants complete questionnaires in their everyday lives and do not have to retrospectively report about a large time interval. However, to ensure the validity of the results obtained from analyzing the intensive longitudinal data (ILD), greater awareness and understanding of appropriate measurement practices are needed. Method: We surveyed 42 researchers experienced with ILD regarding their measurement practices and reasons for suboptimal practices. Results: Results showed that researchers typically do not use measures validated specifically for ILD. Participants assessing the psychometric properties and invariance of measures in their current studies was even less common, as was accounting for these properties when analyzing dynamics. This was mainly because participants did not have the necessary knowledge to conduct these assessments or were unaware of their importance for drawing valid inferences. Open science practices, in contrast, appear reasonably well ingrained in ILD studies. Conclusion: Measurement practices in ILD still need improvement in some key areas; we provide recommendations in order to create a solid foundation for measuring and analyzing psychological constructs.</p

Context-dependent responses to the spread of COVID-19 among national and international students during the first lockdown:An online survey

Background: Restrictions to minimize social contact was necessary to prevent the spread of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus but may have impacted individuals' mental well-being. Emotional responses are modulated by contextual information. Living abroad during the coronavirus disease 2019 (COVID-19) pandemic may have boosted the feeling of isolation as the context is unfamiliar. Objectives: This study compared the psychological impact of social distancing in national students (living in a familiar context) versus international students (living in an unfamiliar context). Methods: During March/April 2020 (first lockdown in the Netherlands), 850 university students completed an online survey. Structural equation modeling (SEM) was conducted to compare how students' responses to the virus were predicted by health anxiety, emotional distress, and personal traits. Results: Compared with national students, international students showed higher levels in 4 identified factors (COVID-19-related worry, perceived risk of infection, distance from possibly contaminated objects, distance from social situations). The factors were mainly predicted by health anxiety across international students, while emotional distress and individual traits (eg, intolerance of uncertainty) played a role across national students. Conclusions:In the familiar context, individual characteristics (traits) predicted the responses to the virus, while the unfamiliar context drove individuals' health-focused responses. Living in a foreign country is associated with psychological burdens and this should be considered by universities for more pronounced social support and clear references to health-related institutions.</p

Assessing and accounting for measurement in intensive longitudinal studies:Current Practices, Considerations, and Avenues for Improvement

Purpose: Intensive longitudinal studies, in which participants complete questionnaires multiple times a day over an extended period, are increasingly popular in the social sciences in general and quality-of-life research in particular. The intensive longitudinal methods allow for studying the dynamics of constructs (e.g., how much patient-reported outcomes vary across time). These methods promise higher ecological validity and lower recall bias than traditional methods that question participants only once, since the high frequency means that participants complete questionnaires in their everyday lives and do not have to retrospectively report about a large time interval. However, to ensure the validity of the results obtained from analyzing the intensive longitudinal data (ILD), greater awareness and understanding of appropriate measurement practices are needed. Method: We surveyed 42 researchers experienced with ILD regarding their measurement practices and reasons for suboptimal practices. Results: Results showed that researchers typically do not use measures validated specifically for ILD. Participants assessing the psychometric properties and invariance of measures in their current studies was even less common, as was accounting for these properties when analyzing dynamics. This was mainly because participants did not have the necessary knowledge to conduct these assessments or were unaware of their importance for drawing valid inferences. Open science practices, in contrast, appear reasonably well ingrained in ILD studies. Conclusion: Measurement practices in ILD still need improvement in some key areas; we provide recommendations in order to create a solid foundation for measuring and analyzing psychological constructs.</p

Power of a randomization test in a single case multiple baseline AB design

A randomization test can be used to statistically test hypotheses in multiple baseline designs to complement the commonly used visual inspection analysis. A crossed factor simulation study was performed to investigate the power of a randomization test in an multiple baseline design. The results sho

Context-Dependent Responses to the Spread of COVID-19 Among National and International Students During the First Lockdown:An Online Survey

Background: Restrictions to minimize social contact was necessary to prevent the spread of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus but may have impacted individuals' mental well-being. Emotional responses are modulated by contextual information. Living abroad during the coronavirus disease 2019 (COVID-19) pandemic may have boosted the feeling of isolation as the context is unfamiliar. Objectives: This study compared the psychological impact of social distancing in national students (living in a familiar context) versus international students (living in an unfamiliar context). Methods: During March/April 2020 (first lockdown in the Netherlands), 850 university students completed an online survey. Structural equation modeling (SEM) was conducted to compare how students' responses to the virus were predicted by health anxiety, emotional distress, and personal traits. Results: Compared with national students, international students showed higher levels in 4 identified factors (COVID-19-related worry, perceived risk of infection, distance from possibly contaminated objects, distance from social situations). The factors were mainly predicted by health anxiety across international students, while emotional distress and individual traits (eg, intolerance of uncertainty) played a role across national students.Conclusions: In the familiar context, individual characteristics (traits) predicted the responses to the virus, while the unfamiliar context drove individuals' health-focused responses. Living in a foreign country is associated with psychological burdens and this should be considered by universities for more pronounced social support and clear references to health-related institutions.</p

Coping and resilience in adults: a cross-sectional network analysis

Background and objectives: Coping and resilience, how we deal with problems and difficulties and recover from misfortune or change, are two well-known interrelated conce

Measuring and Modelling Exposure to External Workplace Aggression in Three Types of Emergency Responders.

The measurement properties of indices about workplace aggression initiated by the public, referred to as external workplace aggression, are underresearched. This study addressed how exposure to external workplace aggression is best measured and modeled in three types of emergency responders. The study inspected the factor structure and explored the addition of severity to an existing measure of frequency of exposure to workplace aggression, which addresses forms of physical aggression, threats, and verbal and nonverbal/nonphysical aggression (gestures) by people outside the organization directed toward employees. Self-reported data from 1,499 emergency responders, including emergency medical workers, firefighters, and police officers in the Netherlands, were analyzed using factor analyses in Mplus. In addition, the relationships between workplace aggression indices and a measure of the situational risk for violence were tested. Results show that the frequency index measured exposure to external workplace aggression better than the index combining the frequency and severity, and that factor structures of indices differed, regarding number and content of factors, between the three groups of emergency responders. An important implication is that researchers and policy employees can use a relatively simple measure to examine exposure to aggression in organizations

No intolerance of errors:The effect of intolerance of uncertainty on performance monitoring revisited

Errors have been conceptualized as internal forms of threat that can cause harm in unpredictable ways. An index of error processing is the error-related negativity (ERN), an event-related potential reflecting variability in the sensitivity to errors. Prior work has shown the relationship between psychopathology symptoms and the ERN is unclear, and may be moderated by intolerance of uncertainty (IU), a trait that captures how people react to unpredictability. IU includes two subfactors of prospective IU (active seeking of predictability) and inhibitory IU (behavioral paralysis). In the present study, 188 undergraduates performed an Eriksen flanker task designed to elicit the ERN, while brain activity was recorded using electroencephalography (EEG). Participants completed the Intolerance of Uncertainty Scale, Short Form (IUS-12), and other measures of anxiety, depression and worry. Total IU explained 5 % of the variance in correct-response negativity (CRN), but was not associated with the ERN in our sample. In contrast to previous findings, the IU subfactors did not predict the ERN or post-error slowing (PES), nor did total IU and depression interact to predict the ERN. Exploratory analyses also showed that total IU did not moderate the relationship between trait anxiety and the ERN. Small samples may have previously exaggerated the links between self-reported IU and the ERN. As such, further high-powered replications are required to confirm if, and how, they are related

Impaired subjective self-control in alcohol use: An ecological momentary assessment study

Background: While both theory and empirical findings have supported impaired self-control as a crucial factor in understanding problem drinking, little is known about the relationship of self-control and drinking in naturalistic settings. The present study uses Ecological Momentary Assessment (EMA) to examine the predictive relationships between impaired subjective self-control, craving and alcohol use in everyday life. Methods: A sample of 172 regular drinkers responded on their smartphone to three random prompts each day for seven days in which amount of perceived self-control and craving were measured with self-report. In the meantime, participants were instructed to initiate an EMA report when they started drinking alcohol. Results: Findings supported the hypotheses that impaired self-control and higher craving levels were prospectively related to the likelihood that people will drink. That is, on random assessments that preceded drinking (i.e., were within two hours of drinking), perceived self-control was lower and craving was higher compared to random assessments that were not followed by drinking. Additionally, during drink consumption, impaired self-control and craving were associated with a higher amount of expected alcohol consumption. Findings further indicated that subjective self-control acted as a moderator of the relationship between craving and alcohol consumption during drinking occasions. Conclusions: By using a smartphone mobile application, this study showed that impaired subjective self-control and cravin

Validation of the Multicultural Personality Questionnaire Short Form (MPQ-SF) for use in the context of international education

The Multicultural Personality Questionnaire (MPQ) is one of the most widely used instruments for measuring individuals’ intercultural competences. The original version consists of 91 items, divided into five subscales, and has been shown to predict attitudes, behavior, and outcomes in a variety of intercultural contexts. Recently, a 40-item short form of the MPQ was developed (MPQ-SF), which may be particularly useful in settings in which time or survey space are limited, or where respondent drop-out is likely to occur. For example, the MPQ-SF would be a valuable tool for assessing longitudinal development of multicultural personality traits in training or educational settings. A prerequisite for such research is to establish measurement invariance of the MPQ-SF between different respondent groups, as well as across time points. Using a sample of students in an international university program (n = 519), the present study examines how the scales perform among male and female respondents, between students of Western and Non-Western background, and across two time points, five months apart. Based on our findings, we conclude that all five subscales of the MPQ-SF display sufficient measurement invariance to be reliably used in this and similar contexts, in comparative as well as longitudinal study designs