Multivariate meta-analysis: modelling the heterogeneity mixing apples and oranges; dangerous or delicious?

Meta-analysis may be broadly defined as the quantitative review and synthesis of the results of related but independent studies. For the simple case where meta-analysis concerns only one outcome measure in each study, the statistical methods are well established now. However, in many practical situations there are several outcome measures presented in the individual studies included in a meta- analysis. In that case analyzing each outcome measure separately in a univariate manner is often suboptimal, and analyzing all outcome measures jointly using multivariate methods is indicated. For many situations with multivariate outcome, appropriate meta-analytic method

Stability of boundaries between response options of response scales: Does 'very happy' remain equally happy over the years?

The differences between response scales in number and wording of response options make it hard to compare data from survey research and to perform research syntheses. A recent method that we have developed to tackle this problem is rooted in the idea that the transition points on a bounded continuum, on which verbal response options from a primary scale transit from one point to another, for instance from ‘happy’ to ‘very happy’, remain unchanged over time. The idea behind this is that although people may change their perception of, for example, their own happiness intensity over time, they are assumed not to change the degree of appreciation they attribute to the terms used to label response options. This is an important assumption for research syntheses that requires that everything remains unchanged, except for the change of interest. It means that if our method is applied to measurements at distinct points in time, differences in estimates of the mean and standard deviation can be attributed solely to changes in the frequency distributions on the primary scale. In this paper we apply the method to happiness and show that it is reasonable to assume that the transition points between the response options are stable over time. Keywords: verbal response scales; comparability; scale transformation; beta distribution; reference distribution; research synthesi

Pooling Time Series Based on Slightly Different Questions About the Same Topic Forty Years of Survey Research on Happiness and Life Satisfaction in The Netherlands

Survey research on subjective wellbeing in The Netherlands started in the early 1970s. The time series happiness and life satisfaction that have emerged since then are unfortunately based on slightly different survey items of which one part uses verbal response scales and another part uses numerical response scales. The diversity of the survey items and a number of other measurement issues, such as the effects of changes in survey mode, hamper comparison over time and make it difficult to establish whether life became any better over the last forty years. These problems can be tackled using the recently developed Reference Distribution Method with which responses to equivalent but not identical survey questions can be pooled to obtain long, consistent time series. We applied the Reference Distribution method to pool time series of happiness and life satisfaction. We conclude that in the past 40 years the Dutch have become slightly happier and satisfied with their lives

'Very happy' is not always equally happy

Survey research is based on questioning and respondents typically answer to questions by picking one of several response options. These response options are labelled verbally with terms such as ‘very happy’ or ‘fairl

Stability of boundaries between response options of response scales: Does 'very happy' remain equally happy over the years?

__Abstract__ The differences between response scales in number and wording of response options make it hard to compare data from survey research and to perform research syntheses. A recent method that we have developed to tackle this problem is rooted in the idea that the transition points on a bounded continuum, on which verbal response options from a primary scale transit from one point to another, for instance from ‘happy’ to ‘very happy’, remain unchanged over time. The idea behind this is that although people may change their perception of, for example, their own happiness intensity over time, they are assumed not to change the degree of appreciation they attribute to the terms used to label response options. This is an important assumption for research syntheses that requires that everything remains unchanged, except for the change of interest. It means that if our method is applied to measurements at distinct points in time, differences in estimates of the mean and standard deviation can be attributed solely to changes in the frequency distributions on the primary scale. In this paper we apply the method to happiness and show that it is reasonable to assume that the transition points between the response options are stable over time

Personality, depressive symptoms, the interparental relationship and parenting: Prospective associations of an actor-partner interdependency model.

Grounded on Belsky's process model and family systems theories and using an actor-partner interdependency modeling (APIM) approach (Belsky & Jaffee, 2006; Cox & Paley, 2003), the current study was the first to examine whether Big Five personality characteristics and depressive symptoms of parents and their partners are related to adolescent-perceived parenting behavior directly and indirectly via interparental stress experienced by both parents. Longitudinal data (Time 1: 2001; Time 2: 2007; and Time 3: 2009) from a large community sample of Flemish families was used (N = 455; Time 1 children: Mage = 7.10 years). Results revealed that, for both parents, more agreeableness and autonomy predicted more parental warmth, and more depressive symptoms and lower agreeableness predicted more overreactive discipline (i.e., actor effects). Both parents' depressive symptoms predicted their own interparental stress (i.e., actor effects). Regarding partner-effects, paternal overreactive discipline was shaped by mother's extraversion and experienced interparental stress, and paternal warmth was affected by mother's experienced interparental stress in addition to fathers' own psychological resources. In contrast, maternal parenting was affected by their own psychological resources only. Although no consistent mediating role of interparental stress was found, one small dyadic indirect effect indicated that maternal depressive symptoms were related to more paternal overreactive discipline via heightened levels of interparental stress experienced by both parents. These results provide new support for the idea of interdependency between parents and specifically support the fathering vulnerability hypothesis. Tentatively, this study informs clinical practice by showing that family interventions aiming to improve parenting should pay attention to specific personality characteristics affecting parenting behavior and adopt a dyadic approach including both parents, especially when targeting paternal parenting. (PsycINFO Database Record (c) 2019 APA, all rights reserved)

The role of the assessment policy in the relation between learning and performance

__Context:__ Optimising student learning and academic performance is a continuous challenge for medical schools. The assessment policy may influence both learning and performance. Previously, the joint contribution of self-regulated learning (SRL) and participation in scheduled learning activities towards academic performance has been reported. However, little is known about the relationships between SRL, participation and academic performance under different assessment policies. __Objectives:__ The goal of this study was to investigate differences in average scores of SRL, participation and academic performance of students under two assessment policies: (i) a conjunctive lower stakes, lower performance standard (old) assessment policy and (ii) a compensatory higher stakes, higher performance standard (new) assessment policy. In addition, this research investigated whether the relationships between academic performance, SRL and participation are similar across both assessment policies. __Methods:__ Year-1 medical students (i) under the old assessment policy (n = 648) and (ii) under the new assessment policy (n = 529) completed the Motivated Strategies for Learning Questionnaire on SRL, and additional items on participation. Year-1 performance was operationalised as students’ average Year-1 course examination grades. manova and structural equation modelling were used for analyses. __Results:__ Generally, students under the new assessment policy showed significantly higher Year-1 performance, SRL and participation, compared with students under the old assessment policy. The relationships between Year-1 performance, SRL and participation were similar across assessment policies. __Conclusions:__ This study indicates that the higher academic performance under a compensatory higher stakes, higher performance standard assessment policy, results from higher SRL and participation, but not from altered relationships between SRL, participation and performance. In sum, assessment policies have the potential to optimise student learning and performance

Psychotherapy for posttraumatic stress disorder in patients with borderline personality disorder: a systematic review and meta-analysis of its efficacy and safety

Background: Posttraumatic stress disorder (PTSD) is common in patients with personality disorders. This comorbidity is accompanied by a lower quality of life, and a higher risk of suicide attempts than patients with only one of these diagnoses. Objective: The aim of this systematic review and meta-analysis was to evaluate the scientific evidence of the efficacy of PTSD treatments for this population. Method: A literature search was performed from 1946 through June 2020. Standardized mean effect sizes of psychotherapy for PTSD were computed. Results: The literature search revealed that psychotherapy was the only intervention that was systematically explored. Fourteen studies were included. In 12 of these studies solely patients with borderline personality disorder participated. Analysis of the four RCTs showed a significant, moderate to high standardized effect size for reducing PTSD symptom severity (Hedges’ g = 0.54), with effects being maintained at least 3 months (Hedges’ g = 0.82). Effect sizes for all studies were also significant, with moderate to high standardized values for symptoms of PTSD (Hedges’ g = 1.04). PTSD improvements were again maintained at 3-month follow-up and beyond (Hedges’ g = 0.98). In addition, a significant decrease in symptoms of depression, anxiety, borderline symptoms, and PTSD in patients with borderline personality disorder could be revealed for all studies (Hedges’ g 0.48–1.04). No increase in self-injurious behaviour, suicide attempts, or hospitalization was observed, while the mean weighted dropout rate during PTSD treatment was 17%. Conclusions: Psychotherapy for PTSD is efficacious and safe for patients with borderline personality disorder and should not be withheld from these vulnerable individuals

Homogenizing Responses to Different Survey Questions on the Same Topic: Proposal of a Scale Homogenization Method Using a Reference Distribution

Survey data are often used for comparison purposes, such as comparisons across nations or comparisons over time. To be effective, this would require equivalent questions and equivalent responses options to the questions. Yet there is a lot of variation in the response scales used, which, for example, differ in the number of response options used and the labeling of these options. This is the case in happiness research, and as a result most of the research data in this field is incomparable. Several methods have been proposed to transform ratings on verbal response scales to a common numerical scale, typically ranging from 0 to 10. In this paper we give an overview of the progress made in those Scale Homogenization methods over time. We describe two early methods: Linear Stretch and the Semantic Judgement of Fixed Word Value Method. Next we discuss the Semantic Judgement of Word Value in Context Method in more detail. Based on these discussions we propose a new Reference Distribution Method. We apply the Semantic Judgement of Word Value in Context and the Reference Distribution Methods to data on happiness in The Netherlands for the years 1989-2009. We show that the Reference Distribution Method produces comparable time series on different questions and that it allows discontinuities in data to be corrected

Conversion of Verbal Response Scales: Robustness Across Demographic Categories

Happiness and life satisfaction have traditionally been measured using verbal response scales, however, these verbal scales have not kept up with the present trend to use numerical response scales. A switch from a verbal scale to a numerical scale, however, causes a severe problem for trend analyses, due to the incomparability of the old and new measurements. The Reference Distribution Method is a method that has been developed recently to deal with this comparison problem. In this method use is made of a reference distribution based on responses to a numerical scale which is used to decide at which point verbally labelled response options transit from one state to another, for example from ‘happy’ to ‘very happy’. Next, for each wave of the time series in which the verbal scale is used, a population mean is estimated for the beta distribution that fits best to these transition points and the responses in this wave. These estimates are on a level that is comparable to that of the mean of the reference distribution and are appropriate for use in an extended time series based on the responses measured using a verbal and a numerical scale. In this paper we address the question of whether the transition points derived for the general population can be used for demographic categories to produce reliable, extended time series to monitor differences in trends among these categories. We conclude that this is possible and that it is not necessary to derive transition points for each demographic category separately