Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research

Replicability of findings is an essential prerequisite of research. For both basic and clinical research, however, low replicability of findings has recently been reported. Replicability may be affected by research biases not sufficiently controlled for by the existing research standards. Several biases such as researcher allegiance or selective reporting are well-known for affecting results. For psychotherapy and pharmacotherapy research, specific additional biases may affect outcome (e.g. therapist allegiance, therapist effects or impairments in treatment implementation). For meta-analyses further specific biases are relevant. In psychotherapy and pharmacotherapy research these biases have not yet been systematically discussed in the context of replicability. Using a list of 13 biases as a starting point, we discuss each bias's impact on replicability. We illustrate each bias by selective findings of recent research, showing that (1) several biases are not yet sufficiently controlled for by the presently applied research standards, (2) these biases have a pernicious effect on replicability of findings. For the sake of research credibility, it is critical to avoid these biases in future research. To control for biases and to improve replicability, we propose to systematically implement several measures in psychotherapy and pharmacotherapy research, such as adversarial collaboration (inviting academic rivals to collaborate), reviewing study design prior to knowing the results, triple-blind data analysis (including subjects, investigators and data managers/statisticians), data analysis by other research teams (crowdsourcing), and, last not least, updating reporting standards such as CONSORT or the Template for Intervention Description and Replication (TIDieR)

Is psychotherapy effective? A re-analysis of treatments for depression

Aims The aim of this study was to reanalyse the data from Cuijpers et al.'s (2018) meta-analysis, to examine Eysenck's claim that psychotherapy is not effective. Cuijpers et al.after correcting for bias, concluded that the effect of psychotherapy for depression was small (standardised mean difference, SMD, between 0.20 and 0.30), providing evidence that psychotherapy is not as effective as generally accepted.MethodsThe data for this study were the effect sizes included in Cuijpers et al. (2018). We removed outliers from the data set of effects, corrected for publication bias and segregated psychotherapy from other interventions. In our study, we considered wait-list (WL) controls as the most appropriate estimate of the natural history of depression without intervention.ResultsThe SMD for all interventions and for psychotherapy compared to WL controls was approximately 0.70, a value consistent with past estimates of the effectiveness of psychotherapy. Psychotherapy was also more effective than care-as-usual (SMD = 0.31) and other control groups (SMD = 0.43).ConclusionsThe re-analysis reveals that psychotherapy for adult patients diagnosed with depression is effective

Quality of life in patients with personality disorders seen at an ordinary psychiatric outpatient clinic

BACKGROUND: Epidemiological studies have found reduced health-related quality of life (QoL) in patients with personality disorders (PDs), but few clinical studies have examined QoL in PDs, and none of them are from an ordinary psychiatric outpatient clinic (POC). We wanted to examine QoL in patients with PDs seen at a POC, to explore the associations of QoL with established psychiatric measures, and to evaluate QoL as an outcome measure in PD patients. METHODS: 72 patients with PDs at a POC filled in the MOS Short Form 36 (SF-36), and two established psychiatric self-rating measures. A national norm sample was compared on the SF-36. An independent psychiatrist diagnosed PDs and Axis-I disorders by structured interviews and rated the Global Assessment of Functioning (GAF). All measurements were repeated in the 39 PD patients that attended the 2 years follow-up examination. RESULTS: PD patients showed high co-morbidity with other PDs and Axis I mental disorders, and they scored significantly lower on all the SF-36 dimensions than age- and gender-adjusted norms. Adjustment for co-morbid Axis I disorders had some influence, however. The SF-36 mental health, vitality, and social functioning were significantly associated with the GAF and the self-rated psychiatric measures. Significant changes at follow-up were found in the psychiatric measures, but only on the mental health and role-physical of the SF-36. CONCLUSION: Patients with PDs seen for treatment at a POC have globally poor QoL. Both physical and mental dimensions of the SF-36 are correlated with established psychiatric measures in such patients, but significant changes in these measures are only partly associated with changes in the SF-36 dimensions

Narcissism in patients admitted to psychiatric acute wards: its relation to violence, suicidality and other psychopathology

<p>Abstract</p> <p>Background</p> <p>The objective was to examine various aspects of narcissism in patients admitted to acute psychiatric wards and to compare their level of narcissism to that of an age- and gender-matched sample from the general population (NORM).</p> <p>Methods</p> <p>This cross-sectional study interviewed 186 eligible acute psychiatric patients with the Brief Psychiatric Rating Scale (BPRS) and the Global Assessment of Functioning (GAF). The patients filled in the Narcissistic Personality Inventory-21 item version (NPI-21), The Hospital Anxiety and Depression Scale (HADS) and the Rosenberg Self-Esteem Scale. High and low narcissism was defined by the median of the total NPI-21 score. An age- and gender-matched control sample from the general population also scored the NPI-21 (NORM).</p> <p>Results</p> <p>Being male, involuntary admitted, having diagnosis of schizophrenia, higher self-esteem, and severe violence were significantly associated with high narcissism, and so were also low levels of suicidality, depression, anxiety and GAF scores. Severe violence and high self-esteem were significantly associated with high narcissism in multivariable analyses. The NPI-21 and its subscales showed test-retest correlations ≥0.83, while the BPRS and the HADS showed lower correlations, confirming the trait character of the NPI-21. Depression and suicidality were negatively associated with the NPI-21 total score and all its subscales, while positive association was observed with grandiosity. No significant differences were observed between patients and NORM on the NPI-21 total score or any of the NPI subscales.</p> <p>Conclusion</p> <p>Narcissism in the psychiatric patients was significantly associated with violence, suicidality and other symptoms relevant for management and treatment planning. Due to its trait character, use of the NPI-21 in acute psychiatric patients can give important clinical information. The similar level of narcissism found in patients and NORM is in need of further examination.</p

Global Assessment of Functioning (GAF): properties and frontier of current knowledge

ABSTRACT: BACKGROUND: Global Assessment of Functioning (GAF) is well known internationally and widely used for scoring the severity of illness in psychiatry. Problems with GAF show a need for its further development (for example validity and reliability problems). The aim of the present study was to identify gaps in current knowledge about properties of GAF that are of interest for further development. Properties of GAF are defined as characteristic traits or attributes that serve to define GAF (or may have a role to define a future updated GAF). METHODS: A thorough literature search was conducted. RESULTS: A number of gaps in knowledge about the properties of GAF were identified: for example, the current GAF has a continuous scale, but is a continuous or categorical scale better? Scoring is not performed by setting a mark directly on a visual scale, but could this improve scoring? Would new anchor points, including key words and examples, improve GAF (anchor points for symptoms, functioning, positive mental health, prognosis, improvement of generic properties, exclusion criteria for scoring in 10-point intervals, and anchor points at the endpoints of the scale)? Is a change in the number of anchor points and their distribution over the total scale important? Could better instructions for scoring within 10-point intervals improve scoring? Internationally, both single and dual scales for GAF are used, but what is the advantage of having separate symptom and functioning scales? Symptom (GAF-S) and functioning (GAF-F) scales should score different dimensions and still be correlated, but what is the best combination of definitions for GAF-S and GAF-F? For GAF with more than two scales there is limited empirical testing, but what is gained or lost by using more than two scales? CONCLUSIONS: In the history of GAF, its basic properties have undergone limited changes. Problems with GAF may, in part, be due to lack of a research programme testing the effects of different changes in basic properties. Given the widespread use, research-based development of GAF has not been especially strong. Further research could improve GAF

Design of a multicentered randomized controlled trial on the clinical and cost effectiveness of schema therapy for personality disorders

<p>Abstract</p> <p>Background</p> <p>Despite international guidelines describing psychotherapy as first choice for people with personality disorders (PDs), well-designed research on the effectiveness and cost-effectiveness of psychotherapy for PD is scarce. Schema therapy (ST) is a specific form of psychological treatment that proved to be effective for borderline PD. Randomized controlled studies on the effectiveness of ST for other PDs are lacking. Another not yet tested new specialized treatment is Clarification Oriented Psychotherapy (COP). The aim of this project is to perform an effectiveness study as well as an economic evaluation study (cost effectiveness as well as cost-utility) comparing ST versus COP versus treatment as usual (TAU). In this study, we focus on avoidant, dependent, obsessive-compulsive, paranoid, histrionic and narcissistic PD.</p> <p>Methods/Design</p> <p>In a multicentered randomized controlled trial, ST, and COP as an extra experimental condition, are compared to TAU. Minimal 300 patients are recruited in 12 mental health institutes throughout the Netherlands, and receive an extensive screening prior to enrolment in the study. When eligible, they are randomly assigned to one of the intervention groups. An economic evaluation and a qualitative research study on patient and therapist perspectives on ST are embedded in this trial. Outcome assessments (both for clinical effectiveness and economic evaluation) take place at 6,12,18,24 and 36 months after start of treatment. Primary outcome is recovery from PD; secondary measures include general psychopathological complaints, social functioning and quality of life. Data for the cost-effectiveness and cost-utility analyses are collected by using a retrospective cost interview. Information on patient and therapist perspectives is gathered using in-depth interviews and focus groups, and focuses on possible helpful and impeding aspects of ST.</p> <p>Discussion</p> <p>This trial is the first to compare ST and COP head-to-head with TAU for people with a cluster C, paranoid, histrionic and/or narcissistic PD. By combining clinical effectiveness data with an economic evaluation and with direct information from primary stakeholders, this trial offers a complete and thorough view on ST as a contribution to the improvement of treatment for this PD patient group.</p> <p>Trial registration</p> <p>Netherlands Trial Register (NTR): <a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=566">NTR566</a></p

Tavistock Adult Depression Study (TADS): a randomised controlled trial of psychoanalytic psychotherapy for treatment-resistant/treatment-refractory forms of depression

ABSTRACT: BACKGROUND: Long-term forms of depression represent a significant mental health problem for which there is a lack of effective evidence-based treatment. This study aims to produce findings about the effectiveness of psychoanalytic psychotherapy in patients with treatment-resistant/treatment-refractory depression and to deepen the understanding of this complex form of depression. METHODS: INDEX GROUP: Patients with treatment resistant/treatment refractory depression. DEFINITION & INCLUSION CRITERIA: Current major depressive disorder, 2 years history of depression, a minimum of two failed treatment attempts, [greater than or equal to]14 on the HRSD or [greater than or equal to]21 on the BDI, plus complex personality and/or psycho-social difficulties. EXCLUSION CRITERIA: Moderate or severe learning disability, psychotic illness, bipolar disorder, substance dependency or receipt of test intervention in the previous two years. DESIGN: Pragmatic, randomised controlled trial with qualitative and clinical components. TEST INTERVENTION: 18 months of weekly psychoanalytic psychotherapy, manualised and fidelity-assessed using the Psychotherapy Process Q-Sort. CONTROL CONDITION: Treatment as usual, managed by the referring practitioner. RECRUITMENT: GP referrals from primary care. RCT MAIN OUTCOME: HRSD (with [less than or equal to]14 as remission). SECONDARY OUTCOMES: depression severity (BDI-II), degree of co-morbid disorders Axis-I and Axis-II (SCID-I and SCID-II-PQ), quality of life and functioning (GAF, CORE, Q-les-Q), object relations (PROQ2a), Cost-effectiveness analysis (CSRI and GP medical records). FOLLOW-UP: 2 years. Plus: a). Qualitative study of participants' and therapists' problem formulation, experience of treatment and of participation in trial. (b) Narrative data from semi-structured pre/post psychodynamic interviews to produce prototypes of responders and non-responders. (c) Clinical case-studies of sub-types of TRD and of change. DISCUSSION: TRD needs complex, long-term intervention and extended research follow-up for the proper evaluation of treatment outcome. This pushes at the limits of the design of randomised therapeutic trials,. We discuss some of the consequent problems and suggest how they may be mitigated. Trial registration Current Controlled Trials ISRCTN40586372