Measuring patient satisfaction with four items: validity of the client satisfaction questionnaire 4 in an outpatient population

Introduction: Patient satisfaction with mental health services has for several decades been considered an important component when evaluating service quality. It is often assessed in the context of monitoring quality of care, developing or evaluating newly implemented interventions or changes in practice. Because of this, patient satisfaction questionnaires are often added to longer questionnaire batteries, and shorter questionnaires are preferred to prevent respondent fatigue and non-compliance and to secure easy implementation. However, most studies use unvalidated patient satisfaction measures, making comparisons between studies difficult. Validation studies of short patient satisfaction measures are therefore warranted. Methods: The primary aim was to examine the construct validity and internal reliability of the Client Satisfaction Questionnaire-4 (CSQ-4) in a Norwegian outpatient mental health setting. A total of 467 patients were recruited from an outpatient psychiatric care clinic in Central Norway. The secondary aim was to examine an earlier proposed cutoff for classifying dissatisfied patients in this new population. A principal component analysis was conducted to evaluate factor structure, correlation analyses were conducted to test for predicted relationships, and Cronbach’s alpha was calculated to examine internal reliability. Results: The CSQ-4 showed a clear unidimensional structure with one factor explaining 80% of its variance. Its internal reliability was very high, with a Cronbach’s alpha of 0.92. As hypothesised this study found no statistically significant sex differences in satisfaction and no statistically significant association between age and satisfaction. Positive changes in symptoms during treatment and higher post-treatment functional impairment were associated with higher patient-reported treatment satisfaction scores, which indicates good construct validity. Conclusion: This is the first study to evaluate the CSQ-4 in a psychiatric population. The CSQ-4 demonstrated good structural validity and internal reliability and was correlated with outcome variables in terms of symptom change and post-treatment functioning. In sum, this indicates that the CSQ-4 is a good short alternative for evaluating patient satisfaction in routine outpatient mental health care.publishedVersio

A digital Norwegian version of the client satisfaction questionnaire 8: factor validity and internal reliability in outpatient mental health care

Background Validated measures of patient-reported experiences are essential for assessing and improving the quality of mental health services and interventions. In Norwegian mental healthcare settings, the Client Satisfaction Questionnaire (CSQ-8) is increasingly being used for this purpose, but the validity and reliability of the Norwegian translation have not been investigated. Methods We examined the factor structure and internal consistency of a digitally administrated Norwegian translation of the CSQ-8 in a sample of 338 patients recruited from outpatient treatment. The relationship between satisfaction scores and the change in symptom severity during treatment, measured by the Patient Health Questionnaire-4, was also investigated. Results The Norwegian CSQ-8 showed a clear unidimensional structure with one factor explaining 74% of the variance. Internal consistency was very high, with a Cronbach’s alpha of 0.95. Satisfaction showed a small-to-moderate negative relationship with change in symptom severity. Satisfaction scores were negatively skewed, and the presence of ceiling effects is discussed. Conclusion Our results support the use of the Norwegian CSQ-8 as a valid and reliable measure of satisfaction with mental healthcare services. Further studies are needed to determine the test-retest reliability of the questionnaire, its sensitivity to change, and to assess its propensity to ceiling effects.publishedVersio

Cost-Effectiveness of Collaborative Care for Depression in UK Primary Care: Economic Evaluation of a Randomised Controlled Trial (CADET)

Background: Collaborative care is an effective treatment for the management of depression but evidence on its cost-effectiveness in the UK is lacking. Aims: To assess the cost-effectiveness of collaborative care in a UK primary care setting. Methods: An economic evaluation alongside a multi-centre cluster randomised controlled trial comparing collaborative care with usual primary care for adults with depression (n = 581). Costs, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratios (ICER) were calculated over a 12-month follow-up, from the perspective of the UK National Health Service and Personal Social Services (i.e. Third Party Payer). Sensitivity analyses are reported, and uncertainty is presented using the cost-effectiveness acceptability curve (CEAC) and the cost-effectiveness plane. Results: The collaborative care intervention had a mean cost of £272.50 per participant. Health and social care service use, excluding collaborative care, indicated a similar profile of resource use between collaborative care and usual care participants. Collaborative care offered a mean incremental gain of 0.02 (95% CI: –0.02, 0.06) quality-adjusted life-years over 12 months, at a mean incremental cost of £270.72 (95% CI: –202.98, 886.04), and resulted in an estimated mean cost per QALY of £14,248. Where costs associated with informal care are considered in sensitivity analyses collaborative care is expected to be less costly and more effective, thereby dominating treatment as usual. Conclusion: Collaborative care offers health gains at a relatively low cost, and is cost-effective compared with usual care against a decision-maker willingness to pay threshold of £20,000 per QALY gained. Results here support the commissioning of collaborative care in a UK primary care setting

DIgital Alcohol Management ON Demand (DIAMOND) feasibility randomised controlled trial of a web-based intervention to reduce alcohol consumption in people with hazardous and harmful use versus a face-to-face intervention: protocol.

BACKGROUND: "Hazardous and harmful" drinkers make up approximately 23 % of the adult population in England. However, only around 10 % of these people access specialist care, such as face-to-face extended brief treatment in community alcohol services. This may be due to stigma, difficulty accessing services during working hours, a shortage of trained counsellors and limited provision of services in many places. Web-based alcohol treatment programmes may overcome these barriers and may better suit people who are reluctant or unable to attend face-to-face services, but there is a gap in the evidence base for the acceptability, effectiveness and cost-effectiveness of these programmes compared with treatment as usual (TAU) in community alcohol services. This study aims investigate the feasibility of all parts of a randomised controlled trial (RCT) of a psychologically informed web-based alcohol treatment programme called Healthy Living for People who use Alcohol (HeLP-Alcohol) versus TAU in community alcohol services, e.g. recruitment and retention, online data collection methods, and the use and acceptability of the intervention to participants. METHODS: A feasibility RCT delivered in north London community alcohol services, comparing HeLP-Alcohol with TAU. Potential participants are aged ≥18 years referred or self-referred for hazardous and harmful use of alcohol, without co-morbidities or other complex problems. The main purpose of this study is to demonstrate the feasibility of recruiting participants to the study and will test online methods for collecting baseline demographic and outcome questionnaire data, randomising participants and collecting 3-month follow-up data. The acceptability of this intervention will be measured by recruitment and retention rates, automated log-in data collection and an online service satisfaction questionnaire. The feasibility of using tailored text message, email or phone prompt to maintain engagement with the intervention will also be explored. Results of the study will inform a definitive Phase 3 RCT. RESULTS: Recruitment started on 26 September 2014 and will run for 1 year. CONCLUSION: The proposed trial will provide data to inform a fully powered non-inferiority effectiveness and cost-effectiveness RCT comparing HeLP-Alcohol with TAU. TRIAL REGISTRATION: ISRCTN31789096

The PULSAR Specialist Care protocol: a stepped-wedge cluster randomized control trial a training intervention for community mental health teams in recovery-oriented practice

Background: Recovery features strongly in Australian mental health policy; however, evidence is limited for the efficacy of recovery-oriented practice at the service level. This paper describes the Principles Unite Local Services Assisting Recovery (PULSAR) Specialist Care trial protocol for a recovery-oriented practice training intervention delivered to specialist mental health services staff. The primary aim is to evaluate whether adult consumers accessing services where staff have received the intervention report superior recovery outcomes compared to adult consumers accessing services where staff have not yet received the intervention. A qualitative sub-study aims to examine staff and consumer views on implementing recovery-oriented practice. A process evaluation sub-study aims to articulate important explanatory variables affecting the interventions rollout and outcomes. Methods: The mixed methods design incorporates a two-step stepped-wedge cluster randomized controlled trial (cRCT) examining cross-sectional data from three phases, and nested qualitative and process evaluation sub-studies. Participating specialist mental health care services in Melbourne, Victoria are divided into 14 clusters with half randomly allocated to receive the staff training in year one and half in year two. Research participants are consumers aged 18-75 years who attended the cluster within a previous three-month period either at baseline, 12 (step 1) or 24 months (step 2). In the two nested sub-studies, participation extends to cluster staff. The primary outcome is the Questionnaire about the Process of Recovery collected from 756 consumers (252 each at baseline, step 1, step 2). Secondary and other outcomes measuring well-being, service satisfaction and health economic impact are collected from a subset of 252 consumers (63 at baseline; 126 at step 1; 63 at step 2) via interviews. Interview based longitudinal data are also collected 12 months apart from 88 consumers with a psychotic disorder diagnosis (44 at baseline, step 1; 44 at step 1, step 2). cRCT data will be analyzed using multilevel mixed-effects modelling to account for clustering and some repeated measures, supplemented by thematic analysis of qualitative interview data. The process evaluation will draw on qualitative, quantitative and documentary data. Discussion: Findings will provide an evidence-base for the continued transformation of Australian mental health service frameworks toward recovery

Effectiveness and cost-effectiveness of a patient-initiated botulinum toxin treatment model for blepharospasm and hemifacial spasm: a study protocol for a randomised controlled trial

Background Blepharospasm and hemifacial spasm are debilitating conditions that significantly impact on patient quality of life. Cyclical treatment with botulinum toxin injections offers temporary relief, but the duration of treatment efficacy is variable. The standard model of patient care defines routine fixed-time based scheduled treatment cycles which may lead to unnecessarily frequent treatment for some patients and experience of distressing symptoms in others, if symptoms return before the scheduled follow-up period. Methods/Design A randomised controlled trial will compare a patient-initiated model of care, where patients determine botulinum toxin treatment timing, to the standard model of care in which care is scheduled by the clinical team. A sample of 266 patients with blepharospasm or hemifacial spasm will be recruited from Moorfields Eye Hospital (MEH), London. The trial will be accompanied by a mixed methods evaluation of acceptability of the new service. Patients who meet eligibility criteria will be assessed at baseline and those in the intervention group will be provided instructions on how to book their own treatment appointments. Patients in both groups will be followed up 3 and 9 months into the trial and all patients will be returned to usual care after 9 months to meet safety protocols. Primary outcome measures include disease severity (questionnaire), functional disability (questionnaire) and patient satisfaction with care (questionnaire). Secondary outcomes include disease-specific quality of life (questionnaire), mood (questionnaire), illness and treatment perceptions (questionnaire and semi-structured interviews), economic impact (questionnaire) and acceptability (questionnaire and semi-structured interviews). Discussion This trial will assess the effectiveness and cost-effectiveness of a patient-led care model for botulinum toxin therapy. If the new model is shown to be effective in reducing distress and disability in these populations and is found to be acceptable to patients, whilst being cost-effective, this will have significant implications for service organisation across the NHS. Trial registration UK Clinical Research Network (UKCRN) Portfolio 18660. Clinicaltrials.gov ID NCT102577224 (registered 29th October 2015

Efficacy and cost-effectiveness of a web-based and mobile stress-management intervention for employees: design of a randomized controlled trial

Background: Work-related stress is associated with a variety of mental and emotional problems and can lead to substantial economic costs due to lost productivity, absenteeism or the inability to work. There is a considerable amount of evidence on the effectiveness of traditional face-to-face stress-management interventions for employees; however, they are often costly, time-consuming, and characterized by a high access threshold. Web-based interventions may overcome some of these problems yet the evidence in this field is scarce. This paper describes the protocol for a study that will examine the efficacy and cost-effectiveness of a web-based guided stress-management training which is based on problem solving and emotion regulation and aimed at reducing stress in adult employees. Methods. The study will target stressed employees aged 18 and older. A randomized controlled trial (RCT) design will be applied. Based on a power calculation of d=.35 (1-β of 80%, α =.05), 264 participants will be recruited and randomly assigned to either the intervention group or a six-month waitlist control group. Inclusion criteria include an elevated stress level (Cohen's Perceived Stress Scale-10 ≥ 22) and current employment. Exclusion criteria include risk of suicide or previously diagnosed psychosis or dissociative symptoms. The primary outcome will be perceived stress, and secondary outcomes include depression and anxiety. Data will be collected at baseline and seven weeks and six months after randomization. An extended follow up at 12 months is planned for the intervention group. Moreover, a cost-effectiveness analysis will be conducted from a societal perspective and will include both direct and indirect health care costs. Data will be analyzed on an intention-to-treat basis and per protocol. Discussion. The substantial negative consequences of work-related stress emphasize the necessity for effective stress-management trainings. If the proposed internet intervention proves to be (cost-) effective, a preventative, economical stress-management tool will be conceivable. The strengths and limitations of the present study are discussed. Trial registration. German Register of Clinical Studies (DRKS): DRKS00004749. © 2013 Heber et al.; licensee BioMed Central Ltd

Group cognitive analytic music therapy: a quasi-experimental feasibility study conducted in a high secure hospital

This study conducted a feasibility patient preference quasi-experimental study of group cognitive analytic music therapy (G-CAMT) for mentally disordered offenders. Participants either chose or were randomised to 16 sessions of manualised G-CAMT (N = 10) plus treatment as usual (TAU) or TAU alone (N = 10). Self-rated and staff-rated outcomes were assessed at baseline, post-intervention and 8-weeks post-intervention. Residency was assessed at 2-year follow-up. Results indicate that G-CAMT was easily implemented; 9/10 participants completed G-CAMT and attendees had high satisfaction with the approach. Session attendance was high; 4/10 participants attended all sessions. At the 8-week follow-up, 3/9 G-CAMT participants had reliable reductions (i.e. statistically reliable pre to 8-week follow-up change results) in intrusive/possessive behaviours and fear of separation/abandonment. On the staff-rated outcome measure G-CAMT participants as a group were statistically significantly friendlier compared to TAU at 8-week follow-up (U = 0.50, p = 0.009, d = 1.92, CI 0.44 to 3.11). There were no differences between the arms in terms of residency outcomes at 2-year follow-up. The study is discussed in terms of G-CAMT’s theoretical grounding and high acceptability. The study is limited by its small sample size, but indicates the possibility of progressing onto a full trial

Impact of a nurse-led intervention to improve screening for cardiovascular risk factors in people with severe mental illnesses. Phase-two cluster randomised feasibility trial of community mental health teams

Background: People with severe mental illnesses (SMI) are at increased risk of cardiovascular disease (CVD). Clinical guidelines recommend regular screening for CVD risk factors. We evaluated a nurse led intervention to improve screening rates across the primary-secondary care interface.Methods: Six community mental health teams (CMHTs) were randomised to receive either the nurse led intervention plus education pack (n = 3) or education pack only (n = 3). Intervention (6 months): The nurse promoted CVD screening in primary care and then in CMHTs. Patients who remained unscreened were offered screening by the nurse. After the intervention participants with SMI were recruited from each CMHT to collect outcome data. Main outcome: Numbers screened during the six months, confirmed in General Practice notes.Results: All six CMHTs approached agreed to randomisation. 121 people with SMI participated in outcome interviews during two waves of recruitment (intervention arm n = 59, control arm n = 62). Participants from both arms of the trial had similar demographic profiles and rates of previous CVD screening in the previous year, with less than 20% having been screened for each risk factor. After the trial, CVD screening had increased in both arms but participants from the intervention arm were significantly more likely to have received screening for blood pressure (96% vs 68%; adjusted Odds Ratio (OR) 13.6; 95% CI: 3.5-38.4), cholesterol (66.7% vs 26.9%, OR 6.1; 3.2-11.5), glucose (66.7% vs 36.5% OR 4.4; 2.7-7.1), BMI (92.5% vs 65.2% OR 6.5; 2.1-19.6), and smoking status (88.2% vs 57.8% OR 5.5; 3.2-9.5) and have a 10 year CVD risk score calculated (38.2% vs 10.9%) OR 5.2 1.8-15.3). Within the intervention arm approximately half the screening was performed in general practice and half by the trial nurse.Conclusions: The nurse-led intervention was superior, resulting in an absolute increase of approximately 30% more people with SMI receiving screening for each CVD risk factor. The feasibility of the trial was confirmed in terms of CMHT recruitment and the intervention, but the response rate for outcome collection was disappointing; possibly a result of the cluster design. The trial was not large or long enough to detect changes in risk factors.Trial Registration: International Standard Randomised Controlled Trial Registration Number (ISRCTRN) 58625025

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ)

<p>Abstract</p> <p>Background</p> <p>The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.</p> <p>Methods</p> <p>Two national postal surveys of psychiatric outpatients took place in Norway in 2004 and 2007. The performance of the POPEQ, including item functioning and differential item functioning, was assessed by Rasch analysis. Principal component analysis of item residuals was used to assess the presence of subdimensions.</p> <p>Results</p> <p>6,677 (43.3%) and 11,085 (35.2%) psychiatric out patients responded to the questionnaire in 2004 and 2007, respectively. All items in the scale were retained after the Rasch analysis. The resulting scale had reasonably good fit to the Rasch model. The items performed the same for the two survey years and there was no differential item functioning relating to patient characteristics. Principal component analysis of the residuals confirmed that the measure to a high degree is unidimensional. However, the data also reflects three potential subscales, each relating to one of the three included aspects of health care.</p> <p>Conclusions</p> <p>The POPEQ had excellent psychometric properties and Rasch analysis further supported the construct validity of the scale by also identifying the three subdimensions originally included as components in the instrument development. The 11-item instrument is recommended in future research on psychiatric out-patient experiences. Future development may lead to the construction of more precise measures of the three subdomains that the POPEQ is based on.</p