Performance indicators for public mental healthcare: A systematic international inventory

Abstract Background The development and use of performance indicators (PI) in the field of public mental health care (PMHC) has increased rapidly in the last decade. To gain insight in the current state of PI for PMHC in nations and regions around the world, we conducted a structured review of publications in scientific peer-reviewed journals supplemented by a systematic inventory of PI published in policy documents by (non-) governmental organizations. Methods Publications on PI for PMHC were identified through database- and internet searches. Final selection was based on review of the full content of the publications. Publications were ordered by nation or region and chronologically. Individual PI were classified by development method, assessment level, care domain, performance dimension, diagnostic focus, and data source. Finally, the evidence on feasibility, data reliability, and content-, criterion-, and construct validity of the PI was evaluated. Results A total of 106 publications were included in the sample. The majority of the publications (n = 65) were peer-reviewed journal articles and 66 publications specifically dealt with performance of PMHC in the United States. The objectives of performance measurement vary widely from internal quality improvement to increasing transparency and accountability. The characteristics of 1480 unique PI were assessed. The majority of PI is based on stakeholder opinion, assesses care processes, is not specific to any diagnostic group, and utilizes administrative data sources. The targeted quality dimensions varied widely across and within nations depending on local professional or political definitions and interests. For all PI some evidence for the content validity and feasibility has been established. Data reliability, criterion- and construct validity have rarely been assessed. Only 18 publications on criterion validity were included. These show significant associations in the expected direction on the majority of PI, but mixed results on a noteworthy number of others. Conclusions PI have been developed for a broad range of care levels, domains, and quality dimensions of PMHC. To ensure their usefulness for the measurement of PMHC performance and advancement of transparency, accountability and quality improvement in PMHC, future research should focus on assessment of the psychometric properties of PI

Composing a core set of performance indicators for public mental health care: a modified Delphi procedure

Public mental health care (PMHC) systems are responsible for the wellbeing of vulnerable groups that cope with complex psychosocial problems. This article describes the development of a set of performance indicators that are feasible, meaningful, and useful to assess the quality of the PMHC system in Amsterdam, the Netherlands. Performance indicators were selected from an international inventory and presented to stakeholders of the PMHC system in a modified Delphi procedure. Characteristics of indicators were judged individually, before consensus on a core set was reached during a plenary discussion. Involving stakeholders at early stages of development increases support for quality assessmen

Effects of Assistive Home Technology on quality of life and falls of people with dementia and job satisfaction of caregivers; results from a pilot randomized controlled trial

Objectives: Determine the effects of the implementation of Assistive Home Technology (AHT) in group homes on the quality of life (QoL) of people with dementia and on job satisfaction of caregivers. Method: Pilot randomized controlled trial in nine in-patient care group homes (group homes with vs. without AHT). Participants were 54 people with dementia and 25 professionals. Outcome measurements were QoL, fall incidents, needs, use of restraints, job satisfaction, workload, and general health. Results: Living in a group home with AHT had a positive effect on four QoL domains: ‘social isolation’, ‘having things to do’, ‘esthetics’, and ‘quality of life appreciation’. No effects were found on 12 other QoL domains. Fall incidents during bathroom visits were significantly reduced by the application of AHT. During this implementation phase, in the AHT group home, a moderate negative effect was found on caregiver’s appreciation of work circumstances. No effects on other outcome measures were found. Conclusion: Positive effects were found on aspects of QoL and fall incidents in the bathroom. The lower caregiver appreciation of work circumstances in the AHT group confirms the importance of intensive support and guidance of personnel during the implementation of AHT

Psychometric properties of the Dutch version of the self-sufficiency matrix (SSM-D)

Measuring treatment outcomes can be challenging in patients who experience multiple interlinked problems, as is the case in public mental health care (PMHC). This study describes the development and psychometric properties of a Dutch version of the self-sufficiency matrix (SSM-D), an instrument that measures outcomes and originates from the US. In two different settings, clients were rated using the SSM-D in combination with the Health of the Nation Outcome Scales (HoNOS) and the Camberwell assessment of need short appraisal schedule (CANSAS). The results provided support for adequate psychometric properties of the SSM-D. The SSM-D had a solid single factor structure and internal consistency of the scale was excellent. In addition, convergent validity of the SSM-D was indicated by strong correlations between HoNOS and CANSAS, as well as between several subdomains. Further research is needed to establish whether the results presented here can be obtained in other PMHC setting

The use of the Dutch Self-Sufficiency Matrix (SSM-D) to inform allocation decisions to public mental health care for homeless people

The current study set out to develop a decision support tool based on the Self-Sufficiency Matrix (Dutch version; SSM-D) for the clinical decision to allocate homeless people to the public mental health care system at the central access point of public mental health care in Amsterdam, The Netherlands. Logistic regression and receiver operating characteristic-curve analyses were used to model professional decisions and establish four decision categories based on SSM-D scores from half of the research population (Total n = 612). The model and decision categories were found to be accurate and reliable in predicting professional decisions in the second half of the population. Results indicate that the decision support tool based on the SSM-D is useful and feasible. The method to develop the SSM-D as a decision support tool could be applied to decision-making processes in other systems and services where the SSM-D has been implemented, to further increase the utility of the instrumen