Beyond the ecological fallacy: potential problems when studying healthcare organisations.

Ecological studies, which consider patient groups rather than individuals, are common in health policy research. The ‘ecological fallacy’ is a well-recognised methodological concern, but in this perspectives paper, we focus on less often appreciated but equally important limitations of such studies. In particular, we consider reliability and power as they apply to ecological studies, and make recommendations to inform the appropriate design and interpretation of these increasingly popular studies.This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. GL is supported by a Cancer Research UK Clinician Scientist Fellowship (A18180). The views expressed in this publication are those of the authors and not necessarily those of any funder or any other organisation or institution.This is the author accepted manuscript. The final version is available from SAGE via http://dx.doi.org/10.1177/014107681561057

Response rates to patient surveys

BACKGROUND: Patient surveys typically have variable response rates between organizations, leading to concerns that such differences may affect the validity of performance comparisons. OBJECTIVE: To explore the size and likely sources of associations between hospital-level survey response rates and patient experience. RESEARCH DESIGN, SUBJECTS, AND MEASURES: Cross-sectional mail survey including 60 patient experience items sent to 101,771 cancer survivors recently treated by 158 English NHS hospitals. Age, sex, race/ethnicity, socioeconomic status, clinical diagnosis, hospital type, and region were available for respondents and nonrespondents. RESULTS: The overall response rate was 67% (range, 39% to 77% between hospitals). Hospitals with higher response rates had higher scores for all items (Spearman correlation range, 0.03-0.44), particularly questions regarding hospital-level administrative processes, for example, procedure cancellations or medical note availability.From multivariable analysis, associations between individual patient experience and hospital-level response rates were statistically significant (P<0.05) for 53/59 analyzed questions, decreasing to 37/59 after adjusting for case-mix, and 25/59 after further adjusting for hospital-level characteristics.Predicting responses of nonrespondents, and re-estimating hypothetical hospital scores assuming a 100% response rate, we found that currently low performing hospitals would have attained even lower scores. Overall nationwide attainment would have decreased slightly to that currently observed. CONCLUSIONS: Higher response rate hospitals have more positive experience scores, and this is only partly explained by patient case-mix. High response rates may be a marker of efficient hospital administration, and higher quality that should not, therefore, be adjusted away in public reporting. Although nonresponse may result in slightly overestimating overall national levels of performance, it does not appear to meaningfully bias comparisons of case-mix-adjusted hospital results.GL is supported by a Cancer Research UK Clinician Scientist Fellowship (A18180).This is the final version of the article. It first appeared from Wolters Kluwer via http://dx.doi.org/10.1097/MLR.000000000000045

Associations of the Consumer Assessment of Healthcare Providers and Systems (CAHPS) Clinician and Group Survey Scores with Interventions and Site, Provider, and Patient Factors: A Systematic Review of the Evidence.

Patient experience is a key aspect of care quality. Since the 2007 release of the Consumer Assessment of Healthcare Providers and Systems Clinician and Group (CG-CAHPS) survey, no systematic review of factors associated with CG-CAHPS scores has been reported. We reviewed 52 peer-reviewed English language articles published in the United States using CG-CAHPS data. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis guidelines and used the Checklist for Analytical Cross-Sectional Studies. We identified several interventions (eg, adding a care coordinator focused on chronic care management) associated with improved overall provider rating and 2 interventions (eg, peer shadow coaching) that improved provider communication scores. Studies evaluating the implementation of patient-centered medical homes or patient-reported outcomes found mixed results. We identified site-level factors (eg, better team communication) and provider-level factors (eg, physician empathy) associated with better patient experience. In contrast, patient-level factors (eg, medication adherence) found mixed associations with patient experience. Policymakers, clinicians, and healthcare leaders can leverage this evidence for quality improvement efforts and interventions supporting patient-centered care

Racial/ethnic disparities in health-related quality of life and health status across pre-, early-, and mid-adolescence: a prospective cohort study.

PURPOSE:To examine (1) racial/ethnic disparities in health-related quality of life (HRQOL) and overall health status among Black, Latino, and White youth during adolescence; (2) whether socioeconomic status (SES) and family contextual variables influence disparities; and (3) whether disparities are consistent from pre- to early- to mid-adolescence. METHODS:A population sample of 4823 Black (1755), Latino (1812), and White (1256) youth in three US metropolitan areas was prospectively assessed in a longitudinal survey conducted on three occasions, in 5th, 7th, and 10th grades, when youth reported their HRQOL using the PedsQL™ short-form Total, Physical and Psychosocial scales and youth and parents separately reported on youth's overall health status. Parents reported their education and household income to index SES, family structure, and use of English at home. RESULTS:Based on analysis conducted separately at each grade, marked racial/ethnic disparities were observed across all measures of HRQOL and health status, favoring White and disfavoring Black, and especially Latino youth. More strongly present in 5th and 7th grade, HRQOL disparities decreased by 10th grade. Most disparities between White and Black youth disappeared when adjusting for SES. However, even after adjusting for SES, family structure, and English use, overall health status disparities disfavoring Latino youth remained across all three assessments. CONCLUSIONS:Racial/ethnic disparities in adolescent HRQOL and health are substantial. These disparities appear consistent from pre- to early-adolescence but diminish for HRQOL by mid-adolescence. As disparities appear influenced by SES and other family contextual variables differently in different racial/ethnic groups, efforts to reduce health disparities in youth should address culturally specific conditions impinging on health

Helioseismological Implications of Recent Solar Abundance Determinations

We show that standard solar models are in good agreement with the helioseismologically determined sound speed and density as a function of solar radius, the depth of the convective zone, and the surface helium abundance, as long as those models do not incorporate the most recent heavy element abundance determinations. However, sophisticated new analyses of the solar atmosphere infer lower abundances of the lighter metals (like C, N, O, Ne, and Ar) than the previously widely used surface abundances. We show that solar models that include the lower heavy element abundances disagree with the solar profiles of sound speed and density as well as the depth of the convective zone and the helium abundance. The disagreements for models with the new abundances range from factors of several to many times the quoted uncertainties in the helioseismological measurements. The disagreements are at temperatures below what is required for solar interior fusion reactions and therefore do not significantly affect solar neutrino emission. If errors in thecalculated OPAL opacities are solely responsible for the disagreements, then the corrections in the opacity must extend from 2 times 10^6 K (R = 0.7R_Sun)to 5 times 10^6 K (R = 0.4 R_Sun), with opacity increases of order 10%.Comment: ApJ in press; clarified Figure

Sample designs for measuring the health of small racial/ethnic subgroups

Most national health surveys do not permit precise measurement of the health of racial/ethnic subgroups that comprise <1 per cent of the U.S. population. We identify three potentially promising sample design strategies for increasing the accuracy of national health estimates for a small target subgroup when used to supplement a small probability sample of that group and apply these strategies to American Indians/Alaska Natives (AI/AN) and Chinese using National Health Interview Survey data. These sample design strategies include (1) complete sampling of targets within households, (2) oversampling selected macrogeographic units, and (3) oversampling from an incomplete list frame. Stage (1) is promising for Chinese and AI/AN; (2) works for both groups, but it would be more cost-effective for AI/AN because of their greater residential concentration; (3) is somewhat effective for groups like Chinese with viable surname lists, but not for AI/AN. Both (2) and (3) efficiently improve measurement precision when the supplement is the same size as the existing core sample, with diminishing additional returns as the supplement grows relative to the core sample, especially for (3). To avoid large design effects, the oversampled geographic areas or lists must have good coverage of the target population. To reduce costs, oversampled geographic tracts and lists must consist primarily of targets. These techniques can be used simultaneously to substantially increase effective sample sizes (ESSs). For example, (1) and (2) in combination can be used to multiply the nominal sample size of AI/AN or Chinese by 8 and the ESS by 4. Copyright © 2008 John Wiley & Sons, Ltd.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/60911/1/3244_ftp.pd

Characteristics of service users and provider organisations associated with experience of out of hours general practitioner care in England: population based cross sectional postal questionnaire survey.

OBJECTIVE: To investigate the experience of users of out of hours general practitioner services in England, UK. DESIGN: Population based cross sectional postal questionnaire survey. SETTING: General Practice Patient Survey 2012-13. MAIN OUTCOME MEASURES: Potential associations between sociodemographic factors (including ethnicity and ability to take time away from work during working hours to attend a healthcare consultation) and provider organisation type (not for profit, NHS, or commercial) and service users' experience of out of hours care (timeliness, confidence and trust in the out of hours clinician, and overall experience of the service), rated on a scale of 0-100. Which sociodemographic/provider characteristics were associated with service users' experience, the extent to which any observed differences could be because of clustering of service users of a particular sociodemographic group within poorer scoring providers, and the extent to which observed differences in experience varied across types of provider. RESULTS: The overall response rate was 35%; 971,232/2,750,000 patients returned surveys. Data from 902,170 individual service users were mapped through their registered practice to one of 86 providers of out of hours GP care with known organisation type. Commercial providers of out of hours GP care were associated with poorer reports of overall experience of care, with a mean difference of -3.13 (95% confidence interval -4.96 to -1.30) compared with not for profit providers. Asian service users reported lower scores for all three experience outcomes than white service users (mean difference for overall experience of care -3.62, -4.36 to -2.89), as did service users who were unable to take time away from work compared with service users who did not work (mean difference for overall experience of care -4.73, -5.29 to -4.17). CONCLUSIONS: Commercial providers of out of hours GP care were associated with poorer experience of care. Targeted interventions aimed at improving experience for patients from ethnic minorities and patients who are unable to take time away from work might be warranted

Evaluation of Talking Parents, Healthy Teens, a new worksite based parenting programme to promote parent-adolescent communication about sexual health: randomised controlled trial

Objective To evaluate a worksite based parenting programme—Talking Parents, Healthy Teens—designed to help parents learn to address sexual health with their adolescent children

Understanding negative feedback from South Asian patients: an experimental vignette study.

OBJECTIVES: In many countries, minority ethnic groups report poorer care in patient surveys. This could be because they get worse care or because they respond differently to such surveys. We conducted an experiment to determine whether South Asian people in England rate simulated GP consultations the same or differently from White British people. If these groups rate consultations similarly when viewing identical simulated consultations, it would be more likely that the lower scores reported by minority ethnic groups in real surveys reflect real differences in quality of care. DESIGN: Experimental vignette study. Trained fieldworkers completed computer-assisted personal interviews during which participants rated 3 video recordings of simulated GP-patient consultations, using 5 communication items from the English GP Patient Survey. Consultations were shown in a random order, selected from a pool of 16. SETTING: Geographically confined areas of ∼130 households (output areas) in England, selected using proportional systematic sampling. PARTICIPANTS: 564 White British and 564 Pakistani adults recruited using an in-home face-to-face approach. MAIN OUTCOME MEASURE: Mean differences in communication score (on a scale of 0-100) between White British and Pakistani participants, estimated from linear regression. RESULTS: Pakistani participants, on average, scored consultations 9.8 points higher than White British participants (95% CI 8.0 to 11.7, p55) and where communication was scripted to be poor. CONCLUSIONS: Substantial differences in ratings were found between groups, with Pakistani respondents giving higher scores than White British respondents to videos showing the same care. Our findings suggest that the lower scores reported by Pakistani patients in national surveys represent genuinely worse experiences of communication compared to the White British majority.This work was funded by the National Institute for Health Research Programme Grants for Applied Research (NIHR PGfAR) Programme (RP-PG-0608-10050).