General practitioners' evaluation of community psychiatric services: responsiveness to change of the General Practitioner Experiences Questionnaire (GPEQ)

<p>Abstract</p> <p>Background</p> <p>Instruments have been developed to assess professional views of the quality of care but have rarely been tested for responsiveness to change. The objective of this study was to test the responsiveness of the General Practitioner Experiences Questionnaire (GPEQ) for the measurement of Community Mental Health Centres in Norway.</p> <p>Methods</p> <p>National surveys were conducted in Norway in 2006 (n = 2,415) and 2008 (n = 2,209) to measure general practitioners' evaluation of community mental health centres. GPs evaluated the centres by means of a postal questionnaire, consisting of questions focused on centre quality and cooperation with GPs. As part of the national surveys 75 GPs in 2006 and 66 GPs in 2008 evaluated Hamar community mental health centre. Between the surveys, several quality improvement initiatives were implemented which were directed at cooperation with and guidance for GPs in Stange municipality, one of eight municipalities in Hamar centre catchment area. The main outcome measures were changes in GPEQ scores from 2006 to 2008 for GPs evaluating Hamar community mental health centre from Stange municipality, and changes in scores for GPs in the other seven municipalities and nationally which were assessed for statistical significance.</p> <p>Results</p> <p>GPs in Stange municipality rated Hamar community mental health centre significantly better on the guidance scale in 2008 than in 2006; on a 0-100 scale where 100 represents the best possible experiences the score was 26.5 in 2006 and 58.3 in 2008 (p < 0.001). Apart from one item about workforce situation, none of the other scales and items showed significant changes. The control group from the other seven municipalities gave significantly poorer rating for the emergency situation scale, the workforce situation scale and seven items in 2008 than in 2006. The national results showed small differences between 2006 and 2008, even though several scales and items were significantly different. A question about changes in centre performance over the last 2-3 years showed that 82% of GPs from Stange municipality reported that Hamar community mental health centre had improved, compared to only 36% from the other seven municipalities and 40% nationally which was statistically significant.</p> <p>Conclusions</p> <p>Following the implementation of an initiative designed to enhance service quality, the GPEQ identified expected changes in the guidance scale for the intervention group, indicating that the instrument is responsive to change. The worsening of services for GPs in the control group evaluating Hamar centre warrants further study.</p

The association between demographic factors, user reported experiences and user satisfaction: results from three casualty clinics in Norway

<p>Abstract</p> <p>Background</p> <p>User reported experiences and satisfaction are increasingly used as basis for quality indicators in the health sector. However, there is limited understanding of factors associated with user reported experiences and satisfaction with casualty clinics.</p> <p>Methods</p> <p>A random sample of 542 patients that had contacted any of three casualty clinics from mid April to mid May 2008 was mailed a questionnaire. A reminder was sent to non-respondents after six weeks. Descriptive statistics for four user reported experiences scales and 20 single items are presented. Multivariate regression analysis was used to assess associations between background variables and user reported experiences, and between user reported experiences and user satisfaction.</p> <p>Results</p> <p>225 (41.5%) patients, carers and guardians returned a completed questionnaire. Users reported most positive experiences with the doctor services and the nursing services at the casualty clinics; on a scale from 0 to 100, where 100 is the best possible experience the doctor scale was 82 and the nursing scale 81. Users reported least positive experiences with the organization of the casualty clinic, with a scale score of 65. Self perceived health was associated with user satisfaction, while self perceived health and age were associated with user reported experiences with organization of the clinics. A range of user reported experience domains were related to user satisfaction, after controlling for socio-demographic variables, including experiences with doctor services at the clinics, organization of the clinics, information and self perceived incorrect treatment.</p> <p>Conclusions</p> <p>Users report positive experiences with the three casualty clinics, with organization as the aspect with largest improvement potential. The importance of age and health status for users' experiences and satisfaction with casualty clinics was shown, but a range of user reported experiences with the clinics were the most important predictors for user satisfaction.</p

The association between survey timing and patient-reported experiences with hospitals: results of a national postal survey

<p>Abstract</p> <p>Background</p> <p>Research on the effect of survey timing on patient-reported experiences and patient satisfaction with health services has produced contradictory results. The objective of this study was thus to assess the association between survey timing and patient-reported experiences with hospitals.</p> <p>Methods</p> <p>Secondary analyses of a national inpatient experience survey including 63 hospitals in the 5 health regions in Norway during the autumn of 2006. 10,912 (45%) patients answered a postal questionnaire after their discharge from hospital. Non-respondents were sent a reminder after 4 weeks. Multilevel linear regression analysis was used to assess the association between survey timing and patient-reported experiences, both bivariate analysis and multivariate analysis controlling for other predictors of patient experiences.</p> <p>Results</p> <p>Multivariate multilevel regression analysis revealed that survey time was significantly and negatively related to three of six patient-reported experience scales: doctor services (Beta = -0.424, <it>p</it>< 0.05), information about examinations (Beta = -0.566, <it>p </it>< 0.05) and organization (Beta = -0.528, <it>p </it>< 0.05). Patient age, self-perceived health and type of admission were significantly related to all patient-reported experience scales (better experiences with higher age, better health and routine admission), and all other predictors had at least one significant association with patient-reported experiences.</p> <p>Conclusions</p> <p>Survey time was significantly and negatively related to three of the six scales for patient-reported experiences with hospitals. Large differences in survey time across hospitals could be problematic for between-hospital comparisons, implying that survey time should be considered as a potential adjustment factor. More research is needed on this topic, including studies with other population groups, other data collection modes and a longer time span.</p

Non-response in a survey of physicians on end-of-life care for the elderly

<p>Abstract</p> <p>Background</p> <p>Physicians are quite often surveyed with the aim to investigate their opinions regarding provision and improvement of health care. However, in many cases response rates tend to be rather low. The aim of the study is to reflect methodological aspects regarding survey conduction and to analyse factors that cause physicians to take part in a study on delivering end-of-life care for the elderly.</p> <p>Methods</p> <p>N = 4,727 physicians in Lower Saxony, Germany, received a standardised questionnaire on their attitudes about end-of-life care for the elderly. Non-responders were asked to state the reasons for non-participation. Comparison of the sociodemographic characteristics between responders and non-responders, and evaluation of the reasons for non-participation were made.</p> <p>Results</p> <p>The response rate to the questionnaire on end-of-life care for the elderly was 40% (n = 1,892). Of the non-responders to the questionnaire, 12.8% (n = 364) stated the reasons for non-participation. Overall, the response rate to the questionnaire varied with specialty and location of the practice: radiotherapists answered significantly more frequently than other categories of physician (e.g. general practitioners) and physicians in rural areas significantly more frequently than their colleagues in urban areas. The reasons most frequently given for non-participation were "Not concerned with the subject" and "No time".</p> <p>Conclusions</p> <p>The varying rates of response indicate that the survey was not sufficiently relevant to all groups of physicians, or that the awareness of the topic may be partly underdeveloped.</p

It takes patience and persistence to get negative feedback about patients’ experiences: a secondary analysis of national inpatient survey data

Background: Patient experience surveys are increasingly used to gain information about the quality of healthcare. This paper investigates whether patients who respond before and after reminders to a large national survey of inpatient experience differ in systematic ways in how they evaluate the care they received. Methods: The English national inpatient survey of 2009 obtained data from just under 70,000 patients. We used ordinal logistic regression to analyse their evaluations of the quality of their care in relation to whether or not they had received a reminder before they responded. Results: 33% of patients responded after the first questionnaire, a further 9% after the first reminder, and a further 10% after the second reminder. Evaluations were less positive among people who responded only after a reminder and lower still among those who needed a second reminder. Conclusions: Quality improvement efforts depend on having accurate data and negative evaluations of care received in healthcare settings are particularly valuable. This study shows that there is a relationship between the time taken to respond and patients’ evaluations of the care they received, with early responders being more likely to give positive evaluations. This suggests that bias towards positive evaluations could be introduced if the time allowed for patients to respond is truncated or if reminders are omitted

A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors

<p>Abstract</p> <p>Background</p> <p>Surveys of doctors are an important data collection method in health services research. Ways to improve response rates, minimise survey response bias and item non-response, within a given budget, have not previously been addressed in the same study. The aim of this paper is to compare the effects and costs of three different modes of survey administration in a national survey of doctors.</p> <p>Methods</p> <p>A stratified random sample of 4.9% (2,702/54,160) of doctors undertaking clinical practice was drawn from a national directory of all doctors in Australia. Stratification was by four doctor types: general practitioners, specialists, specialists-in-training, and hospital non-specialists, and by six rural/remote categories. A three-arm parallel trial design with equal randomisation across arms was used. Doctors were randomly allocated to: online questionnaire (902); simultaneous mixed mode (a paper questionnaire and login details sent together) (900); or, sequential mixed mode (online followed by a paper questionnaire with the reminder) (900). Analysis was by intention to treat, as within each primary mode, doctors could choose either paper or online. Primary outcome measures were response rate, survey response bias, item non-response, and cost.</p> <p>Results</p> <p>The online mode had a response rate 12.95%, followed by the simultaneous mixed mode with 19.7%, and the sequential mixed mode with 20.7%. After adjusting for observed differences between the groups, the online mode had a 7 percentage point lower response rate compared to the simultaneous mixed mode, and a 7.7 percentage point lower response rate compared to sequential mixed mode. The difference in response rate between the sequential and simultaneous modes was not statistically significant. Both mixed modes showed evidence of response bias, whilst the characteristics of online respondents were similar to the population. However, the online mode had a higher rate of item non-response compared to both mixed modes. The total cost of the online survey was 38% lower than simultaneous mixed mode and 22% lower than sequential mixed mode. The cost of the sequential mixed mode was 14% lower than simultaneous mixed mode. Compared to the online mode, the sequential mixed mode was the most cost-effective, although exhibiting some evidence of response bias.</p> <p>Conclusions</p> <p>Decisions on which survey mode to use depend on response rates, response bias, item non-response and costs. The sequential mixed mode appears to be the most cost-effective mode of survey administration for surveys of the population of doctors, if one is prepared to accept a degree of response bias. Online surveys are not yet suitable to be used exclusively for surveys of the doctor population.</p

Magnetic resonance enterography, small bowel ultrasound and colonoscopy to diagnose and stage Crohn’s disease; patient acceptability, and perceived burden

Objectives: To compare patient acceptability and burden of magnetic resonance enterography (MRE) and ultrasound (US) to each other, and to other enteric investigations, particularly colonoscopy. Methods: 159 patients (mean age 38, 94 female) with newly diagnosed or relapsing Crohn’s disease, prospectively recruited to a multicentre diagnostic accuracy study comparing MRE and US, completed an experience questionnaire on the burden and acceptability of small bowel investigations between December 2013 and September 2016. Acceptability, recovery time, scan burden and willingness to repeat the test were analysed using the Wilcoxon signed rank and McNemar tests; and group differences in scan burden with Mann-Whitney U and Kruskal-Wallis tests. Results: Overall, 128 (88%) patients rated MRE as very or fairly acceptable, lower than US (144, 99%; p<0.001), but greater than colonoscopy (60, 60%; p<0.001). MRE recovery time was longer than US (p<0.001), but shorter than colonoscopy (p<0.001). Patients were less willing to undergo MRE again than US (127 vs 133, 91% vs. 99%; p=0.012), but more willing than for colonoscopy (68, 75%; p=0.017). MRE generated greater burden than US (p<0.001), although burden scores were low. Younger age and emotional distress were associated with greater MRE and US burden. Higher MRE discomfort was associated with patient preference for US (p=0.053). Patients rated test accuracy as more important than scan discomfort. Conclusions.: MRE and US are well tolerated. Although MRE generates greater burden, longer recovery, and is less preferred than US, it is more acceptable than colonoscopy. Patients however place greater emphasis on diagnostic accuracy than burden