Test–retest stability of patient experience items derived from the national GP patient survey

PURPOSE: The validity and reliability of various items on the GP Patient Survey (GPPS) survey have been reported, however stability of patient responses over time has not been tested. The purpose of this study was to determine the test-retest reliability of the core items from the GPPS. METHODS: Patients who had recently consulted participating GPs in five general practices across the South West England were sent a postal questionnaire comprising of 54 items concerning their experience of their consultation and the care they received from the GP practice. Patients returning the questionnaire within 3 weeks of mail-out were sent a second identical (retest) questionnaire. Stability of responses was assessed by raw agreement rates and Cohen's kappa (for categorical response items) and intraclass correlation coefficients and means (for ordinal response items). RESULTS: 348 of 597 Patients returned a retest questionnaire (58.3 % response rate). In comparison to the test phase, patients responding to the retest phase were older and more likely to have white British ethnicity. Raw agreement rates for the 33 categorical items ranged from 66 to 100 % (mean 88 %) while the kappa coefficients ranged from 0.00 to 1.00 (mean 0.53). Intraclass correlation coefficients for the 21 ordinal items averaged 0.67 (range 0.44-0.77). CONCLUSIONS: Formal testing of items from the national GP patient survey examining patient experience in primary care highlighted their acceptable temporal stability several weeks following a GP consultation.Funding was provided by Health Services and Delivery Research Programme (Grant No. RP-PG-0608-10050)

A proposed method to investigate reliability throughout a questionnaire

<p>Abstract</p> <p>Background</p> <p>Questionnaires are used extensively in medical and health care research and depend on validity and reliability. However, participants may differ in interest and awareness throughout long questionnaires, which can affect reliability of their answers. A method is proposed for "screening" of systematic change in random error, which could assess changed reliability of answers.</p> <p>Methods</p> <p>A simulation study was conducted to explore whether systematic change in reliability, expressed as changed random error, could be assessed using unsupervised classification of subjects by cluster analysis (CA) and estimation of intraclass correlation coefficient (ICC). The method was also applied on a clinical dataset from 753 cardiac patients using the Jalowiec Coping Scale.</p> <p>Results</p> <p>The simulation study showed a relationship between the systematic change in random error throughout a questionnaire and the slope between the estimated ICC for subjects classified by CA and successive items in a questionnaire. This slope was proposed as an awareness measure - to assessing if respondents provide only a random answer or one based on a substantial cognitive effort. Scales from different factor structures of Jalowiec Coping Scale had different effect on this awareness measure.</p> <p>Conclusions</p> <p>Even though assumptions in the simulation study might be limited compared to real datasets, the approach is promising for assessing systematic change in reliability throughout long questionnaires. Results from a clinical dataset indicated that the awareness measure differed between scales.</p

Respiratory Syncytial Virus Vaccination during Pregnancy and Effects in Infants.

BACKGROUND: Respiratory syncytial virus (RSV) is the dominant cause of severe lower respiratory tract infection in infants, with the most severe cases concentrated among younger infants. METHODS: Healthy pregnant women, at 28 weeks 0 days through 36 weeks 0 days of gestation, with an expected delivery date near the start of the RSV season, were randomly assigned in an overall ratio of approximately 2:1 to receive a single intramuscular dose of RSV fusion (F) protein nanoparticle vaccine or placebo. Infants were followed for 180 days to assess outcomes related to lower respiratory tract infection and for 364 days to assess safety. The primary end point was RSV-associated, medically significant lower respiratory tract infection up to 90 days of life, and the primary analysis of vaccine efficacy against the primary end point was performed in the per-protocol population of infants (prespecified criterion for success, lower bound of the 97.52% confidence interval [CI] of ≥30%). RESULTS: A total of 4636 women underwent randomization, and there were 4579 live births. During the first 90 days of life, the percentage of infants with RSV-associated, medically significant lower respiratory tract infection was 1.5% in the vaccine group and 2.4% in the placebo group (vaccine efficacy, 39.4%; 97.52% CI, -1.0 to 63.7; 95% CI, 5.3 to 61.2). The corresponding percentages for RSV-associated lower respiratory tract infection with severe hypoxemia were 0.5% and 1.0% (vaccine efficacy, 48.3%; 95% CI, -8.2 to 75.3), and the percentages for hospitalization for RSV-associated lower respiratory tract infection were 2.1% and 3.7% (vaccine efficacy, 44.4%; 95% CI, 19.6 to 61.5). Local injection-site reactions among the women were more common with vaccine than with placebo (40.7% vs. 9.9%), but the percentages of participants who had other adverse events were similar in the two groups. CONCLUSIONS: RSV F protein nanoparticle vaccination in pregnant women did not meet the prespecified success criterion for efficacy against RSV-associated, medically significant lower respiratory tract infection in infants up to 90 days of life. The suggestion of a possible benefit with respect to other end-point events involving RSV-associated respiratory disease in infants warrants further study. (Funded by Novavax and the Bill and Melinda Gates Foundation; ClinicalTrials.gov NCT02624947.)

Antenatal magnesium individual participant data international collaboration: assessing the benefits for babies using the best level of evidence (AMICABLE)

BACKGROUND: The primary aim of this study is to assess, using individual participant data (IPD) meta-analysis, the effects of administration of antenatal magnesium sulphate given to women at risk of preterm birth on important clinical outcomes for their child such as death and neurosensory disability. The secondary aim is to determine whether treatment effects differ depending on important pre-specified participant and treatment characteristics, such as reasons at risk of preterm birth, gestational age, or type, dose and mode of administration of magnesium sulphate. METHODS: Design: The Antenatal Magnesium Individual Participant Data (IPD) International Collaboration: assessing the benefits for babies using the best level of evidence (AMICABLE) Group will perform an IPD meta-analysis to answer these important clinical questions. Setting/Timeline: The AMICABLE Group was formed in 2009 with data collection commencing late 2010. Inclusion Criteria: Five trials involving a total 6,145 babies are eligible for inclusion in the IPD meta-analysis. Primary study outcomes: For the infants/children: Death or cerebral palsy. For the women: Any severe maternal outcome potentially related to treatment (death, respiratory arrest or cardiac arrest). DISUCSSION: Results are expected to be publicly available in 2012.C.A. Crowther, P.F. Middleton, L.M. Askie, L.W. Doyle, T.K. Bubner and M. Voyse