Can user testing of a clinical trial patient information sheet make it fit-for-purpose? - a randomized controlled trial

Background: The participant information sheet (PIS) provided to potential trial participants is a critical part of the process of valid consent. However, there is long-standing concern that these lengthy and complex documents are not fit-for-purpose. This has been supported recently through the application of a performance-based approach to testing and improving readability called user testing. This method is now widely used to improve patient medicine leaflets - determining whether people can find and understand key facts. This study applied for the first time a controlled design to determine whether a PIS developed through user testing had improved readability over the original, using a sheet from a UK trial in acute myeloid leukemia (AML16). Methods: In the first phase the performance of the original PIS was tested on people in the target group for the trial. There were three rounds of testing including 50 people in total - with the information revised according to its performance after each of the first 2 rounds. In the second phase, the revised PIS was compared with the original in a parallel groups randomised controlled trial (RCT) A total of 123 participants were recruited and randomly allocated to read one version of the PIS to find and show understanding of 21 key facts. Results: The first, developmental phase produced a revised PIS significantly altered in its wording and layout. In the second, trial phase 66% of participants who read the revised PIS were able to show understanding of all aspects of the trial, compared with 15% of those reading the original version (Odds Ratio 11.2; Chi-square = 31.5 p < .001). When asked to state a preference, 87.1% participants chose the revised PIS (Sign test p < .001). Conclusions: The original PIS for the AML16 trial may not have enabled valid consent. Combining performance-based user testing with expertise in writing for patients and information design led to a significantly improved and preferred information sheet. User testing is an efficient method for indicating strengths and weaknesses in trial information, and Research Ethics Committees and Institutional Review Boards should consider requesting such testing, to ensure that PIS are fit-for-purpose

Selecting short-statured children needing growth hormone testing: Derivation and validation of a clinical decision rule

<p>Abstract</p> <p>Background</p> <p>Numerous short-statured children are evaluated for growth hormone (GH) deficiency (GHD). In most patients, GH provocative tests are normal and are thus in retrospect unnecessary.</p> <p>Methods</p> <p>A retrospective cohort study was conducted to identify predictors of growth hormone (GH) deficiency (GHD) in children seen for short stature, and to construct a very sensitive and fairly specific predictive tool to avoid unnecessary GH provocative tests. GHD was defined by the presence of 2 GH concentration peaks < 10 ng/ml. Certain GHD was defined as GHD and viewing pituitary stalk interruption syndrome on magnetic resonance imaging. Independent predictors were identified with uni- and multi-variate analyses and then combined in a decision rule that was validated in another population.</p> <p>Results</p> <p>The initial study included 167 patients, 36 (22%) of whom had GHD, including 5 (3%) with certain GHD. Independent predictors of GHD were: growth rate < -1 DS (adjusted odds ratio: 3.2; 95% confidence interval [1.3–7.9]), IGF-I concentration < -2 DS (2.8 [1.1–7.3]) and BMI z-score ≥ 0 (2.8 [1.2–6.5]). A clinical decision rule suggesting that patients be tested only if they had a growth rate < -1 DS and a IGF-I concentration < -2 DS achieved 100% sensitivity [48–100] for certain GHD and 63% [47–79] for GHD, and a specificity of 68% [60–76]. Applying this rule to the validation population (n = 40, including 13 patients with certain GHD), the sensitivity for certain GHD was 92% [76–100] and the specificity 70% [53–88].</p> <p>Conclusion</p> <p>We have derived and performed an internal validation of a highly sensitive decision rule that could safely help to avoid more than 2/3 of the unnecessary GH tests. External validation of this rule is needed before any application.</p

Credible knowledge: A pilot evaluation of a modified GRADE method using parent-implemented interventions for children with autism

Abstract Background Decision-making in child and youth mental health (CYMH) care requires recommendations that are developed through an efficient and effective method and are based on credible knowledge. Credible knowledge is informed by two sources: scientific evidence, and practice-based evidence, that reflects the "real world" experience of service providers. Current approaches to developing these recommendations in relation to CYMH will typically include evidence from one source or the other but do not have an objective method to combine the two. To this end, a modified version of the Grading Recommendations Assessment, Development and Evaluation (GRADE) approach was pilot-tested, a novel method for the CYMH field. Methods GRADE has an explicit methodology that relies on input from scientific evidence as well as a panel of experts. The panel established the quality of evidence and derived detailed recommendations regarding the organization and delivery of mental health care for children and youth or their caregivers. In this study a modified GRADE method was used to provide precise recommendations based on a specific CYMH question (i.e. What is the current credible knowledge concerning the effects of parent-implemented, early intervention with their autistic children?). Results Overall, it appeared that early, parent-implemented interventions for autism result in positive effects that outweigh any undesirable effects. However, as opposed to overall recommendations, the heterogeneity of the evidence required that recommendations be specific to particular interventions, based on the questions of whether the benefits of a particular intervention outweighs its harms. Conclusions This pilot project provided evidence that a modified GRADE method may be an effective and practical approach to making recommendations in CYMH, based on credible knowledge. Key strengths of the process included separating the assessments of the quality of the evidence and the strength of recommendations, transparency in decision-making, and the objectivity of the methods. Most importantly, this method combined the evidence and clinical experience in a more timely, explicit and simple process as compared to previous approaches. The strengths, limitations and modifications of the approach as they pertain to CYMH, are discussed