Evaluation of different recall periods for the US National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Aims—The U.S. National Cancer Institute recently developed the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). PRO-CTCAE is a library of questions for clinical trial participants to self-report symptomatic adverse events (e.g., nausea). The objective of this study is to inform evidence-based selection of a recall period when PRO-CTCAE is included in a trial. We evaluated differences between 1-week, 2-week, 3-week, and 4-week recall periods, using daily reporting as the reference. Methods—English-speaking patients with cancer receiving chemotherapy and/or radiotherapy were enrolled at four U.S. cancer centers and affiliated community clinics. Participants completed 27 PRO-CTCAE items electronically daily for 28 days, and then weekly over 4 weeks, using 1-week, 2-week, 3-week, and 4-week recall periods. For each recall period, mean differences, effect sizes, and intraclass correlation coefficients were calculated to evaluate agreement between the maximum of daily ratings and the corresponding ratings obtained using longer recall periods (e.g., maximum of daily scores over 7 days vs. 1-week recall). Analyses were repeated using the average of daily scores within each recall period rather than the maximum of daily scores. Results—127 subjects completed questionnaires (57% male; median age 57). The median of the 27 mean differences in scores on the PRO-CTCAE 5-point response scale comparing the maximum daily versus the longer recall period (and corresponding effect size), was −0.20 (−0.20) for 1-week recall; −0.36 (−0.31) for 2-week recall; −0.45 (−0.39) for 3-week recall; and −0.47 (−0.40) for 4-week recall. The median intraclass correlation across 27 items between the maximum of daily ratings and the corresponding longer recall ratings for 1-week recall was 0.70 (range: 0.54–0.82); 2-week recall: 0.74 (range: 0.58–0.83); 3-week recall: 0.72 (range: 0.61–0.84); and 4-week recall: 0.72 (range: 0.64–0.86). Similar results were observed for all analyses using the average of daily scores rather than the maximum of daily scores. Conclusions—1-week recall corresponds best to daily reporting. Although intraclass correlations remain stable over time, there are small but progressively larger differences between daily and longer recall periods at 2, 3, and 4 weeks, respectively. The preferred recall period for the PRO-CTCAE is the past 7 days, although investigators may opt for recall periods of 2, 3, or 4 weeks with an understanding that there may be some information loss

Feasibility of Patient Reporting of Symptomatic Adverse Events via the Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PROCTCAE) in a Chemoradiotherapy Cooperative Group Multicenter Clinical Trial

Purpose—To assess the feasibility of measuring symptomatic adverse events (AEs) in a multicenter clinical trial using the National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). Methods and Materials—Patients enrolled in Trial XXXX (XXXX) were asked to self-report 53 PRO-CTCAE items representing 30 symptomatic AEs at 6 time points (baseline; weekly x4 during treatment; 12-weeks post-treatment). Reporting was conducted via wireless tablet computers in clinic waiting areas. Compliance was defined as the proportion of visits when an expected PRO-CTCAE assessment was completed. Results—Among 226 study sites participating in Trial XXXX, 100% completed 35-minute PROCTCAE training for clinical research associates (CRAs); 80 sites enrolled patients of which 34 (43%) required tablet computers to be provided. All 152 patients in Trial XXXX agreed to selfreport using the PRO-CTCAE (median age 66; 47% female; 84% white). Median time for CRAs to learn the system was 60 minutes (range 30–240), and median time for CRAs to teach a patient to self-report was 10 minutes (range 2–60). Compliance was high, particularly during active treatment when patients self-reported at 86% of expected time points, although compliance was lower post-treatment (72%). Common reasons for non-compliance were institutional errors such as forgetting to provide computers to participants; patients missing clinic visits; internet connectivity; and patients feeling “too sick”. Conclusions—Most patients enrolled in a multicenter chemoradiotherapy trial were willing and able to self-report symptomatic adverse events at visits using tablet computers. Minimal effort was required by local site staff to support this system. The observed causes of missing data may be obviated by allowing patients to self-report electronically between-visits, and by employing central compliance monitoring. These approaches are being incorporated into ongoing studies

Mode equivalence and acceptability of tablet computer-, interactive voice response system-, and paper-based administration of the U.S. National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Abstract Background PRO-CTCAE is a library of items that measure cancer treatment-related symptomatic adverse events (NCI Contracts: HHSN261201000043C and HHSN 261201000063C). The objective of this study is to examine the equivalence and acceptability of the three data collection modes (Web-enabled touchscreen tablet computer, Interactive voice response system [IVRS], and paper) available within the US National Cancer Institute (NCI) Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) measurement system. Methods Participants (n = 112; median age 56.5; 24 % high school or less) receiving treatment for cancer at seven US sites completed 28 PRO-CTCAE items (scoring range 0–4) by three modes (order randomized) at a single study visit. Subjects completed one page (approx. 15 items) of the EORTC QLQ-C30 between each mode as a distractor. Item scores by mode were compared using intraclass correlation coefficients (ICC); differences in scores within the 3-mode crossover design were evaluated with mixed-effects models. Difficulties with each mode experienced by participants were also assessed. Results 103 (92 %) completed questionnaires by all three modes. The median ICC comparing tablet vs IVRS was 0.78 (range 0.55–0.90); tablet vs paper: 0.81 (0.62–0.96); IVRS vs paper: 0.78 (0.60–0.91); 89 % of ICCs were ≥0.70. Item-level mean differences by mode were small (medians [ranges] for tablet vs. IVRS = −0.04 [−0.16–0.22]; tablet vs paper = −0.02 [−0.11–0.14]; IVRS vs paper = 0.02 [−0.07–0.19]), and 57/81 (70 %) items had bootstrapped 95 % CI around the effect sizes within +/−0.20. The median time to complete the questionnaire by tablet was 3.4 min; IVRS: 5.8; paper: 4.0. The proportion of participants by mode who reported “no problems” responding to the questionnaire was 86 % tablet, 72 % IVRS, and 98 % paper. Conclusions Mode equivalence of items was moderate to high, and comparable to test-retest reliability (median ICC = 0.80). Each mode was acceptable to a majority of respondents. Although the study was powered to detect moderate or larger discrepancies between modes, the observed ICCs and very small mean differences between modes provide evidence to support study designs that are responsive to patient or investigator preference for mode of administration, and justify comparison of results and pooled analyses across studies that employ different PRO-CTCAE modes of administration. Trial registration NCT Clinicaltrials.gov identifier: NCT0215863

Mode equivalence and acceptability of tablet computer-, interactive voice response system-, and paper-based administration of the U.S. National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Background PRO-CTCAE is a library of items that measure cancer treatment-related symptomatic adverse events (NCI Contracts: HHSN261201000043C and HHSN 261201000063C). The objective of this study is to examine the equivalence and acceptability of the three data collection modes (Web-enabled touchscreen tablet computer, Interactive voice response system [IVRS], and paper) available within the US National Cancer Institute (NCI) Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) measurement system. Methods Participants (n = 112; median age 56.5; 24 % high school or less) receiving treatment for cancer at seven US sites completed 28 PRO-CTCAE items (scoring range 0–4) by three modes (order randomized) at a single study visit. Subjects completed one page (approx. 15 items) of the EORTC QLQ-C30 between each mode as a distractor. Item scores by mode were compared using intraclass correlation coefficients (ICC); differences in scores within the 3-mode crossover design were evaluated with mixed-effects models. Difficulties with each mode experienced by participants were also assessed. Results 103 (92 %) completed questionnaires by all three modes. The median ICC comparing tablet vs IVRS was 0.78 (range 0.55–0.90); tablet vs paper: 0.81 (0.62–0.96); IVRS vs paper: 0.78 (0.60–0.91); 89 % of ICCs were ≥0.70. Item-level mean differences by mode were small (medians [ranges] for tablet vs. IVRS = −0.04 [−0.16–0.22]; tablet vs paper = −0.02 [−0.11–0.14]; IVRS vs paper = 0.02 [−0.07–0.19]), and 57/81 (70 %) items had bootstrapped 95 % CI around the effect sizes within +/−0.20. The median time to complete the questionnaire by tablet was 3.4 min; IVRS: 5.8; paper: 4.0. The proportion of participants by mode who reported “no problems” responding to the questionnaire was 86 % tablet, 72 % IVRS, and 98 % paper. Conclusions Mode equivalence of items was moderate to high, and comparable to test-retest reliability (median ICC = 0.80). Each mode was acceptable to a majority of respondents. Although the study was powered to detect moderate or larger discrepancies between modes, the observed ICCs and very small mean differences between modes provide evidence to support study designs that are responsive to patient or investigator preference for mode of administration, and justify comparison of results and pooled analyses across studies that employ different PRO-CTCAE modes of administration. Trial registration NCT Clinicaltrials.gov identifier: NCT0215863

Cognitive interviewing of the US National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

The National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) is a library of question items that enables patient reporting of adverse events (AEs) in clinical trials. This study contributes content validity evidence of the PRO-CTCAE by incorporating cancer patient input of the relevance and comprehensiveness of the item library

Uneven focal shoe deterioration in Tourette syndrome.

A 31-year-old single man (AB) sought neuropsychiatric consultation for treatment-resistant motor and vocal tics. He described himself expressing a total of 24 different tics, mainly facial twitches (eye blinking, raising eyebrows, mouth opening, lips licking, stereotyped grimacing) and inappropriate utterances (grunting, throat clearing, sniffing), since the age of 7. There appeared to be no family history of tic disorder. He reported occasional utterance of swear words in contextually inappropriate situations (coprolalia), and the urge to copy other people’s movements (echopraxia). Other tic-associated symptoms included self-injurious behaviours and forced touching of objects. A.B. met both DSM-IV-tr and ICD-10 criteria for Tourette syndrome, and also DSM-IV-tr criteria for attention deficit hyperactivity disorder (combined type) in childhood

Stakeholder perspectives on implementing the National Cancer Institute’s patient-reported outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

The National Cancer Institute (NCI) is developing a patient-reported version of its Common Terminology Criteria for Adverse Events, called the "PRO-CTCAE." The PRO-CTCAE consists of a library of patient-reported items which can be administered in clinical trials to directly capture the patient experience of adverse events during cancer treatment, as well as a software platform for administering these items via computer or telephone. In order to better understand the impressions of stakeholders involved in cancer clinical research about the potential value of the PRO-CTCAE approach to capturing adverse event information in clinical research, as well as their perspectives about barriers and strategies for implementing the PRO-CTCAE in NCI-sponsored cancer trials, a survey was conducted. A survey including structured and open-ended questions was developed to elicit perceptions about the use of patient-reported outcomes (PROs) for adverse event reporting, and to explore logistical considerations for implementing the PRO-CTCAE in cancer trials. The survey was distributed electronically and by paper to a convenience sample of leadership and committee members in the NCI's cooperative group network, including principal investigators, clinical investigators, research nurses, data managers, patient advocates, and representatives of the NCI and Food and Drug Administration. Between October, 2008 through February, 2009, 727 surveys were collected. Most respondents (93%) agreed that patient reporting of adverse symptoms would be useful for improving understanding of the patient experience with treatment in cancer trials, and 88%, 80%, and 76%, respectively, endorsed that administration of PRO-CTCAE items in clinical trials would improve the completeness, accuracy, and efficiency of symptom data collection. More than three fourths believed that patient reports would be useful for informing treatment dose modifications and towards FDA regulatory evaluation of drugs. Eighty-eight percent felt that patients in clinical trials would be willing to self-report adverse symptoms at clinic visits via computer, and 68% felt patients would self-report weekly from home via the internet or an automated telephone system. Lack of computers and limited space and personnel were seen as potential barriers to in-clinic self-reporting, but these were judged to be surmountable with adequate funding. The PRO-CTCAE items and software are viewed by a majority of survey respondents as a means to improve adverse event data quality and comprehensiveness, enhance clinical decision-making, and foster patient-clinician communication. Research is ongoing to assess the measurement properties and feasibility of implementing this measure in cancer clinical trials

Validity and Reliability of the US National Cancer Institute’s Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Symptomatic adverse events (AEs) in cancer trials are currently reported by clinicians using the National Cancer Institute's (NCI) Common Terminology Criteria for Adverse Events (CTCAE). To integrate the patient perspective, the NCI developed a patient-reported outcomes version of the CTCAE (PRO-CTCAE) to capture symptomatic AEs directly from patients