Content Validity of Anatomic Site-Specific Patient-Reported Outcomes Version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) Item Sets for Assessment of Acute Symptomatic Toxicities in Radiation Oncology

Purpose: To improve assessment of symptomatic toxicity in cancer clinical trials and complement clinician-based toxicity reporting, the US National Cancer Institute developed a measurement system called the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE). The objective of this study was to examine the content validity of PRO-CTCAE in patients undergoing radiation therapy and to establish anatomic site-specific item sets for implementation in cancer research. Methods and Materials: Patients receiving radiation to the brain, head and neck, breast, thorax, abdomen, or pelvis were recruited during the final week of radiation. Participants described side effects qualitatively and completed anatomic site-specific checklists indicating the presence or absence of symptomatic toxicities drawn from the PRO-CTCAE library. Items endorsed by ≥20% of participants were selected for inclusion. Symptomatic toxicities described qualitatively were content analyzed and summarized. Symptomatic toxicities not reflected in the PRO-CTCAE item library were tabulated. Results: We conducted 389 interviews of patients receiving radiation to the brain (n = 46), head and neck (n = 69), breast (n = 134), thorax (n = 30), abdomen (n = 27), female pelvis (n = 36), or male pelvis (n = 47). Median age was 62 years; 62% were female. The 53 solicited PRO-CTCAE symptoms reflected all reported radiation-induced toxicities with the exception of phlegm/mucus production and mouth/throat pain with swallowing in patients receiving head and neck radiation, eye dryness/irritation in patients undergoing brain radiation, and obstructive urinary symptoms in men receiving pelvic radiation. The PRO-CTCAE items “skin burns” and “pain” require greater specificity to adequately reflect toxicities experienced during radiation. Conclusions: PRO-CTCAE demonstrates strong content validity as a measure of symptomatic toxicities in patients receiving radiation. These results provide empirical support for the definition of site-specific PRO-CTCAE item sets to assess the symptomatic toxicities of radiation therapy. The site-specific PRO-CTCAE item sets developed herein are currently being deployed in our department via an electronic platform to capture treatment-related toxicity

Composite grading algorithm for the National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Background: The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events is an item library designed for eliciting patient-reported adverse events in oncology. For each adverse event, up to three individual items are scored for frequency, severity, and interference with daily activities. To align the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events with other standardized tools for adverse event assessment including the Common Terminology Criteria for Adverse Events, an algorithm for mapping individual items for any given adverse event to a single composite numerical grade was developed and tested. Methods: A five-step process was used: (1) All 179 possible Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events score combinations were presented to 20 clinical investigators to subjectively map combinations to single numerical grades ranging from 0 to 3. (2) Combinations with <75% agreement were presented to investigator committees at a National Clinical Trials Network cooperative group meeting to gain majority consensus via anonymous voting. (3) The resulting algorithm was refined via graphical and tabular approaches to assure directional consistency. (4) Validity, reliability, and sensitivity were assessed in a national study dataset. (5) Accuracy for delineating adverse events between study arms was measured in two Phase III clinical trials (NCT02066181 and NCT01522443). Results: In Step 1, 12/179 score combinations had <75% initial agreement. In Step 2, majority consensus was reached for all combinations. In Step 3, five grades were adjusted to assure directional consistency. In Steps 4 and 5, composite grades performed well and comparably to individual item scores on validity, reliability, sensitivity, and between-arm delineation. Conclusion: A composite grading algorithm has been developed and yields single numerical grades for adverse events assessed via the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events, and can be useful in analyses and reporting

The controlled versus natural indexing languages debate revisited: a perspective on information retrieval practice and research

This article revisits the debate concerning con trolled and natural indexing languages, as used in searching the databases of the online hosts, in-house information retrieval systems, online public access catalogues and databases stored on CD-ROM. The debate was first formu lated in the early days of information retrieval more than a century ago but, despite significant advances in technology, remains unresolved. The article divides the history of the debate into four eras. Era one was characterised by the introduction of controlled vocabulary. Era two focused on comparisons between different indexing languages in order to assess which was best. Era three saw a number of case studies of limited generalisability and a general recognition that the best search performance can be achieved by the parallel use of the two types of indexing languages. The emphasis in Era four has been on the development of end-user-based systems, including online public access catalogues and databases on CD-ROM. Recent developments in the use of expert systems techniques to support the representation of meaning may lead to systems which offer significant support to the user in end-user searching. In the meantime, however, information retrieval in practice involves a mixture of natural and controlled indexing languages used to search a wide variety of different kinds of databases