Trustworthiness of patient-reported outcomes in unblinded cancer clinical trials

There is substantial and growing interest in measuring patient-reported outcomes in drug development trials, for example, to understand the effects of treatment on tumor-associated pain. Although there is enthusiasm at the US Food and Drug Administration (FDA) for such a patient-centered approach, evidenced by guidance for industry published on this topic in 2009, most oncology trials and FDA-approved medication labels still do not include information on patient-reported outcomes

Clinician vs Patient Reporting of Baseline and Postbaseline Symptoms for Adverse Event Assessment in Cancer Clinical Trials

Many patients enter cancer clinical trials with baseline symptoms. Notably, the current clinician reporting mechanism for symptomatic adverse events (AEs) via the Common Terminology Criteria for Adverse Events (CTCAE) does not formally distinguish between symptoms present at baseline vs those that develop during a trial. Therefore, AE estimation in clinical trials may include symptoms that predate trial entry. This raises concern that the cumulative incidence of patient-reported AEs may be high, particularly if preexisting symptoms related to other causes (eg, comorbidities, prior treatment) are attributed to study drugs

The brief pain inventory and its "pain at its worst in the last 24 hours" item: Clinical trial endpoint considerations

Context: In 2006, the United States Food and Drug Administration (FDA) released a draft Guidance for Industry on the use of patient-reported outcomes (PRO) Measures in Medical Product Development to Support Labeling Claims. This draft guidance outlines psychometric aspects that should be considered when designing a PRO measure, including conceptual framework, content validity, construct validity, reliability, and the ability to detect clinically meaningful score changes. When finalized, it may provide a blueprint for evaluations of PRO measures that can be considered by sponsors and investigators involved in PRO research and drug registration trials. Objective: In this review we examine the short form of the Brief Pain Inventory (BPI) and particularly the " pain at its worst in the last 24 hours" item in the context of the FDA draft guidance, to assess its utility in clinical trials that include pain as a PRO endpoint. Results and Conclusions: After a systematic evaluation of the psychometric aspects of the BPI, we conclude that the BPI and its " pain at its worst in the last 24 hours" item generically satisfy most key recommendations outlined in the draft guidance for assessing a pain-reduction treatment effect. Nonetheless, when the BPI is being considered for assessment of pain endpoints in a registration trial, sponsors and investigators should consult with the appropriate FDA division early during research design to discuss whether there is sufficient precedent to use the instrument in the population of interest or whether additional evaluations of measurement properties are advisable

What Do “None,” “Mild,” “Moderate,” “Severe,” and “Very Severe” Mean to Patients With Cancer? Content Validity of PRO-CTCAE™ Response Scales

Accurate capture of the symptom experience is essential to gauging efficacy, safety, and tolerability of cancer treatments. The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) was developed by the National Cancer Institute to allow direct patient self-reporting of symptomatic adverse events in cancer clinical trials. Its content validity has been established in accordance with recommended practices for novel patient-reported outcome (PRO) instruments

Bregman Voronoi Diagrams: Properties, Algorithms and Applications

The Voronoi diagram of a finite set of objects is a fundamental geometric structure that subdivides the embedding space into regions, each region consisting of the points that are closer to a given object than to the others. We may define many variants of Voronoi diagrams depending on the class of objects, the distance functions and the embedding space. In this paper, we investigate a framework for defining and building Voronoi diagrams for a broad class of distance functions called Bregman divergences. Bregman divergences include not only the traditional (squared) Euclidean distance but also various divergence measures based on entropic functions. Accordingly, Bregman Voronoi diagrams allow to define information-theoretic Voronoi diagrams in statistical parametric spaces based on the relative entropy of distributions. We define several types of Bregman diagrams, establish correspondences between those diagrams (using the Legendre transformation), and show how to compute them efficiently. We also introduce extensions of these diagrams, e.g. k-order and k-bag Bregman Voronoi diagrams, and introduce Bregman triangulations of a set of points and their connexion with Bregman Voronoi diagrams. We show that these triangulations capture many of the properties of the celebrated Delaunay triangulation. Finally, we give some applications of Bregman Voronoi diagrams which are of interest in the context of computational geometry and machine learning.Comment: Extend the proceedings abstract of SODA 2007 (46 pages, 15 figures

Composite grading algorithm for the National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Background: The Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events is an item library designed for eliciting patient-reported adverse events in oncology. For each adverse event, up to three individual items are scored for frequency, severity, and interference with daily activities. To align the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events with other standardized tools for adverse event assessment including the Common Terminology Criteria for Adverse Events, an algorithm for mapping individual items for any given adverse event to a single composite numerical grade was developed and tested. Methods: A five-step process was used: (1) All 179 possible Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events score combinations were presented to 20 clinical investigators to subjectively map combinations to single numerical grades ranging from 0 to 3. (2) Combinations with <75% agreement were presented to investigator committees at a National Clinical Trials Network cooperative group meeting to gain majority consensus via anonymous voting. (3) The resulting algorithm was refined via graphical and tabular approaches to assure directional consistency. (4) Validity, reliability, and sensitivity were assessed in a national study dataset. (5) Accuracy for delineating adverse events between study arms was measured in two Phase III clinical trials (NCT02066181 and NCT01522443). Results: In Step 1, 12/179 score combinations had <75% initial agreement. In Step 2, majority consensus was reached for all combinations. In Step 3, five grades were adjusted to assure directional consistency. In Steps 4 and 5, composite grades performed well and comparably to individual item scores on validity, reliability, sensitivity, and between-arm delineation. Conclusion: A composite grading algorithm has been developed and yields single numerical grades for adverse events assessed via the Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events, and can be useful in analyses and reporting

Clinical risk factors of colorectal cancer in patients with serrated polyposis syndrome: A multicentre cohort analysis

Objective Serrated polyposis syndrome (SPS) is accompanied by an increased risk of colorectal cancer (CRC). Patients fulfilling the clinical criteria, as defined by the WHO, have a wide variation in CRC risk. We aimed to assess risk factors for CRC in a large cohort of patients with SPS and to evaluate the risk of CRC during surveillance. Design In this retrospective cohort analysis, all patients with SPS from seven centres in the Netherlands and two in the UK were enrolled. WHO criteria were used to diagnose SPS. Patients who only fulfilled WHO criterion-2, with IBD and/or a known hereditary CRC syndrome were excluded. Results In total, 434 patients with SPS were included for analysis; 127 (29.3%) were diagnosed with CRC. In a per-patient analysis =1 serrated polyp (SP) with dysplasia (OR 2.07; 95% CI 1.28 to 3.33), =1 advanced adenoma (OR 2.30; 95% CI 1.47 to 3.67) and the fulfilment of both WHO criteria 1 and 3 (OR 1.60; 95% CI 1.04 to 2.51) were associated with CRC, while a history of smoking was inversely associated with CRC (OR 0.36; 95% CI 0.23 to 0.56). Overall, 260 patients underwent surveillance after clearing of all relevant lesions, during which two patients were diagnosed with CRC, corresponding to 1.9 events/1000 person-years surveillance (95% CI 0.3 to 6.4). Conclusion The presence of SPs containing dysplasia, advanced adenomas and/or combined WHO criteria 1 and 3 phenotype is associated with CRC in patients with SPS. Patients with a history of smoking show a lower risk of CRC, possibly due to a different pathogenesis of disease. The risk of developing CRC during surveillance is lower than previously reported in literature, which may reflect a more mature multicentre cohort with less selection bias

Using confirmatory factor analysis to evaluate construct validity of the Brief Pain Inventory (BPI)

Context: The Brief Pain Inventory (BPI) is a frequently used instrument designed to assess the patient-reported outcome of pain. The majority of factor analytic studies have found a two-factor (i.e., pain intensity and pain interference) structure for this instrument; however, because the BPI was developed with an a priori hypothesis of the relationship among its items, it follows that construct validity investigations should use confirmatory factor analysis (CFA). Objectives: The purpose of this work was to establish the construct validity of the BPI using a CFA framework and demonstrate factorial invariance using a range of demographic variables. Methods: A retrospective CFA was completed in a sample of individuals diagnosed with HIV/AIDS and cancer (n = 364; 63% male; age 21-92 years, M = 51.80). A baseline one-factor model was compared against two-factor and three-factor models (i.e., pain intensity, activity interference, and affective interference) that were developed based on the hypothetical design of the instrument. Results: Fit indices for the three-factor model were statistically superior when compared with the one-factor model and marginally better when compared with the two-factor model. This three-factor structure was found to be invariant across disease, age, and ethnicity groups. Conclusion: The results of this study provide evidence to support a three-factor representation of the BPI, and the originally hypothesized two-factor structure. Such findings will begin to provide clinical trialists, pharmaceutical sponsors, and regulators with confidence in the psychometric properties of this instrument when considering its inclusion in clinical research

Reliability of adverse symptom event reporting by clinicians

Purpose Adverse symptom event reporting is vital as part of clinical trials and drug labeling to ensure patient safety and inform risk-benefit decision making. The purpose of this study was to assess the reliability of adverse event reporting of different clinicians for the same patient for the same visit. Methods A retrospective reliability analysis was completed for a sample of 393 cancer patients (42.8% men; age 26-91, M = 62.39) from lung (n = 134), prostate (n = 113), and Ob/Gyn (n = 146) clinics. These patients were each seen by two clinicians who independently rated seven Common Terminology Criteria for Adverse Events (CTCAE) symptoms. Twenty-three percent of patients were enrolled in therapeutic clinical trials. Results The average time between rater evaluations was 68 min. Intraclass correlation coefficients were moderate for constipation (0.50), diarrhea (0.58), dyspnea (0.69), fatigue (0.50), nausea (0.52), neuropathy (0.71), and vomiting (0.46). These values demonstrated stability over follow-up visits. Two-point differences, which would likely affect treatment decisions, were most frequently seen among symptomatic patients for constipation (18%), vomiting (15%), and nausea (8%). Conclusion Agreement between different clinicians when reporting adverse symptom events is moderate at best. Modification of approaches to adverse symptom reporting, such as patient self-reporting, should be considered

Utilizing image texture to detect land-cover change in Mediterranean coastal wetlands

Land-use/cover change dynamics were investigated in a Mediterranean coastal wetland. Change Vector Analysis (CVA) without and with image texture derived from the co-occurrence matrix and variogram were evaluated for detecting land-use/cover change. Three Landsat Thematic Mapper (TM) scenes recorded on July 1985, 1993 and 2005 were used, minimizing change detection error caused by seasonal differences. Images were geometrically, atmospherically and radiometrically corrected. CVA without and with texture measures were implemented and assessed using reference images generated by object-based supervised classification. These outputs were used for cross-classification to determine the ‘from–to’ change used to compare between techniques. The Landsat TM image bands together with the variogram yielded the most accurate change detection results, with Kappa statistics of 0.7619 and 0.7637 for the 1985–1993 and 1993–2005 image pairs, respectively