Survey data

Individual-level data collected in the Part 2 survey

Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

Abstract Background We used various methods for identifying and prioritizing patient-centered outcomes (PCOs) for comparative effectiveness research (CER). Methods We considered potential PCOs (“benefits” and “harms”) related to (1) gabapentin for neuropathic pain and (2) quetiapine for bipolar depression. Part 1 (April 2014 to March 2015): we searched for PCO research and core outcome sets (COSs). We conducted electronic searches of bibliographic databases and key websites and examined FDA prescribing information and reports of clinical trials and systematic reviews. We asked patient and clinician co-investigators to identify PCOs. Part 2 (not part of our original study protocol): in 2015, we surveyed members of The TMJ Association, Ltd., a patient group associated with temporomandibular disorders (4130 invitations sent). Participants prioritized (1) the importance of six potential benefits and (2) 21 potential harms selected by the investigators in part 1, using stated preference methods. We calculated descriptive statistics. Results In part 1, we identified a COS for pain, the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) recommendations. The COS identified several important benefits, but it lacked specific recommendations about which potential harms to include in CER. We did not identify a COS for bipolar depression. Research reports, prescribing information, and patient co-investigators helped identify but not prioritize outcomes. We abandoned our electronic search for PCO research because we found it would be resource-intensive and yield few relevant reports. In part 2, surveying patients was useful for prioritizing PCOs. Members of The TMJ Association, Ltd., completed the survey (N = 746) and successfully prioritized both benefits and harms. Participants did not identify many benefits other than those we identified in part 1; several participants identified additional harms. Conclusions These exploratory results could inform future research about identifying and prioritizing PCOs. We found that stakeholder co-investigators and research reports contributed to identifying PCOs; surveying a patient group contributed to prioritizing PCOs. Prioritizing potential harms was particularly challenging because there are many more potential harms than potential benefits. Methods for identifying and prioritizing potential benefits for CER might not be appropriate for harms. Further research is needed to determine the generalizability of these results

Data from: Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

Background: We used various methods for identifying and prioritizing patient-centered outcomes (PCOs) for comparative effectiveness research (CER). Methods: We considered potential PCOs (“benefits” and “harms”) related to (1) gabapentin for neuropathic pain and (2) quetiapine for bipolar depression. Part 1 (April 2014 to March 2015): we searched for PCO research and core outcome sets (COSs). We conducted electronic searches of bibliographic databases and key websites and examined FDA prescribing information and reports of clinical trials and systematic reviews. We asked patient and clinician co-investigators to identify PCOs. Part 2 (not part of our original study protocol): in 2015, we surveyed members of The TMJ Association, Ltd., a patient group associated with temporomandibular disorders (4130 invitations sent). Participants prioritized (1) the importance of six potential benefits and (2) 21 potential harms selected by the investigators in part 1, using stated preference methods. We calculated descriptive statistics. Results: In part 1, we identified a COS for pain, the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) recommendations. The COS identified several important benefits, but it lacked specific recommendations about which potential harms to include in CER. We did not identify a COS for bipolar depression. Research reports, prescribing information, and patient co-investigators helped identify but not prioritize outcomes. We abandoned our electronic search for PCO research because we found it would be resource-intensive and yield few relevant reports. In part 2, surveying patients was useful for prioritizing PCOs. Members of The TMJ Association, Ltd., completed the survey (N = 746) and successfully prioritized both benefits and harms. Participants did not identify many benefits other than those we identified in part 1; several participants identified additional harms. Conclusions: These exploratory results could inform future research about identifying and prioritizing PCOs. We found that stakeholder co-investigators and research reports contributed to identifying PCOs; surveying a patient group contributed to prioritizing PCOs. Prioritizing potential harms was particularly challenging because there are many more potential harms than potential benefits. Methods for identifying and prioritizing potential benefits for CER might not be appropriate for harms. Further research is needed to determine the generalizability of these results

Data for Figure_3

Aggregated results used to generate Figure

Additional file 6: of Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

All “other” potential benefits and harms reported by survey participants in open-ended questions. (PDF 3420 kb

Additional file 7: of Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

Baseline characteristics of survey participants included in the final analysis by the reported month of birth. (PDF 1966 kb

Additional file 1: of Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

Search strategies. (PDF 2549 kb

Additional file 5: of Methods to identify and prioritize patient-centered outcomes for use in comparative effectiveness research

TMJ survey participant characteristics. (PDF 1546 kb

Harms are assessed inconsistently and reported inadequately part 1: systematic adverse events

Objectives: We examined systematic adverse events (AEs) in Part 1 (of 2) of a study describing the assessment and reporting of AEs in clinical trials. Study Design and Setting: We examined 52 public and nonpublic data sources about trials of quetiapine for bipolar depression using data from the Multiple Data Sources study. We extracted and compared information about systematic AEs (i.e., AEs assessed for all participants) in six prespecified domains: cardiovascular, cholesterol, endocrine, extrapyramidal symptoms, mania, and weight. Results: Eligible trials did not assess and report the same systematic AEs, and most results were not available in public sources. Overall, public sources reported 159 results, of which 92 of 159 (58%) included sufficient statistical information to calculate the treatment effect and its precision. Nonpublic sources reported 636 results; 630 of 636 (99%) reported sufficient statistical information. Conclusion: Systematic AEs were defined and analyzed in many ways, which led to many numerical results. Most systematic AEs were not mentioned in public sources. To minimize bias, methods for defining and analyzing potential AEs should be prespecified in trial registers and protocols. All trial results should be publicly available so that stakeholders can compare benefits and AEs. Trials could report core sets of AEs to facilitate decision-making

Harms are assessed inconsistently and reported inadequately Part 2: nonsystematic adverse events

Objective: We examined nonsystematic adverse events (AEs) in Part 2 (of 2) of a study describing the assessment and reporting AEs in clinical trials. Study Design and Setting: We examined 21 trials of gabapentin for neuropathic pain (52 sources) and seven trials of quetiapine for bipolar depression (80 sources) using data from the Multiple Data Sources study. We extracted and compared information about nonsystematic AEs (i.e., AEs that were not assessed for every participant), including AEs categorized as “serious.” We recorded whether AEs were grouped by anatomic or physiological system. Results: Trials of the same drug reported information about different AEs. Information in public sources was inadequate for decision-making. No public source reported all AEs, or all serious AEs, identified in nonpublic sources about the same trial. Of trials with only public sources, 2/15 (13%) gabapentin and 0/3 (0%) quetiapine trials grouped AEs by anatomic or physiological system. Conclusion: Public sources contained little information about nonsystematic AEs, including serious AEs. Grouping might make nonsystematic AEs easier to detect; however, most public sources did not report grouped AEs. Standards are needed to improve the collection and reporting of nonsystematic AEs so that stakeholders can use trials to assess the balance of potential benefits and harms