Examining the role of funders in ensuring value and reducing waste in research: An organizational case-study of the Patient-Centered Outcomes Research Institute [version 1; peer review: 2 approved]

International experts have recommended actions that funders can take to improve the value of research investments. They state that self-assessment and public sharing are the basis for accountability and improvement. We examined our policies and practice to determine the extent to which the Patient-Centered Outcomes Research Institute’s (PCORI) policies and practices as a research funder align with international best practice recommendations. A self-audit of current policies and practice against 17 recommendations and 35 sub-recommendations representing five major stages of research production, based on adapted methods used for self-assessment by another funder, was performed.  Fit of existing PCORI policies and practices with 35 sub-recommendations, qualitative assessment of adequacy (area of strength; area of partial strength; area of growth; not applicable) for 17 recommendations for five stages of research production was assessed. Of the 17 recommendations, 15 were applicable to PCORI’s research mission and focus.  PCORI has policies and practices in place for all elements of six recommendations (“area of strength”) and policies that address each element but with some still in active development for three (“area of partial strength”). PCORI is partially addressing six of the 15 relevant recommendations (“area of growth”). Areas for growth include making study protocols publicly available, improving policies on data sharing, and enhancing collaboration with other funders to reduce redundant funding. A voluntary consortium of international funders is underway to encourage further progress, including additional self-assessment and public sharing for accountability. These findings indicate PCORI has undertaken efforts to align its funding practices with international recommendations to ensure the value of public dollars invested in research.  Further efforts will likely require additional coordination and collaboration between funders and stakeholders

An approach to addressing subpopulation considerations in systematic reviews: the experience of reviewers supporting the U.S. Preventive Services Task Force

Abstract Background Guideline developers and other users of systematic reviews need information about whether a medical or preventive intervention is likely to benefit or harm some patients more (or less) than the average in order to make clinical practice recommendations tailored to these populations. However, guidance is lacking on how to include patient subpopulation considerations into the systematic reviews upon which guidelines are often based. In this article, we describe methods developed to consistently consider the evidence for relevant subpopulations in systematic reviews conducted to support primary care clinical preventive service recommendations made by the U.S. Preventive Services Task Force (USPSTF). Proposed approach Our approach is grounded in our experience conducting systematic reviews for the USPSTF and informed by a review of existing guidance on subgroup analysis and subpopulation issues. We developed and refined our approach based on feedback from the Subpopulation Workgroup of the USPSTF and pilot testing on reviews being conducted for the USPSTF. This paper provides processes and tools for incorporating evidence-based identification of important sources of potential heterogeneity of intervention effects into all phases of systematic reviews. Key components of our proposed approach include targeted literature searches and key informant interviews to identify the most important subpopulations a priori during topic scoping, a framework for assessing the credibility of subgroup analyses reported in studies, and structured investigation of sources of heterogeneity of intervention effects. Conclusions Further testing and evaluation are necessary to refine this proposed approach and demonstrate its utility to the producers and users of systematic reviews beyond the context of the USPSTF. Gaps in the evidence on important subpopulations identified by routinely applying this process in systematic reviews will also inform future research needs

Description and pilot results from a novel method for evaluating return of incidental findings from next-generation sequencing technologies

To develop, operationalize, and pilot test a transparent, reproducible, and evidence informed method to qualify when to report incidental findings from next generation sequencing technologies

Oncotype DX tumor gene expression profiling in stage II colon cancer: Application: Prognostic, risk prediction

Overall five-year survival for patients with stage-II colon cancer averages 75% after surgery alone. However, some of these patients have poorer outcomes, similar to patients with stage-III disease. The proposed use of the Oncotype DX assay is to improve risk stratification for recurrence in stage-II colon cancer

Examining the role of funders in ensuring value and reducing waste in research: An organizational case-study of the Patient-Centered Outcomes Research Institute.

International experts have recommended actions that funders can take to improve the value of research investments. They state that self-assessment and public sharing are the basis for accountability and improvement. We examined our policies and practice to determine the extent to which the Patient-Centered Outcomes Research Institute's (PCORI) policies and practices as a research funder align with international best practice recommendations. A self-audit of current policies and practice against 17 recommendations and 35 sub-recommendations representing five major stages of research production, based on adapted methods used for self-assessment by another funder, was performed.  Fit of existing PCORI policies and practices with 35 sub-recommendations, qualitative assessment of adequacy (area of strength; area of partial strength; area of growth; not applicable) for 17 recommendations for five stages of research production was assessed. Of the 17 recommendations, 15 were applicable to PCORI's research mission and focus.  PCORI has policies and practices in place for all elements of six recommendations ("area of strength") and policies that address each element but with some still in active development for three ("area of partial strength"). PCORI is partially addressing six of the 15 relevant recommendations ("area of growth"). Areas for growth include making study protocols publicly available, improving policies on data sharing, and enhancing collaboration with other funders to reduce redundant funding. A voluntary consortium of international funders is underway to encourage further progress, including additional self-assessment and public sharing for accountability. These findings indicate PCORI has undertaken efforts to align its funding practices with international recommendations to ensure the value of public dollars invested in research.  Further efforts will likely require additional coordination and collaboration between funders and stakeholders