Implementing an application programming interface for PROMIS measures at three medical centers

BACKGROUND: There is an increasing body of literature advocating for the collection of patient-reported outcomes (PROs) in clinical care. Unfortunately, there are many barriers to integrating PRO measures, particularly computer adaptive tests (CATs), within electronic health records (EHRs), thereby limiting access to advances in PRO measures in clinical care settings. OBJECTIVE: To address this obstacle, we created and evaluated a software integration of an Application Programming Interface (API) service for administering and scoring Patient-Reported Outcomes Measurement Information System (PROMIS) measures with the EHR system. METHODS: We created a RESTful API and evaluated the technical feasibility and impact on clinical workflow at three academic medical centers. RESULTS: Collaborative teams (i.e., clinical, information technology [IT] and administrative staff) performed these integration efforts addressing issues such as software integration as well as impact on clinical workflow. All centers considered their implementation successful based on the high rate of completed PROMIS assessments (between January 2016 and January 2021) and minimal workflow disruptions. CONCLUSION: These case studies demonstrate not only the feasibility but also the pathway for the integration of PROMIS CATs into the EHR and routine clinical care. All sites utilized diverse teams with support and commitment from institutional leadership, initial implementation in a single clinic, a process for monitoring and optimization, and use of custom software to minimize staff burden and error

Evaluation of Item Candidates: The PROMIS Qualitative Item Review

One of the PROMIS (Patient-Reported Outcome Measurement Information System) network's primary goals is the development of a comprehensive item bank for patient-reported outcomes of chronic diseases. For its first set of item banks, PROMIS chose to focus on pain, fatigue, emotional distress, physical function, and social function. An essential step for the development of an item pool is the identification, evaluation, and revision of extant questionnaire items for the core item pool. In this work, we also describe the systematic process wherein items are classified for subsequent statistical processing by the PROMIS investigators. Six phases of item development are documented: identification of extant items, item classification and selection, item review and revision, focus group input on domain coverage, cognitive interviews with individual items, and final revision before field testing. Identification of items refers to the systematic search for existing items in currently available scales. Expert item review and revision was conducted by trained professionals who reviewed the wording of each item and revised as appropriate for conventions adopted by the PROMIS network. Focus groups were used to confirm domain definitions and to identify new areas of item development for future PROMIS item banks. Cognitive interviews were used to examine individual items. Items successfully screened through this process were sent to field testing and will be subjected to innovative scale construction procedures

Patient-reported outcomes in performance measurement

Patient-reported outcomes (PROs) are measures of how patients feel or what they are able to do in the context of their health status; PROs are reports, usually on questionnaires, about a patient's health conditions, health behaviors, or experiences with health care that individuals report directly, without modification of responses by clinicians or others; thus, they directly reflect the voice of the patient. PROs cover domains such as physical health, mental and emotional health, functioning, symptoms and symptom burden, and health behaviors. They are relevant for many activities: helping patients and their clinicians make informed decisions about health care, monitoring the progress of care, setting policies for coverage and reimbursement of health services, improving the quality of health care services, and tracking or reporting on the performance of health care delivery organizations. We address the major methodological issues related to choosing, administering, and using PROs for these purposes, particularly in clinical practice settings. We include a framework for best practices in selecting PROs, focusing on choosing appropriate methods and modes for administering PRO measures to accommodate patients with diverse linguistic, cultural, educational, and functional skills, understanding measures developed through both classic and modern test theory, and addressing complex issues relating to scoring and analyzing PRO data.Publishe

Cognitive interviewing in the evaluation of fatigue items: Results from the patient-reported outcomes measurement information system (PROMIS)

Cognitive Interviewing (CI) is a technique increasingly used to obtain respondent feedback on potential items during questionnaire development. No standard guidelines exist by which to incorporate CI feedback in deciding to retain, revise, or eliminate potential items. We used CI in developing fatigue items for the National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS) Roadmap initiative. Our aims were to describe the CI process, formally evaluate the utility of decisions made on the basis of CI, and offer suggestions for future research

The impact of next and back buttons on time to complete and measurement reliability in computer-based surveys

To assess the impact of including next and back buttons on response burden and measurement reliability of computer-based surveys. A sample of 807 participants (mean age of 53; 64% women, 83% non-Hispanic white; 81% some college or college graduates) from the YouGov Polimetrix panel was administered 56 items assessing performance of social/role activities and 56 items measuring satisfaction with social/role activities. Participants were randomly assigned to either (1) automatic advance to the next question with no opportunity to go back (auto/no back); (2) automatic advance to the next questions with an opportunity to go back (auto/back); (3) next button to go to the next question with no opportunity to go back (next/no back); or (4) next button to go to the next question with an opportunity to go back (next/back). We found no difference in missing data, internal consistency reliability, and domain scores by group. Time to complete the survey was about 50% longer when respondents were required to use a next button to go on. Given the similarity in missing data, reliability and mean scale scores with or without use of the next button, we recommend automatic advancement to the next item with the option to go back to the previous item

Leveraging pediatric PROMIS item banks to assess physical functioning in children at risk for severe functional loss

Background: Pediatric neuromuscular illnesses often result in decreased health-related quality of life (HRQL), notably in physical functioning. Generic HRQL measures have been developed for use in general populations, but may not adequately assess patients with severe functional loss. To address this measurement gap, we created two custom parent-proxy physical functioning short forms for use among children at risk for low levels of functioning, using pediatric Patient Reported Outcomes Measurement Information System (PROMIS) item banks for Upper Extremity and Mobility. Methods: Two custom short forms from PROMIS Upper Extremity (13 items) and Mobility (13 items) parent-proxy item banks were created and administered to parents of children (ages 5 – 22 years) enrolled in an integrated care program for management of chronic respiratory insufficiency, largely due to neuromuscular illnesses. Standardized PROMIS T-scores have a mean of 50 (SD = 10); higher scores indicate better functioning. Physicians rated clinical severity. Single proxy-rated items on mental and physical health from the Child Health Rating Inventories (CHRIs) global health scale were completed by parents. Psychometric properties, including known groups comparisons, were explored. Results: Fifty-seven parents completed the parent-proxy custom PROMIS short forms. The mean Upper Extremity T-score was 21 (SD = 13); the mean Mobility T-score was 22 (SD = 11). Some participants scored at the measurement floor; two items on assistive devices did not perform well in this sample and were excluded from the Mobility T-score. Known groups comparisons showed that those with lower clinical severity had better median Upper Extremity (22 vs. 14, p < 0.001) and Mobility (28 vs. 16, p = 0.004) function than those with worse clinical severity. Both Upper Extremity and Mobility T-scores were higher in the subgroups defined by better physical and mental health, as measured by the CHRIs. Conclusions: Upper Extremity and Mobility T-scores were nearly three standard deviations below the PROMIS pediatric calibration population mean. Preliminary psychometrics demonstrated the potential to more accurately measure lower physical functioning using items from PROMIS item banks. However, some participants scored at the measurement floor despite targeting items at the lower end of the scale. Further short form refinement, enrichment of the item banks, and larger-scale field testing are needed

Patient-reported outcomes in performance measurement

Patient-reported outcomes (PROs) are measures of how patients feel or what they are able to do in the context of their health status; PROs are reports, usually on questionnaires, about a patient's health conditions, health behaviors, or experiences with health care that individuals report directly, without modification of responses by clinicians or others; thus, they directly reflect the voice of the patient. PROs cover domains such as physical health, mental and emotional health, functioning, symptoms and symptom burden, and health behaviors. They are relevant for many activities: helping patients and their clinicians make informed decisions about health care, monitoring the progress of care, setting policies for coverage and reimbursement of health services, improving the quality of health care services, and tracking or reporting on the performance of health care delivery organizations. We address the major methodological issues related to choosing, administering, and using PROs for these purposes, particularly in clinical practice settings. We include a framework for best practices in selecting PROs, focusing on choosing appropriate methods and modes for administering PRO measures to accommodate patients with diverse linguistic, cultural, educational, and functional skills, understanding measures developed through both classic and modern test theory, and addressing complex issues relating to scoring and analyzing PRO data

Diamantes do médio rio Jequitinhonha, Minas Gerais: qualificação gemológica e análise granulométrica

BackgroundGlobal health measures represent an attractive option for researchers and clinicians seeking a brief snapshot of a patient's overall perspective on his or her health. Because scores on different global health measures are not comparable, comparative effectiveness research (CER) is challenging.ObjectiveTo establish a common reporting metric so that the physical and mental health scores on the Veterans RAND 12-Item Health Survey (VR-12 (©) ) can be converted into scores on the corresponding Patient Reported Outcomes Measurement Information System (PROMIS(®)) Global Health scores.DesignFollowing a single-sample linking design, participants from an Internet panel completed items from the PROMIS Global Health and VR-12 Health Survey. A common metric was created using analyses based on item response theory (IRT), producing score cross-walk tables for the mental and physical health components of each measure. The linking relationships were evaluated by calculating the standard deviation of differences between the observed and linked PROMIS scores and estimating confidence intervals by sample size.ParticipantsParticipants (N = 2025) were 49 % male and 73 % white; mean age was 46 years.Main measuresMental and physical health subscales of the PROMIS Global Health and the VR-12. The mean VR-12 physical component and mental component scores were 45.2 and 46.6, respectively; the mean PROMIS physical and mental health scores were 48.3 and 48.5, respectively.Key resultsWe found evidence that the combined set of VR-12 and PROMIS items were relatively unidimensional and that we could proceed with linking. Linking worked better between the physical health than mental health scores using VR-12 item responses (vs. linking based on algorithmic scores). For each of the cross-walks, users can minimize the impact of linking error with modest increases in sample sizes.ConclusionsVR-12 scores can be expressed on the PROMIS Global Health metric to facilitate the evaluation of treatment, including CER. Extending these results to other common measures of global health is encouraged

Development of a PROMIS item bank to measure pain interference

This paper describes the psychometric properties of the PROMIS Pain Interference (PROMIS-PI) bank. An initial candidate item pool (n=644) was developed and evaluated based on review of existing instruments, interviews with patients, and consultation with pain experts. From this pool, a candidate item bank of 56 items was selected and responses to the items were collected from large community and clinical samples. A total of 14,848 participants responded to all or a subset of candidate items. The responses were calibrated using an item response theory (IRT) model. A final 41-item bank was evaluated with respect to IRT assumptions, model fit, differential item function (DIF), precision, and construct and concurrent validity. Items of the revised bank had good fit to the IRT model (CFI and NNFI/TLI ranged from 0.974 to 0.997), and the data were strongly unidimensional (e.g., ratio of first and second eigenvalue = 35). Nine items exhibited statistically significant DIF. However, adjusting for DIF had little practical impact on score estimates and the items were retained without modifying scoring. Scores provided substantial information across levels of pain; for scores in the T-score range 50-80, the reliability was equivalent to 0.96 to 0.99. Patterns of correlations with other health outcomes supported the construct validity of the item bank. The scores discriminated among persons with different numbers of chronic conditions, disabling conditions, levels of self-reported health, and pain intensity (p< 0.0001). The results indicated that the PROMIS-PI items constitute a psychometrically sound bank. Computerized adaptive testing and short forms are available

The challenge of measuring intra-individual change in fatigue during cancer treatment

Evaluate how well three different patient-reported outcomes (PROs) measure individual change