An investigation of the effects of conditioning on two ability estimates in DIF analyses when the data are two-dimensional.

Differential Item functioning is present when examinees of the same ability, but belonging to different groups, have differing probabilities of success on an item. Traditionally, DIF detection procedures have been implemented conditioning on total test score. However, if there are group differences on the abilities underlying test performance, and total score is used as the matching criterion, multidimensional item impact may be incorrectly identified as DIF. This study sought to confirm earlier research which demonstrated that multidimensional item impact may be identified as DIF, and then to determine whether conditioning on multiple ability estimates would improve item classification accuracy. Data were generated to simulate responses for 1000 reference group members and 1000 focal group members to two-dimensional tests. The focal group mean on the second ability was one standard deviation less than the reference group mean. The dimensional structure of the tests, the discrimination of the items, and the correlation between the two abilities were varied. Logistic regression and Mantel-Haenszel DIF analyses were conducted using total score as the matching criterion. As anticipated, substantial numbers of items were identified as DIF. Items were then selected into subtests based on item measurement direction. The logistic regression procedure was re-implemented, with subtest scores substituted for total score. In the majority of the conditions simulated, this change in criterion resulted in substantial reductions in Type I errors. The magnitude of the reductions were related to the dimensional structure of the test, and the discrimination of the items. Finally, DIF analyses of two real data sets were conducted, using the same procedures. For one of the two tests, substituting subtest scores for total score resulted in a reduction in number of items identified as DIF. These results suggest that multidimensionality in a data set may have a significant impact on the results of DIF analyses. If total score is used as the matching criterion very high Type I error rates may be expected under some conditions. By conditioning on subtest scores in lieu of total score in logistic regression analyses it may be possible to substantially reduce the number of Type I errors, at least in some circumstances

Using Home Visits to Understand Medication Errors in Children

Summary: Current research methods are not well designed to detect medication errors that occur at home. We developed home visit methods to investigate home medication errors in children with chronic conditions. These methods include observation of parent administration of medication to the child by a trained nurse observer who takes detailed ethnographic notes; review of all prescription and over-the-counter medications for dispensing errors, pill counts, and medication reconciliation; and parent interviews to identify barriers to effective home use of medications, prior home medication errors that parents are aware of, and suggestions for systemic improvements. Details about each possible error detected are recorded using a structured data collection form (allergies, medication list, dispensing errors, administration errors). We conducted several pilot home visits and found that this approach has the potential to help understand home medication errors in order to develop interventions to improve the safety of medication self-management

Barriers and Facilitators to Genetic Testing for Familial Hypercholesterolemia in the United States: A Review

Familial Hypercholesterolemia (FH) is an underdiagnosed condition in the United States (US) and globally, affecting an estimated 1/250 individuals. It is a genetic risk factor for premature cardiovascular disease and is responsible for an estimated 600,000 to 1.2 million preventable vascular events. Studies show that FH genetic testing can identify a causal gene variant in 60 to 80% of clinically suspected FH cases. However, FH genetic testing is currently underutilized in clinical settings in the US despite clinical recommendations and evidence supporting its use. Reasons for underutilization are not well understood. We conducted a literature review in the PubMed/MEDLINE database and eight peer-reviewed journals. After filtering for and reviewing 2340 articles against our inclusion criteria, we included nine commentaries or expert opinions and eight empirical studies reported between January 2014 and March 2019 in our review. After applying the Consolidated Framework for Implementation Research (CFIR), we identified a total of 26 potential barriers and 15 potential facilitators (estimated barrier to facilitator ratio of 1.73). We further estimated ratios of potential barriers to facilitators for each CFIR domain (Characteristics of Intervention, Outer Setting, Inner Setting, Characteristics of Individuals, and Process). Findings derived from our systematic approach to the literature and calculations of estimated baseline ratios of barriers and facilitators can guide future research to understand FH genetic testing implementation in diverse clinical settings. Our systematic approach to the CFIR could also be used as a model to understand or compare barriers and facilitators to other evidence-based genetic testing processes in health care settings in the US and abroad

A vision for using online portals for surveillance of patient-centered communication in cancer care

The Veterans Health Administration (VHA) is charged with providing high-quality health care, not only in terms of technical competence but also with regard to patient-centered care experiences. Patient-centered coordination of care and communication are especially important in cancer care, as deficiencies in these areas have been implicated in many cases of delayed cancer diagnosis and treatment. Additionally, because cancer care facilities are concentrated within the VHA system, geographical and system-level barriers may present prominent obstacles to quality care. Systematic assessment of patient-centered communication (PCC) may help identify both individual veterans who are at risk of suboptimal care and opportunities for quality improvement initiatives at the service, facility, or system-wide level. In this manuscript, we describe our vision to implement an assessment of PCC through patient self-report to improve the quality of cancer care and other health services in the VHA. We outline a possible strategy to assess PCC that leverages the VHA’s existing initiative to promote use of an online personal health record for veterans (MyHealtheVet). Questionnaires administered periodically or following specific episodes of care can be targeted to assess PCC in cancer care. Assessment of PCC can also be tied to clinical and administrative data for more robust analysis of patient outcomes. Ultimately, the goal of any assessment of PCC is to gather valid, actionable data that can assist VHA clinicians and staff with providing the best possible care for veterans with cancer

ComprehENotes, an Instrument to Assess Patient Reading Comprehension of Electronic Health Record Notes: Development and Validation

BACKGROUND: Patient portals are widely adopted in the United States and allow millions of patients access to their electronic health records (EHRs), including their EHR clinical notes. A patient\u27s ability to understand the information in the EHR is dependent on their overall health literacy. Although many tests of health literacy exist, none specifically focuses on EHR note comprehension. OBJECTIVE: The aim of this paper was to develop an instrument to assess patients\u27 EHR note comprehension. METHODS: We identified 6 common diseases or conditions (heart failure, diabetes, cancer, hypertension, chronic obstructive pulmonary disease, and liver failure) and selected 5 representative EHR notes for each disease or condition. One note that did not contain natural language text was removed. Questions were generated from these notes using Sentence Verification Technique and were analyzed using item response theory (IRT) to identify a set of questions that represent a good test of ability for EHR note comprehension. RESULTS: Using Sentence Verification Technique, 154 questions were generated from the 29 EHR notes initially obtained. Of these, 83 were manually selected for inclusion in the Amazon Mechanical Turk crowdsourcing tasks and 55 were ultimately retained following IRT analysis. A follow-up validation with a second Amazon Mechanical Turk task and IRT analysis confirmed that the 55 questions test a latent ability dimension for EHR note comprehension. A short test of 14 items was created along with the 55-item test. CONCLUSIONS: We developed ComprehENotes, an instrument for assessing EHR note comprehension from existing EHR notes, gathered responses using crowdsourcing, and used IRT to analyze those responses, thus resulting in a set of questions to measure EHR note comprehension. Crowdsourced responses from Amazon Mechanical Turk can be used to estimate item parameters and select a subset of items for inclusion in the test set using IRT. The final set of questions is the first test of EHR note comprehension

Health Information Seeking on Behalf of Others: Characteristics of ‘Surrogate Seekers’

Understanding the health information seeking behaviors of surrogate seekers (those who seek health information for others) may guide efforts to reach disadvantaged populations. We used 2011-2012 data from the Health Information National Trends Survey to describe the behaviors of online surrogate seekers. Respondents were asked about their use of the Internet for surrogate seeking over the prior 12 months. Data were weighted to calculate population estimates. Compared to those who sought health information online for only themselves, surrogate seekers were more likely to live in households with others (weighted percent 89.4% vs. 82.5% of self-seekers; p \u3c 0.05); no significant differences in gender, race, income or education were observed. Surrogate seekers were more likely to report: visits to social networking sites to read and share about medical topics; participation in online health support groups and downloading of health information to electronic devices. On multivariate analysis, those who had looked online for a healthcare provider were more likely to be surrogate seekers (OR 1.67, 95% CI 1.08-2.59). Our results offer insight for leveraging health communication efforts to reach populations who rely upon surrogate seekers for health information