Investigating Evaluation Frameworks for Electronic Health Record: A Literature Review

BACKGROUND: There are various electronic health records (EHRs) evaluation frameworks with multiple dimensions and numerous sets of evaluation measures, while the coverage rate of evaluation measures in a common framework varies in different studies. AIM: This study provides a literature review of the current EHR evaluation frameworks and a model for measuring the coverage rate of evaluation measures in EHR frameworks. METHODS: The current study was a comprehensive literature review and a critical appraisal study. The study was conducted in three phases. In Phase 1, a literature review of EHR evaluation frameworks was conducted. In Phase 2, a three-level hierarchical structure was developed, which includes three aspects, 12 dimensions, and 110 evaluation measures. Subsequently, evaluation measures in the identified studies were categorized based on the hierarchical structure. In Phase 3, relative frequency (RF) of evaluation measures in different dimensions and aspects for each of the identified studies were determined and categorized as follows: Appropriate, moderate, and low coverage. RESULTS: Out of a total of 8276 retrieved articles, 62 studies were considered relevant. The RF range in the second and third level of the hierarchical structure was between 8.6%–91.94% and 0.2%–61%, respectively. “Ease of use” and “system quality” were the most frequent evaluation measure and dimension. Our results indicate that identified studies cover at least one and at most nine evaluation dimensions and current evaluation frameworks focus more on the technology aspect. Almost in all identified studies, evaluation measures related to the technology aspect were covered. However, evaluation measures related to human and organization aspects were covered in 68% and 84% of the identified studies, respectively. CONCLUSION: In this study, we systematically reviewed all literature presenting any type of EHR evaluation framework and analyzed and discussed their aspects and features. We believe that the findings of this study can help researchers to review and adopt the EHR evaluation frameworks for their own particular field of usage

Implementation outcome instruments for use in physical healthcare settings: a systematic review

BACKGROUND: Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings. METHOD: The following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument. RESULTS: Fifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability. CONCLUSION: Investigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 2017 CRD42017065348

The Key Determinant Factors of Clinical Information Systems User Satisfaction: Lessons Learnt From an Australian Case Study

Driven by the escalating pressures to enhance its outcomes within its limited resources, the healthcare industry is increasingly investing in various clinical information systems. Although user satisfaction is key to realizing the benefits of these large invests, the determinant factors for user satisfaction with clinical information systems are still not well understood. This study addresses this need by qualitatively investigating the relationships between the overall satisfaction with clinical information systems and five key aspects of clinical information systems, namely key functionalities, efficiency of use, intuitiveness of graphical user interfaces (GUI), communication, collaboration, and information exchange, and interoperability and compatibility issues. The findings resulting from both descriptive and thematic analyses show that clinical information systems are still in their infant stage and that their maturity is highly questionable. Simpler clinical information systems are likely to be more satisfying than more complex systems. System design and training provided are also key factors as the study finds

Developing a theoretical model and questionnaire survey instrument to measure the success of electronic health records in residential aged care

Electronic health records (EHR) are introduced into healthcare organizations worldwide to improve patient safety, healthcare quality and efficiency. A rigorous evaluation of this technology is important to reduce potential negative effects on patient and staff, to provide decision makers with accurate information for system improvement and to ensure return on investment. Therefore, this study develops a theoretical model and questionnaire survey instrument to assess the success of organizational EHR in routine use from the viewpoint of nursing staff in residential aged care homes. The proposed research model incorporates six variables in the reformulated DeLone and McLean information systems success model: system quality, information quality, service quality, use, user satisfaction and net benefits. Two variables training and self-efficacy were also incorporated into the model. A questionnaire survey instrument was designed to measure the eight variables in the model. After a pilot test, the measurement scale was used to collect data from 243 nursing staff members in 10 residential aged care homes belonging to three management groups in Australia. Partial least squares path modeling was conducted to validate the model. The validated EHR systems success model predicts the impact of the four antecedent variablesÐtraining, self-efficacy, system quality and information qualityÐon the net benefits, the indicator of EHR systems success, through the intermittent variables use and user satisfaction. A 24-item measurement scale was developed to quantitatively evaluate the performance of an EHR system. The parsimonious EHR systems success model and the measurement scale can be used to benchmark EHR systems success across organizations and units and over time

The Factors of Consumer Intension of Using Mobile Payment in Vietnam

Purpose: Within the context of emerging mobile technologies, Mobile payment or M-payment has been introduced as the new trend for payment methods bringing more value and convenience to consumers. However, the development of M-payment services is still quite timid in some Southeast Asia countries including Vietnam. This is also the reason and motivation for the author to do this research.   Theoretical framework: The goal of this study is to spot some factors that affect the use behavior (UB) of M-payment consumers in five major metropolises that were most influential on the economy in Vietnam.   Design/methodology/approach: A quantitative questionnaire was used to measure the responses of participants and Partial Least Squares (PLS) method was employed to analyze the collection data as well as test all hypotheses.   Findings: The results indicated that SI has been the important factor leading to the BI to use M-payment followed by SV and SC issues and BI also had a strong influence on the UB of consumers. Since M-payment is still in the infancy stage and is one of the most exciting mobile applications for the next few years in Vietnam, the identification of important factors concerning M-payments.   Research, Practical & Social Implications: To investigate the factors affecting UB of Vietnamese M-payment consumers, the researcher proposed a research model which analyzes the impact of various variables extracted from system quality (ST), service quality (SV), security (SC), social influence (SI) on behavioral intention (BI) to use and BI on M-payment UB.   Originality/value: This study will assist merchants and software developers to design and improve the systems and services to ensure the full acceptance and continuous use of the systems. Finally, a set of suggestions for the subsequent research works also was listed at the end of this study

Electronic medical records: an empirical study of South African health workers' attitudes, use and perceptions of impacts

Thesis (M.Com. (Information Systems))--University of the Witwatersrand, Faculty of Commerce, Law and Management, School of Economic and Business Sciences, 2014.Successful implementation of electronic medical record systems (EMRs) can result in many benefits. However, the adoption and use of EMRs by health workers is often problematic. Understanding the perceptions and attitudes of health workers towards the use of these systems is therefore important. This study has contributed by examining (a) perceptions of health workers towards the characteristics of EMR systems, (b) perceptions of the impacts of EMR use on healthcare delivery and other workplace outcomes (i.e. individual work performance and job satisfaction), (c) their intentions to continue using EMRs. The DeLone and McLean Information System Success model and the Information Systems Continuance model were used to underpin the study and to hypothesize inter-relationships amongst these perceptions and attitudes. The empirical context of the study was Tygerberg Hospital in Cape Town, South Africa. A survey was carried out and 142 responses were obtained from the nurses at the hospital. Results showed that system characteristics, namely, system quality, information quality and service quality were significant predictors of user satisfaction, which in turn was found to be a significant predictor of EMR use. Satisfaction together with perceptions of individual impacts and healthcare impacts was found to lead to continuance intention. Users reported statistically significantly higher levels of job satisfaction than non-users. Healthcare impact perceptions was positively associated with job satisfaction. Based on the results of the study, it is recommended that decision makers, policy makers and EMR vendors pay close attention to the service quality and the system quality of EMRs as these are the key determinants of user satisfaction. It is also recommended that managers ensure that all healthcare workers be given access to and encouraged to use EMRs to perform their work related task as EMR users have been shown to have higher levels of job satisfaction than non-users

Healthcare professionals' satisfaction toward the use of district health information system and its associated factors in southwest Ethiopia: using the information system success model

BackgroundEthiopia has the potential to use the district health information system, which is a building block of the health system. Thus, it needs to assess the performance level of the system by identifying the satisfaction of end users. There is little evidence about users' satisfaction with using this system. As a result, this study was conducted to fill this gap by evaluating user satisfaction and associated factors of district health information system among healthcare providers in Ethiopia, using the information system success model.MethodsAn institutional-based cross-sectional study was conducted from November to December 2022 in the Oromia region of southwest Ethiopia. A total of 391 health professionals participated in the study. The study participants were selected using a census. Using a self-administered questionnaire, data were collected. Measurement and structural equation modeling analyses were used to evaluate reliability, the validity of model fit, and to test the relationship between the constructs, respectively, using analysis of moment structure (AMOS) V 26.ResultsSystem quality had a positive direct effect on the respondent's system use (β = 0.18, P-value < 0.001), and satisfaction (β = 0.44, P-value < 0.001). Service quality had also a direct effect on the respondent's system use (β = 0.37, P-value < 0.01), and satisfaction with using the district health information system (β = 0.36, P-value < 0.01). Similarly, system use had also a direct effect on the respondent's satisfaction (β = 0.53, P-value < 0.05). Moreover, computer literacy had a direct effect on the respondent's system use (β = 0.63, P-value < 0.05), and satisfaction (β = 0.51, P-value < 0.01).ConcussionsThe overall user satisfaction with using the district health information system in Ethiopia was low. System quality, service quality, and computer literacy had a direct positive effect on system use and user satisfaction. In addition, system use and information quality had a direct positive effect on healthcare professionals' satisfaction with using the district health information system. The most important factor for enhancing system use and user satisfaction was computer literacy. Accordingly, for the specific user training required for the success of the district health information system in Ethiopia, the manager should offer additional basic computer courses for better use of the system

Gamification: a key determinant of massive open online course (MOOC) success

Massive open online courses (MOOCs), contribute significantly to individual empowerment because they can help people learn about a wide range of topics. To realize the full potential of MOOCs, we need to understand their factors of success, here defined as the use, user satisfaction, along the individual and organizational performance resulting from the user involvement. We propose a theoretical framework to identify the determinants of successful MOOCs, and empirically measure these factors in a real MOOC context. We put forward the role of gamification and suggest that, together with information system (IS) theory, gamification proved to play a crucial role in the success of MOOCs.info:eu-repo/semantics/acceptedVersio