A Multilevel System of Quality Technology-Enhanced Learning and Teaching Indicators

published_or_final_versio

Thematic Working Group 7: Indicators of Quality Technology: Enhanced Learning and Teaching

EDUsummIT 2015 was co-hosted by UNESCO Bangkok (the Asia and Pacific regional bureau of UNESCO) and Curtin Universitypublished_or_final_versio

Tracing digital transformation in educational organizations

This chapter describes the quantitative approaches for assessing various aspects of digital transformation from the joint research and development project #ko.vernetzt. In an application-oriented case study approach, the operationalization of a maturity model of digital transformation for educational organizations (MMEO) and the design and implementation of a multi-perspective evaluation concept are outlined. While the MMEO provides a state perspective on the digital transformation of an educational organization and its employees, the evaluation concept aims at tracing developments of media-related professional competencies. MMEO has been implemented in a study with N = 222 participants, while N = 59 learners were subject to the evaluation polls. The results provide the necessary evidence for implementing and continuously improving a qualification program in the regarded research context. However, the methodology can also be transferred to other organizations in the education sector and beyond

To what extent do nurses use research in clinical practice? A systematic review

Background : In the past forty years, many gains have been made in our understanding of the concept of research utilization. While numerous studies exist on professional nurses\u27 use of research in practice, no attempt has been made to systematically evaluate and synthesize this body of literature with respect to the extent to which nurses use research in their clinical practice. The objective of this study was to systematically identify and analyze the available evidence related to the extent to which nurses use research findings in practice. Methods : This study was a systematic review of published and grey literature. The search strategy included 13 online bibliographic databases: Cochrane Database of Systematic Reviews, Cochrane Central Register of Controlled Trials, MEDLINE, CINAHL, EMBASE, HAPI, Web of Science, SCOPUS, OCLC Papers First, OCLC WorldCat, ABI Inform, Sociological Abstracts, and Dissertation Abstracts. The inclusion criteria consisted of primary research reports that assess professional nurses\u27 use of research in practice, written in the English or Scandinavian languages. Extent of research use was determined by assigning research use scores reported in each article to one of four quartiles: low, moderate-low, moderate-high, or high. Results : Following removal of duplicate citations, a total of 12,418 titles were identified through database searches, of which 133 articles were retrieved. Of the articles retrieved, 55 satisfied the inclusion criteria. The 55 final reports included cross-sectional/survey (n = 51) and quasi-experimental (n = 4) designs. A sensitivity analysis, comparing findings from all reports with those rated moderate (moderate-weak and moderate-strong) and strong quality, did not show significant differences. In a majority of the articles identified (n = 38, 69%), nurses reported moderate-high research use. Conclusions : According to this review, nurses\u27 reported use of research is moderate-high and has remained relatively consistent over time until the early 2000\u27s. This finding, however, may paint an overly optimistic picture of the extent to which nurses use research in their practice given the methodological problems inherent in the majority of studies. There is a clear need for the development of standard measures of research use and robust well-designed studies examining nurses\u27 use of research and its impact on patient outcomes. The relatively unchanged self-reports of moderate-high research use by nurses is troubling given that over 40 years have elapsed since the first studies in this review were conducted and the increasing emphasis in the past 15 years on evidence-based practice. More troubling is the absence of studies in which attempts are made to assess the effects of varying levels of research use on patient outcomes.<br /

The BARRIERS scale -- the barriers to research utilization scale: A systematic review

<p>Abstract</p> <p>Background</p> <p>A commonly recommended strategy for increasing research use in clinical practice is to identify barriers to change and then tailor interventions to overcome the identified barriers. In nursing, the BARRIERS scale has been used extensively to identify barriers to research utilization.</p> <p>Aim and objectives</p> <p>The aim of this systematic review was to examine the state of knowledge resulting from use of the BARRIERS scale and to make recommendations about future use of the scale. The following objectives were addressed: To examine how the scale has been modified, to examine its psychometric properties, to determine the main barriers (and whether they varied over time and geographic locations), and to identify associations between nurses' reported barriers and reported research use.</p> <p>Methods</p> <p>Medline (1991 to September 2009) and CINHAL (1991 to September 2009) were searched for published research, and ProQuest^®digital dissertations were searched for unpublished dissertations using the BARRIERS scale. Inclusion criteria were: studies using the BARRIERS scale in its entirety and where the sample was nurses. Two authors independently assessed the study quality and extracted the data. Descriptive and inferential statistics were used.</p> <p>Results</p> <p>Sixty-three studies were included, with most using a cross-sectional design. Not one study used the scale for tailoring interventions to overcome identified barriers. The main barriers reported were related to the setting, and the presentation of research findings. Overall, identified barriers were consistent over time and across geographic locations, despite varying sample size, response rate, study setting, and assessment of study quality. Few studies reported associations between reported research use and perceptions of barriers to research utilization.</p> <p>Conclusions</p> <p>The BARRIERS scale is a nonspecific tool for identifying general barriers to research utilization. The scale is reliable as reflected in assessments of internal consistency. The validity of the scale, however, is doubtful. There is no evidence that it is a useful tool for planning implementation interventions. We recommend that no further descriptive studies using the BARRIERS scale be undertaken. Barriers need to be measured specific to the particular context of implementation and the intended evidence to be implemented.</p

A systematic review of the psychometric properties of self-report research utilization measures used in healthcare

<p>Abstract</p> <p>Background</p> <p>In healthcare, a gap exists between what is known from research and what is practiced. Understanding this gap depends upon our ability to robustly measure research utilization.</p> <p>Objectives</p> <p>The objectives of this systematic review were: to identify self-report measures of research utilization used in healthcare, and to assess the psychometric properties (acceptability, reliability, and validity) of these measures.</p> <p>Methods</p> <p>We conducted a systematic review of literature reporting use or development of self-report research utilization measures. Our search included: multiple databases, ancestry searches, and a hand search. Acceptability was assessed by examining time to complete the measure and missing data rates. Our approach to reliability and validity assessment followed that outlined in the <it>Standards for Educational and Psychological Testing</it>.</p> <p>Results</p> <p>Of 42,770 titles screened, 97 original studies (108 articles) were included in this review. The 97 studies reported on the use or development of 60 unique self-report research utilization measures. Seven of the measures were assessed in more than one study. Study samples consisted of healthcare providers (92 studies) and healthcare decision makers (5 studies). No studies reported data on acceptability of the measures. Reliability was reported in 32 (33%) of the studies, representing 13 of the 60 measures. Internal consistency (Cronbach's Alpha) reliability was reported in 31 studies; values exceeded 0.70 in 29 studies. Test-retest reliability was reported in 3 studies with Pearson's <it>r </it>coefficients > 0.80. No validity information was reported for 12 of the 60 measures. The remaining 48 measures were classified into a three-level validity hierarchy according to the number of validity sources reported in 50% or more of the studies using the measure. Level one measures (n = 6) reported evidence from any three (out of four possible) <it>Standards </it>validity sources (which, in the case of single item measures, was all applicable validity sources). Level two measures (n = 16) had evidence from any two validity sources, and level three measures (n = 26) from only one validity source.</p> <p>Conclusions</p> <p>This review reveals significant underdevelopment in the measurement of research utilization. Substantial methodological advances with respect to construct clarity, use of research utilization and related theory, use of measurement theory, and psychometric assessment are required. Also needed are improved reporting practices and the adoption of a more contemporary view of validity (<it>i.e.</it>, the <it>Standards</it>) in future research utilization measurement studies.</p

Indicators of quality technology-enhanced Learning and Teaching

Conference Theme: Public Scholarship to Educate Diverse Democracie