Development of a Taxonomy of Keywords for Engineering Education Research

The diversity of engineering education research provides an opportunity for cross‐fertilization of ideas and creativity, but it also can result in fragmentation of the field and duplication of effort. One solution is to establish a standardized taxonomy of engineering education terms to map the field and communicate and connect research initiatives. This report describes the process for developing such a taxonomy, the EER Taxonomy. Although the taxonomy focuses on engineering education research in the United States, inclusive efforts have engaged 266 individuals from 149 cities in 30 countries during one multiday workshop, seven conference sessions, and several other virtual and in‐person activities. The resulting taxonomy comprises 455 terms arranged in 14 branches and six levels. This taxonomy was found to satisfy four criteria for validity and reliability: (1) keywords assigned to a set of abstracts were reproducible by multiple researchers, (2) the taxonomy comprised terms that could be selected as keywords to fully describe 243 articles in three journals, (3) the keywords for those 243 articles were evenly distributed across the branches of the taxonomy, and (4) the authors of 31 conference papers agreed with 90% of researcher‐assigned keywords. This report also describes guidelines developed to help authors consistently assign keywords for their articles by encouraging them to choose terms from three categories: (1) context/focus/topic, (2) purpose/target/motivation, and (3) research approach.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/116010/1/jee20101.pd

An analysis of the alignment of the Grade 12 Physical Sciences examination and the core curriculum in South Africa

I report on an analysis of the alignment between the South African Grade 12 Physical Sciences core curriculum content and the exemplar papers of 2008, and the final examination papers of 2008 and 2009. A two-dimensional table was used for both the curriculum and the examination in order to calculate the Porter alignment index, which indicates the degree of match between the two. Alignment indices of 0.8 and 0.6 for Physics and Chemistry, respectively, were computed and remained constant for Physics, but fluctuated initially for Chemistry before levelling off. Using the revised Bloom’s taxonomy, discrepancies were found in terms of cognitive levels as well as content areas in both Physics and Chemistry. The cognitive level Remember is under-represented in the Chemistry and Physics examinations, whereas the cognitive levels Understand and Apply were over-represented in Chemistry. It is argued that the shift to higher cognitive levels is in line with the reported increase in cognitive complexity of the Physical Sciences curriculum. The significance of the study for Physical Science teachers is highlighted, and the potential for further research is also indicated.Keywords: alignment; assessment; Chemistry; cognitive level; curriculum content; Physics; revised Bloom’s taxonomy 

Game-related assessments for personnel selection: A systematic review

Industrial development in recent decades has led to using information and communication technologies (ICT) to support personnel selection processes. One of the most notable examples is game-related assessments (GRA), supposedly as accurate as conventional tests but which generate better applicant reactions and reduce the likelihood of adverse impact and faking. However, such claims still lack scientific support. Given practitioners’ increasing use of GRA, this article reviews the scientific literature on gamification applied to personnel selection to determine whether the current state of the art supports their use in professional practice and identify specific aspects on which future research should focus. Following the PRISMA model, a search was carried out in the Web of Science and Scopus databases, identifying 34 valid articles, of which 85.3% are empirical studies that analyze five areas: (1) validity; (2) applicant reactions; (3) design of GRA; (4) personal characteristics and GRA; and (5) adverse impact and faking. Together, these studies show that GRA can be used in personnel selection but that the supposed advantages of GRA over conventional tests are fewer than imagined. The results also suggest several aspects on which research should focus (e.g., construct validity, differences depending on the type of game, prediction of different job performance dimensions), which could help define the situations in which the use of GRA may be recommended

Classification schemes for knowledge translation interventions: a practical resource for researchers

Abstract Background As implementation science advances, the number of interventions to promote the translation of evidence into healthcare, health systems, or health policy is growing. Accordingly, classification schemes for these knowledge translation (KT) interventions have emerged. A recent scoping review identified 51 classification schemes of KT interventions to integrate evidence into healthcare practice; however, the review did not evaluate the quality of the classification schemes or provide detailed information to assist researchers in selecting a scheme for their context and purpose. This study aimed to further examine and assess the quality of these classification schemes of KT interventions, and provide information to aid researchers when selecting a classification scheme. Methods We abstracted the following information from each of the original 51 classification scheme articles: authors’ objectives; purpose of the scheme and field of application; socioecologic level (individual, organizational, community, system); adaptability (broad versus specific); target group (patients, providers, policy-makers), intent (policy, education, practice), and purpose (dissemination versus implementation). Two reviewers independently evaluated the methodological quality of the development of each classification scheme using an adapted version of the AGREE II tool. Based on these assessments, two independent reviewers reached consensus about whether to recommend each scheme for researcher use, or not. Results Of the 51 original classification schemes, we excluded seven that were not specific classification schemes, not accessible or duplicates. Of the remaining 44 classification schemes, nine were not recommended. Of the 35 recommended classification schemes, ten focused on behaviour change and six focused on population health. Many schemes (n = 29) addressed practice considerations. Fewer schemes addressed educational or policy objectives. Twenty-five classification schemes had broad applicability, six were specific, and four had elements of both. Twenty-three schemes targeted health providers, nine targeted both patients and providers and one targeted policy-makers. Most classification schemes were intended for implementation rather than dissemination. Conclusions Thirty-five classification schemes of KT interventions were developed and reported with sufficient rigour to be recommended for use by researchers interested in KT in healthcare. Our additional categorization and quality analysis will aid in selecting suitable classification schemes for research initiatives in the field of implementation science

Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI

As an emerging interaction paradigm, physiological computing is increasingly being used to both measure and feed back information about our internal psychophysiological states. While most applications of physiological computing are designed for individual use, recent research has explored how biofeedback can be socially shared between multiple users to augment human-human communication. Reflecting on the empirical progress in this area of study, this paper presents a systematic review of 64 studies to characterize the interaction contexts and effects of social biofeedback systems. Our findings highlight the importance of physio-temporal and social contextual factors surrounding physiological data sharing as well as how it can promote social-emotional competences on three different levels: intrapersonal, interpersonal, and task-focused. We also present the Social Biofeedback Interactions framework to articulate the current physiological-social interaction space. We use this to frame our discussion of the implications and ethical considerations for future research and design of social biofeedback interfaces.Comment: [Accepted version, 32 pages] Clara Moge, Katherine Wang, and Youngjun Cho. 2022. Shared User Interfaces of Physiological Data: Systematic Review of Social Biofeedback Systems and Contexts in HCI. In CHI Conference on Human Factors in Computing Systems (CHI'22), ACM, https://doi.org/10.1145/3491102.351749

Designing a Tool to Assess Professional Competences: Theoretical Foundations and Potential Applications

This conceptual paper outlines the descriptive theoretical foundations or kernel theories for designing an information and communication technology (ICT) tool to assess professional competences in the Austrian trade and craft sector. Upon completion, the ICT-tool serves as a boundary object in which applicants and assessors can interact. While this paper consists of a literature review and conceptual discussion, the overall project is methodologically placed within a multidisciplinary design-science paradigm. Design science scaffolds and structures the development of a theoretical model, the generation of assessment-items and the ICT-tool itself. This paper discusses the necessary descriptive knowledge or kernel theories on which the design of the ICT-tool rests. First, we describe the validation of prior learning - a process advocated by the European Union to make professional competences visible. Second, we describe the process how professional competences come about: through formal, non-formal and informal learning. Subsequently, we outline a knowledge-driven discourse on professional competences and discuss how different definitions of professional competence afford different approaches for its assessment. By presenting a use-case, we outline how the ICT-tool may guide applicants and assessors through this process

A knowledge-based framework to facilitate E-training implementation

Dissertação para obtenção do Grau de Mestre em Engenharia Eletrotécnica e de ComputadoresNowadays, there is an evident increase of the custom-made products or solutions demands with the objective to better fits to customer needs and profiles. Aligned with this, research in e-learning domain is focused in developing systems able to dynamically readjust their contents to respond to learners’ profiles demands. On the other hand, there is also an increase of e-learning developers which even not being from pedagogical curricula, as research engineers, needs to prepare e-learning programmes about their prototypes or products developed. This thesis presents a knowledge-based framework with the purpose to support the creation of e-learning materials, which would be easily adapted for an effective generation of custom-made e-learning courses or programmes. It embraces solutions for knowledge management, namely extraction from text & formalization and methodologies for collaborative e-learning courses development, where main objective is to enable multiple organizations to actively participate on its production. This also pursues the challenge of promoting the development of competencies, which would result from an efficient knowledge-transfer from research to industry