Measuring adaptive expertise: development and validation of an instrument

Individuals with adaptive expertise possess the skills to deal with novel problems. Whereas this concept has been around since the mid-1980s, no instrument exists that provides a good operationalization of the theoretical construct. This inhibits the further development of research on adaptive expertise and the evaluation of employees' adaptive expertise levels. Adaptive expertise has been unanimously described as a composition of domain-specific and innovative skills. Some researchers argue that metacognitive skills are also crucial. This study aimed to establish whether an instrument measuring adaptive expertise is composed of these three dimensions. In addition, it was tested whether such an instrument is influenced by task variety and work experience, as previously reported in literature. A sample of 383 professionals and graduates were used to test the Adaptive Expertise Inventory. Through exploratory factor analysis (EFA), (E/CFA), and confirmatory factor analysis (CFA), the quality of the instrument was evaluated. Good model fit was achieved. The final instrument consisted of two dimensionsi.e., domain-specific and innovative skillswith five items each. Regression analysis showed that not work experience, but task variety is related to level of adaptive expertise. The Adaptive Expertise Inventory proved to be a valid instrument for measuring adaptive expertise

Student participation in the design of learning and teaching: Disentangling the terminology and approaches

Background: Students are ever more involved in the design of educational practices, which is reflected in the growing body of literature about approaches to student participation. Similarities and differences between these approaches often remain vague since the terms are used interchangeably. This confusing and fragmented body of literature hampers our understanding the process and outcomes of student participation and choosing the most suitable approach for it. Method: We identified the three most frequently used terms related to the design of learning and teaching–design-based research (DBR), participatory design (PD), and co-creation–and disentangled the terminology by focusing on relevant definitions, aims, involvement of students, outcomes, and related terminology. Results: Differences between the approaches to student participation can be found in the degree to which students are the central actors and the degree to which the design is informed by educational theory. Conclusion: It is important to align the level of student participation with the purpose of the approach

Changing the culture of assessment: the dominance of the summative assessment paradigm

Background Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students’ use of assessment-related feedback. Methods Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. Results Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants’ prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. Conclusions Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step

Overcoming the barriers of teaching physical examination at the bedside: More than just curriculum design

Background: Physicians in training must achieve a high degree of proficiency in performing physical examinations and must strive to become experts in the field. Concerns are emerging about physicians' abilities to perform these basic skills, essential for clinical decision making. Learning at the bedside has the potential to support skill acquisition through deliberate practice. Previous skills improvement programs, targeted at teaching physical examinations, have been successful at increasing the frequency of performing and teaching physical examinations. It remains unclear what barriers might persist after such program implementation. This study explores residents' and physicians' perceptions of physical examinations teaching at the bedside following the implementation of a new structured bedside curriculum: What are the potentially persisting barriers and proposed solutions for improvement? Methods: The study used a constructivist approach using a qualitative inductive thematic analysis that was oriented to construct an understanding of the barriers and facilitators of physical examination teaching in the context of a new bedside curriculum. Participants took part in individual interviews and subsequently focus groups. Transcripts were coded and themes were identified. Results: Data analyses yielded three main themes: (1) the culture of teaching physical examination at the bedside is shaped and threatened by the lack of hospital support, physicians' motivation and expertise, residents' attitudes and dependence on technology, (2) the hospital environment makes bedside teaching difficult because of its chaotic nature, time constraints and conflicting responsibilities, and finally (3) structured physical examination curricula create missed opportunities in being restrictive and pose difficulties in identifying patients with findings. Conclusions: Despite the implementation of a structured bedside curriculum for physical examination teaching, our study suggests that cultural, environmental and curriculum-related barriers remain important issues to be addressed. Institutions wishing to develop and implement similar bedside curricula should prioritize recruitment of expert clinical teachers, recognizing their time and efforts. Teaching should be delivered in a protected environment, away from clinical duties, and with patients with real findings. Physicians must value teaching and learning of physical examination skills, with multiple hands-on opportunities for direct role modeling, coaching, observation and deliberate practice. Ideally, clinical teachers should master the art of combining both patient care and educational activities

Learners in a Changing Learning Landscape: Reflections from an Instructional Design Perspective

Van Merriënboer, J. J. G., & Stoyanov, S. (2008). Learners in a changing learning landscape: Reflections from an instructional design perspective. In J. Visser & M. Visser-Valfrey (Eds.), Learners in a changing learning landscape: Reflections from a dialogue on new roles and expectations (pp. 69-90). Dordrecht, The Netherlands: Springer.Both learners and teachers find themselves in a learning landscape that is rapidly changing, along with fast societal and technological developments. This paper discusses the new learning landscape from an instructional design perspective. First, with regard to what is learned, people more than ever need flexible problem-solving and reasoning skills allowing them to deal with new, unfamiliar problem situations in their professional and everyday life. Second, with regard to the context in which learning takes place, learning in technology-rich, informal and professional 24/7 settings is becoming general practice. And third, with regard to the learners themselves, they can more often be characterized as lifelong learners who are mature, bring relevant prior knowledge, and have very heterogeneous expectations and perceptions of learning. High-quality instructional design research should focus on the question which instructional methods and media-method combinations are effective, efficient and appealing in this new learning landscape. Some innovative instructional methods that meet this requirement are discussed

Barriers to the uptake and use of feedback in the context of summative assessment

Despite calls for feedback to be incorporated in all assessments, a dichotomy exists between formative and summative assessments. When feedback is provided in a summative context, it is not always used effectively by learners. In this study we explored the reasons for this. We conducted individual interviews with 17 students who had recently received web based feedback following a summative assessment. Constant comparative analysis was conducted for recurring themes. The summative assessment culture, with a focus on avoiding failure, was a dominant and negative influence on the use of feedback. Strong emotions were prevalent throughout the period of assessment and feedback, which reinforced the focus on the need to pass, rather than excel. These affective factors were heightened by interactions with others. The influence of prior learning experiences affected expectations about achievement and the need to use feedback. The summative assessment and subsequent feedback appeared disconnected from future clinical workplace learning. Socio-cultural influences and barriers to feedback need to be understood before attempting to provide feedback after all assessments. A move away from the summative assessment culture may be needed in order to maximise the learning potential of assessments

Teacher Perspectives on Whole-Task Information Literacy Instruction

This paper presents results of an explorative study on perceived merits of contemporary holistic approaches to designing information literacy instruction in a university setting. Seven teachers in educational sciences evaluated their premaster’s course on conducting a literature review designed according to a modern design approach, named Four-Component Instructional Design (4C/ID). They noted their perceptions on course quality by means of a standardized course evaluation questionnaire and a SWOT analysis. Results of the questionnaire showed that teachers were positive on whole-task information literacy instruction, confirming the results of an earlier study on 4C/ID-caused instructional effects. The SWOT analysis indicated that teachers recognized the value of applied 4C/ID principles like whole-task-centeredness, structured guidance, and scaffolding. We added suggestions on enhancing the positive effects of whole-task instructional design based on identified educational weaknesses such as relatively poor constructive alignment and threats such as imperfect curriculum coherence

Young Children’s Use of Personalized Technologies: Insights From Teachers and Digital Software Designers in Japan

Many smart technologies offer personalized experiences, such as the possibility for children to record their voice, add their own pictures or drawings to digital stories, customize their avatars or adjust display settings to their needs. This study examined the views of teachers and digital software designers on children’s use of smart personalized technologies in Japan. Sixteen teachers and two designers from Japan took part in semi-structured interviews on the school or company premises in Tokyo and Osaka. Thematic analysis of the transcripts yielded three themes: agency, privacy and autonomy, which we consider through the lens of socio-materiality. While there were clear concerns about the protection of children’s privacy with personalized technologies, children’s agency and autonomy in using them was perceived both as a benefit and limitation of digital personalization features. The participants’ paradoxical perceptions of the risks and benefits of personalization point to a complex socio-technological model of personalization that is embedded in children’s smart technologies and influences adults’ views on their use in early education. Our findings have implications for informing and theorising the design of personalization features in digital technologies