Testing like you teach: The challenge of constructing local, ecologically valid tests

In an educational context, local, ecologically valid tests can reflect the use of literacy and thinking tools. These tests present a challenge to central, content focused, high-stakes testing, and to transmission approaches to teaching. They require teachers to accept knowledge as a verb, and to design assessment protocols that reflect co-constructive ways of teaching. This article reports the outcome of praxis action research with middle and secondary school teachers who incorporated topic-appropriate literacy and thinking tools into their teaching. They also redesigned their local tests linked to high-stakes test protocols to reflect the use of these tools. A thematic analysis of observations and interviews suggests that this process impacted on the structural characteristics (morés) of the schools, and posed affective, cognitive and pedagogical challenges to teachers

Using personal narratives to explore multiple identities in organisational contexts

Purpose The purpose of this paper is to explore and incorporate personal narratives as a new methodological tool into the qualitative research of complex organisational issues such as identity. Particularly, this study provides a fresh methodological perspective on organisational identity exploration by using personal narratives to examine multiple identities that occur in dynamic organisational contexts. Design/methodology/approach In order to examine multiple identities, personal narratives found in the 43 semi-structured in-depth interviews collected were analysed. These narratives were examined following a textual and performative analysis. Findings The paper furthers methodological discussions in organisations in three ways. First, it responds to the need for a methodological approach that allows multiple identity exploration in organisations while it presents personal narratives as a valuable methodological perspective within organisational research. Second, it extends the methodological use of personal narratives for the in-depth qualitative study of complex organisational issues such as identity. Finally, the study stretches the boundaries of mainstream organisational research by illustrating that personal narratives can be used as a methodological approach to explore organisational identities. Originality/value This research integrates personal narratives as a methodological tool into the qualitative research of dynamic organisational issues. Employing personal narratives has allowed the exploration of multiple identities that take place in organisations in a manner not previously achieved in organisational studies. The study, therefore, challenges previous organisational research and expands the boundaries of organisational identity studies, offering a new qualitative methodological account for identity exploration in organisations

Do coursework summative assessments predict clinical performance? A systematic review

BACKGROUND: Two goals of summative assessment in health profession education programs are to ensure the robustness of high stakes decisions such as progression and licensing, and predict future performance. This systematic and critical review aims to investigate the ability of specific modes of summative assessment to predict the clinical performance of health profession education students. METHODS: PubMed, CINAHL, SPORTDiscus, ERIC and EMBASE databases were searched using key terms with articles collected subjected to dedicated inclusion criteria. Rigorous exclusion criteria were applied to ensure a consistent interpretation of ‘summative assessment’ and ‘clinical performance’. Data were extracted using a pre-determined format and papers were critically appraised by two independent reviewers using a modified Downs and Black checklist with level of agreement between reviewers determined through a Kappa analysis. RESULTS: Of the 4783 studies retrieved from the search strategy, 18 studies were included in the final review. Twelve were from the medical profession and there was one from each of physiotherapy, pharmacy, dietetics, speech pathology, dentistry and dental hygiene. Objective Structured Clinical Examinations featured in 15 papers, written assessments in four and problem based learning evaluations, case based learning evaluations and student portfolios each featured in one paper. Sixteen different measures of clinical performance were used. Two papers were identified as ‘poor’ quality and the remainder categorised as ‘fair’ with an almost perfect (k = 0.852) level of agreement between raters. Objective Structured Clinical Examination scores accounted for 1.4–39.7% of the variance in student performance; multiple choice/extended matching questions and short answer written examinations accounted for 3.2–29.2%; problem based or case based learning evaluations accounted for 4.4–16.6%; and student portfolios accounted for 12.1%. CONCLUSIONS: Objective structured clinical examinations and written examinations consisting of multiple choice/extended matching questions and short answer questions do have significant relationships with the clinical performance of health professional students. However, caution should be applied if using these assessments as predictive measures for clinical performance due to a small body of evidence and large variations in the predictive strength of the relationships identified. Based on the current evidence, the Objective Structured Clinical Examination may be the most appropriate summative assessment for educators to use to identify students that may be at risk of poor performance in a clinical workplace environment. Further research on this topic is needed to improve the strength of the predictive relationship. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12909-017-0878-3) contains supplementary material, which is available to authorized users

Enhanced Web-Based Otitis Study Case vs Simple Paper-Case: Impact on Medical Student Objec-tive Structured Clinical Exam (OSCE) Performance

Background: Distance education methods have taken on greater importance as medical student education has moved off campus into the community. What the best methods are for conveying information to students at distant sites has not been determined. Objective: To determine if students at distant community sites who received an otitis media study case by e-mail that was enhanced with a referral to a web-based otitis study case, performed better on otitis OSCE stations than students who received the same case not enhanced with visuals or referrals to a web-based otitis case. Design/Methods: Students were randomized by community site to receive either the enhanced (E) or simple otitis study case (S). Students were e-mailed an otitis media study case during the 5th week of the rotation. Those randomized to the E-case received a case that started with a case scenario followed by a "Task" that instructed them to go to this web address: http://www.aap.org/otitismedia/www/vc/ear/index.cfm (American Academy of Pediatrics Otitis Web Site). They were then to select "Case 1" which was a continuation of the case scenario present on their e-mail. A list of learning objectives was also printed on the e-mail. Students receiving the S-case viewed the same case scenario and objectives, but were not instructed to go to the web page. All students rotated through two OSCE otitis stations. In the first station they interviewed a simulated patient(OSCE-SP) and counseled her on the management of her 12 month old with otitis. Within that station they viewed a video of a pneumoscopic exam of two ears, one ear with otitis and the other ear normal. At the 2nd otitis station the student presented the case to a faculty and was asked a series of questions about otitis media(OSCE-PR). Scores on the two stations were compared by group. Results: There were 198 students who took the OSCE. 178 (90%) responded to a survey that indicated they had opened and read the e-mailed case. There were 87 students in the E-group and 91 in the S-group. The mean ±s.d. OSCE-SP station score for the E-group was 72.6 ±12.0 vs 75.4 ±9.8 for the S-group, p=0.09. For the otitis presentation station the scores for the E-group and S-group were respectively, 82.9 ±9.6 and 83.7 ±9.4, p=0.55. Conclusions: These data suggest that enhanced visual distance education cases may offer no distinct advantage over simple paper-type case study guide

Webs of activity in online course design and teaching

In this study, we followed three faculty members' experiences with designing and teaching online courses for the first time. In order to complete the activity, the faculty members had to work -collaboratively with others across the university. Activity theory provided a framework within which to study faculty members' collaborative activities with members of different activity systems that had different goals, tools, divisions of labor and accountabilities. In concordance with activity theory, such differences led to contradictions, disturbances, and transformations in thinking and work activities. The results of the study have implications for individuals and systems undertaking technology integration in teaching

A Project Based Approach to Statistics and Data Science

In an increasingly data-driven world, facility with statistics is more important than ever for our students. At institutions without a statistician, it often falls to the mathematics faculty to teach statistics courses. This paper presents a model that a mathematician asked to teach statistics can follow. This model entails connecting with faculty from numerous departments on campus to develop a list of topics, building a repository of real-world datasets from these faculty, and creating projects where students interface with these datasets to write lab reports aimed at consumers of statistics in other disciplines. The end result is students who are well prepared for interdisciplinary research, who are accustomed to coping with the idiosyncrasies of real data, and who have sharpened their technical writing and speaking skills

A Multimedia Interactive Environment Using Program Archetypes: Divide-and-Conquer

As networks and distributed systems that can exploit parallel computing become more widespread, the need for ways to teach parallel programming effectively grows as well. Even though many colleges and universities provide courses on parallel programming [1], most of those courses are reserved for graduate students and advanced undergraduates. There is a demand for ways to teach fundamental parallel programming concepts to people with just a working knowledge of programming. By using the idea of a software archetype, and providing a learning environment that teaches both concept and coding, we hope to satisfy this need. This paper presents an overview of the multimedia approach we took in teaching parallel programming and offers Divide-and-Conquer as an example of its use

Persuasive Technology for Learning in Business Context

"Persuasive Design is a relatively new concept which employs general principles of persuasion that can be implemented in persuasive technology. This concept has been introduced by BJ Fogg in 1998, who since then has further extended it to use computers for changing attitudes and behaviour. Such principles can be applied very well in learning and teaching: in traditional human-led learning, teachers always have employed persuasion as one of the elements of teaching. Persuasive technology moves these principles into the digital domain, by focusing on technology that inherently stimulates learners to learn more quickly and effectively. This is very relevant for the area of Business Management in several aspects: Consumer Behavior, Communications, Human Resource, Marketing & Advertising, Organisational Behavior & Leadership. The persuasive principles identified by BJ Fogg are: reduction, tunnelling, tailoring, suggestion, self-monitoring, surveillance, conditioning, simulation, social signals. Also relevant is the concept of KAIROS, which means the just-in-time, at the right place provision of information/stimulus. In the EuroPLOT project (2010-2013) we have developed persuasive learning objects and tools (PLOTs) in which we have applied persuasive designs and principles. In this context, we have developed a pedagogical framework for active engagement, based on persuasive design in which the principles of persuasive learning have been formalised in a 6-step guide for persuasive learning. These principles have been embedded in two tools – PLOTmaker and PLOTLearner – which have been developed for creating persuasive learning objects. The tools provide specific capability for implementing persuasive principles at the very beginning of the design of learning objects. The feasibility of employing persuasive learning concepts with these tools has been investigated in four different case studies with groups of teachers and learners from realms with distinctly different teaching and learning practices: Business Computing, language learning, museum learning, and chemical substance handling. These case studies have involved the following learner target groups: school children, university students, tertiary students, vocational learners and adult learners. With regards to the learning context, they address archive-based learning, industrial training, and academic teaching. Alltogether, these case studies include participants from Sweden, Africa (Madagascar), Denmark, Czech Republic, and UK. One of the outcomes of this investigation was that one cannot apply a common set of persuasive designs that would be valid for general use in all situations: on the contrary, the persuasive principles are very specific to learning contexts and therefore must be specifically tailored for each situation. Two of these case studies have a direct relevance to education in the realm of Business Management: Business Computing and language learning (for International Business). In this paper we will present the first results from the evaluation of persuasive technology driven learning in these two relevant areas.