Collaboration scripts - a conceptual analysis

This article presents a conceptual analysis of collaboration scripts used in face-to-face and computer-mediated collaborative learning. Collaboration scripts are scaffolds that aim to improve collaboration through structuring the interactive processes between two or more learning partners. Collaboration scripts consist of at least five components: (a) learning objectives, (b) type of activities, (c) sequencing, (d) role distribution, and (e) type of representation. These components serve as a basis for comparing prototypical collaboration script approaches for face-to-face vs. computer-mediated learning. As our analysis reveals, collaboration scripts for face-to-face learning often focus on supporting collaborators in engaging in activities that are specifically related to individual knowledge acquisition. Scripts for computer-mediated collaboration are typically concerned with facilitating communicative-coordinative processes that occur among group members. The two lines of research can be consolidated to facilitate the design of collaboration scripts, which both support participation and coordination, as well as induce learning activities closely related to individual knowledge acquisition and metacognition. In addition, research on collaboration scripts needs to consider the learners’ internal collaboration scripts as a further determinant of collaboration behavior. The article closes with the presentation of a conceptual framework incorporating both external and internal collaboration scripts

Accounting students' IT applicaton skills over a 10-year period

This paper reports on the changing nature of a range of information technology (IT) application skills that students declare on entering an accounting degree over the period from 1996 to 2006. Accounting educators need to be aware of the IT skills students bring with them to university because of the implications this has for learning and teaching within the discipline and the importance of both general and specific IT skills within the practice and craft of accounting. Additionally, IT skills constitute a significant element within the portfolio of employability skills that are increasingly demanded by employers and emphasized within the overall Higher Education (HE) agenda. The analysis of students' reported IT application skills on entry to university, across a range of the most relevant areas of IT use in accounting, suggest that their skills have continued to improve over time. However, there are significant differential patterns of change through the years and within cohorts. The paper addresses the generalizability of these findings and discusses the implications of these factors for accounting educators, including the importance of recognising the differences that are potentially masked by the general increase in skills; the need for further research into the changing nature, and implications, of the gender gap in entrants' IT application skills; and the low levels of entrants' spreadsheet and database skills that are a cause for concern

Competency-based (CanMEDS) residency training programme in radiology: systematic design procedure, curriculum and success factors

Based on the CanMEDS framework and the European Training Charter for Clinical Radiology a new radiology curriculum was designed in the Netherlands. Both the development process and the resulting new curriculum are presented in this paper. The new curriculum was developed according to four systematic design principles: discursiveness, hierarchical decomposition, systematic variation and satisficing (satisficing is different from satisfying; in this context, satisficing means searching for an acceptable solution instead of searching for an optimal solution). The new curriculum is organ based with integration of radiological diagnostic techniques, comprises a uniform national common trunk followed by a 2-year subspecialisation, is competency outcome based with appropriate assessment tools and techniques, and is based on regional collaboration among radiology departments. The application of the systematic design principles proved successful in producing a new curriculum approved by all authorities. The principles led to a structured, yet flexible, development process in which creative solutions could be generated and adopters (programme directors, supervisors and residents) were highly involved. Further research is needed to empirically test the components of the new curriculum

Teaching evidence-based management with a focus on producing local evidence

We present an approach to teaching evidence-based management (EBMgt) that trains future managers how to produce local evidence. Local evidence is causally interpretable data, collected on-site in companies to address a specific business problem. Our teaching method is a variant of problem-based learning, a method originally developed to teach evidence-based medicine. Following this method, students learn an evidence-based problem-solving cycle for addressing actual business cases. Executing this cycle, students use and produce scientific evidence through literature searches and the design of local, experimental tests of causal hypotheses. We argue the value of teaching EBMgt with a focus on producing local evidence, how it can be taught, and what can be taught. We conclude by outlining our contribution to the literature on teaching EBMgt and by discussing limitations of our approach

Exploring the impact of cumulative testing on academic performance of undergraduate students in Spain

The final publication is available at Springer via http://dx.doi.org/10.1007/s11092-014-9208-zFrequent testing provides opportunities for students to receive regular feedback and to increase their motivation. It also provides the instructor with valuable information on how course progresses, thus making it possible to solve the problems encountered before it is too late. Frequent tests with noncumulative contents have been widely analysed in the literature with inconclusive results. However, cumulative testing methods have hardly been reported in higher education courses. This paper analyses the effect of applying an assessment method based on frequent and cumulative tests on student performance. Our results show that, when applied to a microeconomics course, students who were assessed by a frequent, cumulative testing approach largely outperformed those assessed with a single final exam.Doménech I De Soria, J.; Blázquez Soriano, MD.; De La Poza, E.; Muñoz Miquel, A. (2015). Exploring the impact of cumulative testing on academic performance of undergraduate students in Spain. Educational Assessment, Evaluation and Accountability. 27(2):153-169. https://doi.org/10.1007/s11092-014-9208-zS153169272Adelman, HS, & Taylor, L. (1990). Intrinsic motivation and school misbehaviour some intervention implications. Journal of Learning Disabilities, 23, 541–550.Biggs, J, & Tang, C. (2007). Teaching for quality learning at university 3rd edn. Open University Press.Boston, C. (2002). The concept of formative assessment. Practical Assessment Research & Evaluation 8.Brown, GA, Bull, J, Pendlebury, M. (1997). Assessing Student Learning in Higher Education, 1st edn. Routledge.Cano, MD. (2011). Students’ involvement in continuous assessment methodologies: a case study for a distributed information systems course. IEEE Transactions on Education, 54, 442–451.Casem, ML (2006). Active learning is not enough. Journal of College Science Teaching, 35.Chen, J, & Lin, TF. (2008). Class attendance and exam performance a randomized experiment. The Journal of Economic Education, 39, 213–227.Chickering, AW, & Gamson, ZF. (1987). Seven principles for good practice in undergraduate education. American Association for Higher Education Bulletin, 39, 3–7.Crooks, TJ. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58, 438–481.De Paola, M, & Scoppa, V. (2011). Frequency of examinations and student achievement in a randomized experiment. Economics of Education Review, 30, 1416–1429.Deck, W. (1998). The effects of frequency of testing on college students in a principles of marketing course, PhD thesis, Virginia Polytechnic Institute and State University. Virginia: Blacksburg.Dempster, FN. (1991). Synthesis of research on reviews and tests. Educational Leadership, 48, 71–76.Dochy, F. (2008). The Edumetric Quality of New Modes of Assessment: Some Issues and Prospects. Assessment, Learning and Judgement in Higher Education. Dordrecht: Springer Netherlands.Eikner, AE, & Montondon, L. (2001). Evidence on factors associated with success in intermediate accounting I. Accounting Educators’ Journal 13.Emerson, TLN, & Mencken, KD. (2011). Homework to require or not? online graded homework and student achievement Perspectives on Economic Education Research 7.Fulkerson, F, & Martin, G. (1981). Effects of exam frequency on student performance, evaluations of instructor, and test anxiety. Teaching of Psychology, 8, 90–93.Furnham, A, & Chamorro-Premuzic, T. (2005). Individual differences and beliefs concerning preference for university assessment methods. Journal of Applied Social Psychology, 35, 1968–1994.Gibbs, G, & Simpson, C. (2005). Conditions under which assessment supports students’ learning Learning and Teaching in Higher Education 1 (August 5, 2011)3–31.Haberyan, KA. (2003). Do weekly quizzes improve student performance on general biology exams?. The American Biology Teacher, 65, 110–114.Kling, N, McCorkle, D, Miller, C, Reardon, J. (2005). The impact of testing frequency on student performance in a marketing course. Journal of Education for Business, 81, 67–72.Kuh, GD (2003). What we’re learning about student engagement from NSSE Change 35.Kuo, T, & Simon, A. (2009). How many tests do we really need. College Teaching, 57, 156–160.Leeming, FC. (2002). The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology, 29, 210–212.Lumsden, KG, Scott, A, Becker, WE. (1987). The economics student reexamined Male-female differences in comprehension. Journal of Economic Education, 18, 365–375.Marriott, P. (2009). Students’ evaluation of the use of online summative assessment on an undergraduate financial accounting module. British Journal of Educational Technology, 40, 237–254.Marriott, P, & Lau, A. (2008). The use of on-line summative assessment in an undergraduate financial accounting course. Journal of Accounting Education, 26, 73–90.McNabb, R, Pal, S, Sloane, P. (2002). Gender differences in educational attainment. the case of university students in england and wales. Economica, 69, 481–503.Miller, F. (1987). Test frequency, student performance and teacher evaluation in the basic marketing class. Journal of Marketing Education, 9, 14–19.Nicol, DJ, & Macfarlane Dick, D. (2006). Formative assessment and self-regulated learning, A model and seven principles of good feedback practice. Studies in Higher Education, 31, 199–218.Nowell, C, & Alston, RM. (2007). I thought I got an A! Overconfidence across the economics curriculum. The Journal of Economic Education, 38, 131–142.Race, P (1995). The art of assessing 1 New Academic 4.Scriven, M. (1967). The Methodology of Evaluation, vol 1 (pp. 39–83). Chicago: Rand McNally.Skinner, BF. (1974). About behaviorism. New York: Alfred A Knopf.Taras, M. (2005). Assessment - summative and formative - some theoretical reflections. British Journal of Educational Studies, 53, 466–478.Trotter, E. (2006). Student perceptions of continuous summative assessment. Assessment & Evaluation in Higher Education, 31, 505–521.Yorke, M. (2003). Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education, 45, 477–501

Online peer assessment in higher education: a systematic review of literature in educational practices

Neste artigo procedemos a uma revisão sistemática da literatura sobre Online Peer Assessment (OPA) no Ensino Superior, mediadas por Tecnologias Digitais de Informação e Comunicação (TIC). Identificamos suas características, centrais e opcionais e mapeamos exemplos práticos (procedimentos e TIC) de OPA que poderão ser transversais, adaptáveis e aplicáveis em diversas unidades curriculares e regimes educacionais. Os resultados apontam para a utilização da OPA como uma estratégia que potencia a “avaliação para a aprendizagem”. Os referenciais teóricos subjacentes, os métodos de avaliação e os tipos de TIC utilizadas indicam seu direcionamento para um maior envolvimento e responsabilidade do aluno na sua aprendizagem. Evidenciamos na literatura que se busca desenvolver essas competências, dando ao aluno oportunidades com alguma regularidade para autoavaliar-se e avaliar seus pares por meio de feedback construtivo. Há também evidências de que dar ou produzir feedback é mais benéfico para a aprendizagem do que apenas recebê-lo, como também é cognitivamente mais exigente e envolve os alunos de forma mais ativa e os direciona ao pensamento crítico e a processos metacognitivos. A partir dos resultados alcançados, consideramos que a OPA, enquanto ferramenta cognitiva, contribui para a construção do conhecimento e para a reflexão sobre a aprendizagem. Um desafio que se coloca diz respeito ao desenvolvimento criativo com foco na diversificação e na inovação das práticas de avaliação no sentido de potenciar aprendizagens e resultados acadêmicos, em atenção às necessidades de aprendizagem que se manifestam frente às expectativas da educação atual e futura e às exigências da sociedade.In this research a systematic review of literature about Online Peer Assessment (OPA) in higher education, mediated by Information and Communication Technology (ICT), was carried out. Optional and central characteristics and its practices (procedures and ICT) were identified and mapping. These procedures and practices may be transversal, adaptable and applied in several curriculum units and educational regimes. The results point to the use of OPA as a strategy that enhances “assessment for learning”. The theoretical framework, the methods of assessment and the kinds of ICT used indicate directions for greater involvement and responsibility from the part of the student in his/her learning. Theoretical framework identifies the need to develop students’ skills, providing them with opportunities for self-assessment and peer assessment on a regular basis through constructive feedback. There is also evidence that to give or receive feedback is more beneficial for learning than just receiving it. It is also cognitively more demanding and directs the students to critical thinking and metacognitive processes. From the results obtained, OPA is seen as a cognitive tool, contributing to the building of knowledge and to reflection about learning. Issues for further reflection are also identified such as the creative development of assessment methods with a focus on diversity and innovation in order to enhance students’ learning and academic results, taking into account their learning needs in face of the expectations of current and future education and the demands of society.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), PortugalFundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio

Barriers to the uptake and use of feedback in the context of summative assessment

Despite calls for feedback to be incorporated in all assessments, a dichotomy exists between formative and summative assessments. When feedback is provided in a summative context, it is not always used effectively by learners. In this study we explored the reasons for this. We conducted individual interviews with 17 students who had recently received web based feedback following a summative assessment. Constant comparative analysis was conducted for recurring themes. The summative assessment culture, with a focus on avoiding failure, was a dominant and negative influence on the use of feedback. Strong emotions were prevalent throughout the period of assessment and feedback, which reinforced the focus on the need to pass, rather than excel. These affective factors were heightened by interactions with others. The influence of prior learning experiences affected expectations about achievement and the need to use feedback. The summative assessment and subsequent feedback appeared disconnected from future clinical workplace learning. Socio-cultural influences and barriers to feedback need to be understood before attempting to provide feedback after all assessments. A move away from the summative assessment culture may be needed in order to maximise the learning potential of assessments