Toward a document evaluation methodology: What does research tell us about the validity and reliability of evaluation methods?

Although the usefulness of evaluating documents has become generally accepted among communication professionals, the supporting research that puts evaluation practices empirically to the test is only beginning to emerge. This article presents an overview of the available research on troubleshooting evaluation methods. Four lines of research are distinguished concerning the validity of evaluation methods, sample composition, sample size, and the implementation of evaluation results during revisio

How authentic should a learning context be? Using real and simulated profiles in a classroom intervention to improve safety on social network sites

With the rise of social network sites (SNSs), there is an increasing need for safety education within the current cyber society. To this end, a variety of educational materials have been developed to prepare children to be vigilant when interacting on such sites. However, little is known about the critical design aspects necessary to make these materials effective. In this study, we build on the results of two previous studies, in which we found that general instructional principles drawn from constructivism, such as collaborative learning, are not always appropriate to teach children how to behave safely online. This study therefore focuses on the importance of authentic learning and active learning as critical design features. A quasi-experimental study was conducted in secondary schools in order to compare the impact of two classroom interventions about the risks on SNSs. As part of the intervention, students were presented scaffolds towards different risks related to an SNS-profile through a series of questions. In the control condition, these questions concerned a simulated SNS-profile on paper containing signs of many risks. In the experimental condition, students had to answer the same questions about their own SNS-profile on a computer. It was hypothesized that the simulated profile would not be experienced as realistic, and that students would have difficulties identifying with it. On the other hand, teenagers were expected to be able to recognize more risks on the simulated ‘worst-case scenario’ profile than on their own profile, which would facilitate the scaffolding process in the control condition. The results of the study mostly confirmed these hypotheses. Furthermore, the question arose as to whether the intervention based on the student’s own rea listic profile was educationally more valuable than the intervention based on the simulated profile, but no such added value was found. On the contrary, the scaffolding questions about the simulated profile were found to be more effective in teaching the teenagers about the different categories of risks that were tackled. Based on these findings, the importance of an authentic setting was put into perspective. Within the context of a classroom intervention to promote safety on SNSs, the exercise based on the simulated SNS-profile is put forward as the more effective teaching strategy

‘The best app is the teacher’ introducing classroom scripts in technology-enhanced education

A quasi-experimental study was set up in secondary education to study the role of teachers while implementing tablet devices in science education. Three different classroom scripts that guided students and teachers' actions during the intervention on two social planes (group and classroom level) are compared. The main goal was to investigate which classroom script leads to the best results regarding progress in domain-specific knowledge and inquiry skills. Besides student achievement, students' experiences towards the role of the teacher and students' perceptions towards learning with tablets within the three conditions were investigated. In the first condition, the classroom script included learning activities that were balanced between the group and the classroom level. In the second condition, the learning activities occurred predominantly on the group level. The third condition entailed the classroom script as the control condition in which the learning activities were situated only on the classroom level, with the tablet used in a traditional way or as ‘book behind glass’. Results show that students perform better on domain-specific knowledge in the conditions where the teacher intervened on the classroom level. Regarding the acquisition of inquiry skills, students performed best in the condition where the learning activities were balanced between the group and the classroom level. Moreover, students who perceived more structure achieved better. These results indicate that the role of the teacher cannot be ignored in technology-enhanced learning. Moreover, these results seem to suggest that one of the best apps remains the teacher

The impact of tablet devices on high school students' cognitive load and learning

P

Roles as a structuring tool in online discussion groups: the differential impact of different roles on social knowledge construction

A