Meta-evaluation of the impacts and legacy of the London 2012 Olympic Games and Paralympic Games : Developing methods paper

This report brings together the interim findings from the Developing Meta-Evaluation Methods study, which is being undertaken in conjunction with the Meta-Evaluation of the Impacts and Legacy of the London 2012 Olympic Games and Paralympic Games. The work on methods is funded by the Economic and Social Research Council (ESRC). The aim of this paper is to review the existing evidence on conducting meta-evaluation, and provide guidance appropriate to the Meta Evaluation of the Games as well as other meta-evaluation studies

A toolkit modeling approach for sustainable forest management planning: Achieving balance between science and local needs

To assist forest managers in balancing an increasing diversity of resource objectives, we developed a toolkit modeling approach for sustainable forest management (SFM). The approach inserts a meta-modeling strategy into a collaborative modeling framework grounded in adaptive management philosophy that facilitates participation among stakeholders, decision makers, and local domain experts in the meta-model building process. The modeling team works iteratively with each of these groups to define osential questions, identify data resources, and then determine whether available tools can be applied or adapted, or whether new tools can be rapidly created to fit the need. The desired goal of the process is a linked series of domain-specific models (tools) that balances generalized "top-down" models (i.e., scientific models developed without input from the local system) with case-specific customized "bottom-up" models that are driven primarily by local needs. Information flow between models is organized according to vertical (i.e., between scale) and horizontal (i.e., within scale) dimensions. We illustrate our approach within a 2.1 million hectare forest planning district in central Labrador, a forested landscape where social hnd ecological values receive a higher priority than economic values. However, the focus of this paper is on the process of how SFM modeling tools and concepts can be rapidly assembled and applied in new locations, balancing efficient transfer of science with adaptation to local needs. We use the Labrador case study to illustrate strengths and challenges uniquely associated with a meta-modeling approach to integrated modeling as it fits within the broader collaborative modeling framework. Principle advantages of the approach include the scientific rigor introduced by peer-reviewed models, combined with the adaptability of meta-modeling. A key challenge is the limited transparency of scientific models to different participatory groups. This challenge can be overcome by frequent and substantive two-way communication among different groups at appropriate times in the model-building process, combined with strong leadership that includes strategic choices when assembling the modeling team. The toolkit approach holds promise for extending beyond case studies, without compromising the bottom-up flow of needs and information, to inform SFM planning using the best available science

A framework to analyze argumentative knowledge construction in computer-supported collaborative learning

Computer-supported collaborative learning (CSCL) is often based on written argumentative discourse of learners, who discuss their perspectives on a problem with the goal to acquire knowledge. Lately, CSCL research focuses on the facilitation of specific processes of argumentative knowledge construction, e.g., with computer-supported collaboration scripts. In order to refine process-oriented instructional support, such as scripts, we need to measure the influence of scripts on specific processes of argumentative knowledge construction. In this article, we propose a multi-dimensional approach to analyze argumentative knowledge construction in CSCL from sampling and segmentation of the discourse corpora to the analysis of four process dimensions (participation, epistemic, argumentative, social mode)

Weight of evidence: a framework for the appraisal of the quality and relevance of evidence

Knowledge use and production is complex and so also are attempts to judge its quality. Research synthesis is a set of formal processes to determine what is known from research in relation to different research questions and this process requires judgements of the quality and relevance of the research evidence considered. Such judgement can be according to generic standards or be specific to the review question. The judgements interact with other judgements in the review process such as inclusion criteria and search strategies and can be absolute or weighted judgements combined in a weight of evidence framework. Judgments also vary depending upon the type of review that can range from statistical meta analysis to meta ethnography. Empirical study of the ways that quality and relevance judgements are made can illuminate the nature of such decisions and their impact on epistemic and other domains of knowledge. Greater clarity about such ideological and theoretical differences can enable greater participative debates about such differences

The effectiveness of teamwork training on teamwork behaviors and team performance : A systematic review and meta-analysis of controlled interventions

The objective of this study was to conduct a systematic review and meta-analysis of teamwork interventions that were carried out with the purpose of improving teamwork and team performance, using controlled experimental designs. A literature search returned 16,849 unique articles. The meta-analysis was ultimately conducted on 51 articles, comprising 72 (k) unique interventions, 194 effect sizes, and 8439 participants, using a random effects model. Positive and significant medium-sized effects were found for teamwork interventions on both teamwork and team performance. Moderator analyses were also conducted, which generally revealed positive and significant effects with respect to several sample, intervention, and measurement characteristics. Implications for effective teamwork interventions as well as considerations for future research are discussed

Dimensions of web site credibility and their relation to active trust and behavioural impact

This paper discusses two trends that threaten to undermine the effectiveness of online social marketing interventions: growing mistrust and competition. As a solution, this paper examines the relationships between Web site credibility, target audiences’ active trust and behaviour. Using structural equation modelling to evaluate two credibility models, this study concludes that Web site credibility is best considered a three-dimensional construct composed of expertise, trustworthiness and visual appeal, and that trust plays a partial mediating role between Web site credibility and behavioural impacts. The paper examines theoretical implications of conceptualizing Web sites according to a human credibility model, and factoring trust into Internet-based behavioural change interventions. Practical guidelines suggest ways to address these findings when planning online social marketing interventions