Analytic frameworks for assessing dialogic argumentation in online learning environments

Over the last decade, researchers have developed sophisticated online learning environments to support students engaging in argumentation. This review first considers the range of functionalities incorporated within these online environments. The review then presents five categories of analytic frameworks focusing on (1) formal argumentation structure, (2) normative quality, (3) nature and function of contributions within the dialog, (4) epistemic nature of reasoning, and (5) patterns and trajectories of participant interaction. Example analytic frameworks from each category are presented in detail rich enough to illustrate their nature and structure. This rich detail is intended to facilitate researchers’ identification of possible frameworks to draw upon in developing or adopting analytic methods for their own work. Each framework is applied to a shared segment of student dialog to facilitate this illustration and comparison process. Synthetic discussions of each category consider the frameworks in light of the underlying theoretical perspectives on argumentation, pedagogical goals, and online environmental structures. Ultimately the review underscores the diversity of perspectives represented in this research, the importance of clearly specifying theoretical and environmental commitments throughout the process of developing or adopting an analytic framework, and the role of analytic frameworks in the future development of online learning environments for argumentation

Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Improvable objects and attached dialogue: new literacy practices employed by learners to build knowledge together in asynchronous settings

Asynchronous online dialogue offers advantages to learners, but has appeared to involve only limited use of new literacy practices. To investigate this, a multimodal approach was applied to asynchronous dialogue. The study analysed the online discussions of small groups of university students as they developed collaboratively authored documents. Sociocultural discourse analysis of the dialogue was combined with visual analysis of its structural elements. The groups were found to employ new literacies that supported the joint construction of knowledge. The documents on which they worked together functioned as ‘improvable objects’ and the development of these was associated with engagement in ‘attached dialogue’. By investigating a wider range of conference dialogue than has previously been explored, it was found that engaging in attached dialogue associated with collaborative authorship of improvable objects prompts groups of online learners to share knowledge, challenge ideas, justify opinions, evaluate evidence and consider options

Learning through online discussion: a case of triangulation in research

This paper reports on issues in carrying out research into online discussion. The context is a study of a distance learning module within an MBA program. The module required students to tackle problems based on real life scenarios within small online groups. Students were studying part time and shared similar professional backgrounds. The research looked at students' overall evaluation of the module, ways in which group work was conducted, and the contribution of the tutor. The approach taken was an interpretive case study using questionnaire survey, text analysis and interviews. The main findings from the study are reported, but the focus is on the strengths of, and difficulties in, using the research methods. Triangulation of methods provides the researcher with a greater degree of confidence in reporting findings, although subjective interpretation is still needed

Transforming pre-service teacher curriculum: observation through a TPACK lens

This paper will discuss an international online collaborative learning experience through the lens of the Technological Pedagogical Content Knowledge (TPACK) framework. The teacher knowledge required to effectively provide transformative learning experiences for 21st century learners in a digital world is complex, situated and changing. The discussion looks beyond the opportunity for knowledge development of content, pedagogy and technology as components of TPACK towards the interaction between those three components. Implications for practice are also discussed. In today’s technology infused classrooms it is within the realms of teacher educators, practising teaching and pre-service teachers explore and address effective practices using technology to enhance learning

Teaching and learning in virtual worlds: is it worth the effort?

Educators have been quick to spot the enormous potential afforded by virtual worlds for situated and authentic learning, practising tasks with potentially serious consequences in the real world and for bringing geographically dispersed faculty and students together in the same space (Gee, 2007; Johnson and Levine, 2008). Though this potential has largely been realised, it generally isn’t without cost in terms of lack of institutional buy-in, steep learning curves for all participants, and lack of a sound theoretical framework to support learning activities (Campbell, 2009; Cheal, 2007; Kluge & Riley, 2008). This symposium will explore the affordances and issues associated with teaching and learning in virtual worlds, all the time considering the question: is it worth the effort

Attitudes of Undergraduate Social Work Students Toward Interprofessional Health Care Practice and Interprofessional Health Care Education

In 2005, the Centre for Collaborative Health Professional Education at Memorial University in Canada commenced an inquiry into the interprofessional education (IPE) of social work students. In the 2005/2006 academic year, undergraduate social work students were introduced to an IPE program at Memorial University for the first time. This interdisciplinary initiative brought together students from pharmacy, nursing, medicine, and social work to develop and encourage interprofessional educational activities with the purpose of increasing collaborative patient-centered practice competencies of students and professionals (Sharpe & Curran, 2006). In the subsequent three academic years (2005/2006, 2006/2007, 2007/2008) Bachelor of Social Work (BSW) students explored a variety of IPE modules. This paper summarizes the available literature on the topic of IPE and reports on data collected from three cohorts of undergraduate social work students regarding their attitudes toward interdisciplinary team practice. Data collected are in relation to the Health and Wellbeing of Children module, one of the five module topics in which these students participated over the three-year period. It is proposed that by understanding student attitudes as they are evidenced at this early stage of professional development, valuable information will be provided to educators to inform best practices in the teaching and learning of interprofessional practice skills within the discipline of social work. Finally, the authors provide suggested directions for future research

From multiple perspectives to shared understanding

The aim of this study was to explore how learners operating in a small group reach shared understanding as they work out joint research questions and build a theoretical framework and to identify the resources and tools they used in the process. The learners’ own interpretations of their group activities and learning were also taken into account. The data, consisting of group discussions and the documents produced by the group, were subjected to a qualitative content analysis. The group members employed a variety of resources and tools to exchange their individual perspectives and achieve shared understanding. Summaries of relevant literature laid a foundation for the group’s theoretical discussions. Reflective comparisons between their book knowledge and their personal experiences of online interaction and collaboration were frequent, suggesting that such juxtapositions may have enhanced their learning by intertwining the content to be mastered and the activities entailed by this particular content

Dialogue as Data in Learning Analytics for Productive Educational Dialogue

This paper provides a novel, conceptually driven stance on the state of the contemporary analytic challenges faced in the treatment of dialogue as a form of data across on- and offline sites of learning. In prior research, preliminary steps have been taken to detect occurrences of such dialogue using automated analysis techniques. Such advances have the potential to foster effective dialogue using learning analytic techniques that scaffold, give feedback on, and provide pedagogic contexts promoting such dialogue. However, the translation of much prior learning science research to online contexts is complex, requiring the operationalization of constructs theorized in different contexts (often face-to-face), and based on different datasets and structures (often spoken dialogue). In this paper, we explore what could constitute the effective analysis of productive online dialogues, arguing that it requires consideration of three key facets of the dialogue: features indicative of productive dialogue; the unit of segmentation; and the interplay of features and segmentation with the temporal underpinning of learning contexts. The paper thus foregrounds key considerations regarding the analysis of dialogue data in emerging learning analytics environments, both for learning-science and for computationally oriented researchers

Assessment of online reflections: engaging english second language (ESL) students

Online discussion boards are increasingly being used by tertiary educators as a tool for encouraging greater student interaction and developing learning communities. In particular, educators who have adopted a learner-centered, socio-constructivist approach to teaching have sought to facilitate collaborative learning in which students reflect upon and share their experiences and perspectives, and construct knowledge together through developing shared meanings. In this paper, the findings of an electronic survey of the perceptions of 70 distance education EFL and ESL students concerning a compulsory assessment item involving contribution to an online course discussion board are presented. The study revealed that the majority of the students enjoyed the assessment item and agreed that posting to the online course discussion board had allowed them to achieve a range of cognitive and social learning outcomes, as well as, to develop some important graduate skills. In particular, ESL students reported the benefits of posting to the discussion board in terms of sharing their experiences with others and reducing the feeling of isolation. Further, when considering social outcomes, ESL students perceive the discussion board provided them with an opportunity to meet and develop a closer relationship with other students in the course and encouraged them to keep up with their studies