Content analysis: What are they talking about?

Quantitative content analysis is increasingly used to surpass surface level analyses in Computer-Supported Collaborative Learning (e.g., counting messages), but critical reflection on accepted practice has generally not been reported. A review of CSCL conference proceedings revealed a general vagueness in definitions of units of analysis. In general, arguments for choosing a unit were lacking and decisions made while developing the content analysis procedures were not made explicit. In this article, it will be illustrated that the currently accepted practices concerning the ‘unit of meaning’ are not generally applicable to quantitative content analysis of electronic communication. Such analysis is affected by ‘unit boundary overlap’ and contextual constraints having to do with the technology used. The analysis of e-mail communication required a different unit of analysis and segmentation procedure. This procedure proved to be reliable, and the subsequent coding of these units for quantitative analysis yielded satisfactory reliabilities. These findings have implications and recommendations for current content analysis practice in CSCL research

The effect of functional roles on perceived group efficiency during computer-supported collaborative learning

In this article, the effect of functional roles on group performance and collaboration during computer-supported collaborative learning (CSCL) is investigated. Especially the need for triangulating multiple methods is emphasised: Likert-scale evaluation questions, quantitative content analysis of e-mail communication and qualitative analysis of open-ended questions were used. A comparison of fourty-one questionnaire observations, distributed over thirteen groups in two research conditions – groups with prescribed functional roles (n = 7, N = 18) and nonrole groups (n = 6, N = 23) – revealed no main effect for performance (grade). Principal axis factoring of the Likert-scales revealed a latent variable that was interpreted as perceived group efficiency (PGE). Multilevel modelling (MLM) yielded a positive marginal effect of PGE. Most groups in the role condition report a higher degree of PGE than nonrole groups. Content analysis of e-mail communication of all groups in both conditions (role n = 7, N = 25; nonrole n = 6, N = 26) revealed that students in role groups contribute more ‘coordination’ focussed statements. Finally, results from cross case matrices of student responses to open-ended questions support the observed marginal effect that most role groups report a higher degree of perceived group efficiency than nonrole groups

Supporting Self-Directed Learning Process in a Virtual Collaborative Problem Based Learning Environment

The PBL process is a self-directed learning process. In the light of self-directed learning theory, the author argues that computational mechanisms can be used to support selfdirected learning for PBL groups in virtual learning environments. In this paper, an approach to the support of self-directed learning is proposed. This approach supports self-directed learning in a virtual PBL environment in two ways. Firstly, the shared workspaces together with their accompanying tools and documents allow students to actively engage in collaborative, creative, and unstructured PBL activities. Secondly, the process support tool helps students to organize, execute, and coordinate structured parts of PBL processes. This approach has been adopted to develop our prototype system CROCODILE

Custom-built environments for Communities of Online Informal Learning: an exploratory study of tools, structures, and strategies

This qualitative, exploratory study grouped together and explored custom-built environments for communities of online informal learning (COILs) with a special lens on the socio-technical relationship of platform tools, structures, and strategies that lead to social learning. The study was conducted through a three-phase process. First, a list of possible candidate sites was analyzed for appropriate fit based on the defining terms of a custom-built COIL environment. Second, an observational content analysis was implemented on 10 of the sites to aggregate a list of the tools, structures, and strategies used in the sites. Lastly, the same 10 sites and the lists of tools, structures, and strategies were researched through both pre-established codes for sociability, usability, and community-building designs and an open exploratory observation of their uses with a focus on the way these features support COILs. Social learning and informal learning were also purposefully scrutinized while themes regarding personalized learning and sustainability also emerged from the exploration. All design themes were found represented within the sites, as were social learning, informal learning, personalized learning, and efforts toward sustainability

The design, implementation and evaluation of a web-based learning environment for distance education

In this study, the need was emphasised to investigate the effects of using the Web in teaching students at a distance using a multi-level evaluation framework. A Web-based learning environment was designed, developed, implemented and evaluated for this purpose. Constructivist epistemology provided the basis for developing various components and developing problem-centred and interactive activities. Management, tutorial, interaction and support components were designed to work with each other to construct the learning environment, deliver course content, facilitate interaction and monitor student progress.A methodology was designed to describe and assess the learning environment in terms of access (standardisation, speed, resources, the tutor and peers), costs (types, structure, factors influencing, etc.), teaching and learning functions (quality of course objectives, materials and resources, learning approach and student achievement), interactivity (quantity and quality of student-tutor and student-peer interaction), user-friendliness (user-interface design, ease of use and navigation design) and organisational issues. The learners were Egyptian first-grade secondary school students (32), assigned randomly, and the topic selected for the course being developed was mathematics. Feedback was obtained from both learners and experts in distance education and on-line learning during the developmental and field-testing of the learning environment. Quantitative and qualitative methods (on-line student and expert questionnaires, students' logs, performance in formative evaluation, content analysis of peer discussions, achievement test and cost-analysis) were combined to gain insights into students' satisfaction with the different instructional and technical features and capabilities of the learning environment, achievement of course objectives in comparison with conventional classroom students, factors influencing their learning and perceptions and the unit cost per student study hour.The results indicated that although the learning environment and course materials were accessible, interactive, well-structured, user-friendly and achievement was successful for the on-line group, no significant differences were identified between the on-line students and traditional classroom students in overall achievement or achievement of low-order and high-order learning objectives. In addition, it is unlikely any cost saving would be made from shifting to the Internet to deliver instruction and many major factors were found to influence the development and support costs of on-line learning