Towards a Technique for Modeling New Forms of Collaborative Work Practices – The Facilitation Process Model 2.0

Collaboration Engineering (CE) is an approach for the design and deployment of repeatable collaborative work practices that can be executed by practitioners themselves without the ongoing support of external collaboration professionals. A key design activity in CE concerns modeling current and future collaborative work practices. CE researchers and practitioners have used the Facilitation Process Model (FPM) technique. However, this modeling technique suffers from a number of shortcomings to model contemporary collaborative work practices. We use a design science approach to identify the main challenges with the original FPM technique, derive requirements and design a revised modeling technique that is based on the current technique enriched by BPMN 2.0 elements. This paper contributes to the CE literature by offering a revised FPM technique that assists CE-designers to capture new forms of collaborative work practices

Supportive technologies for group discussion in MOOCs

A key hurdle that prevents MOOCs from reaching their transformative potential in terms of making valuable learning experiences available to the masses is providing support for students to make use of the resources they can provide for each other. This paper lays the foundation for meeting this challenge by beginning with a case study and computational modeling of social interaction data. The analysis yields new knowledge that informs design and development of novel, real-time support for building healthy learning communities that foster a high level of engagement and learning. We conclude by suggesting specific areas for potential impact of new technology

Emergent Capabilities for Collaborative Teams in the Evolving Web Environment

This paper reports on our investigation of the latest advances for the Social Web, Web 2.0 and the Linked Data Web. These advances are discussed in terms of the latest capabilities that are available (or being made available) on the Web at the time of writing this paper. Such capabilities can be of significant benefit to teams, especially those comprised of multinational, geographically-dispersed team members. The specific context of coalition members in a rapidly formed diverse military context such as disaster relief or humanitarian aid is considered, where close working between non-government organisations and non-military teams will help to achieve results as quickly and efficiently as possible. The heterogeneity one finds in such teams, coupled with a lack of dedicated private network infrastructure, poses a number of challenges for collaboration, and the current paper represents an attempt to assess whether nascent Web-based capabilities can support such teams in terms of both their collaborative activities and their access to (and sharing of) information resources

RATE TO MEASURE MATHEMATICS TEACHING: USING THE MANY-FACET RASCH MODELING TO REEVALUATE THE MATHEMATICS CLASSROOM OBSERVATION PROTOCOL FOR PRACTICES (MCOP2)

Rater-mediated classroom observation protocols are increasingly being used for teaching performance assessments, which makes identifying and controlling for various rater effects a central issue to ensure the rating quality. A series of validation studies under the classical test theory framework, including content validity, interrater reliability, and structure analysis, have been completed for the 16-item Mathematics Classroom Observation Protocol for Practices (MCOP2). However, the MCOP2 data have never been investigated under the Rasch framework. Due to the methodological limitations of the CTT approach for rater-mediated assessments, it is imperative to examine the MCOP2 validity and reliability using the MFRM modeling technique to implement dimensionality analysis, item-level analysis, rater effects control, and ratee and rater ability level calibration. To that end, two existing samples of the MCOP2 data were obtained and analyzed, where twelve raters were asked to rate 237 math classroom observations, using the MCOP2 classroom observation protocol. The data were analyzed under the MFRM framework, using Facets 3.83.3. Results of the Facets analysis showed that both the MCOP2 subscales (i.e., Student Engagement & Teacher Facilitation) were valid, unidimensional, and highly reliable rater-mediated performance measures across raters, ratees, and study samples. However, rater-item bias analyses revealed a type of intra-rater inconsistency, where some raters tended to rate more severely than other raters on certain items while more leniently on some other items. The overall findings are promising in that they provide systematic preliminary psychometric evidence for the viability of the MCOP2 protocol to be used for math teachers’ self-assessment and/or peer-assessment along with other designated raters in the future studies

COGNITIVE PRESENCE IN PEER FACILITATED ASYNCHRONOUS ONLINE DISCUSSION: THE PATTERNS AND HOW TO FACILITATE

This study, in the context of peer-facilitated asynchronous online discussion, explored the characteristics and patterns of students’ cognitive presence, and examined the practices that aim to enhance cognitive presence development. Participants were 53 students from a graduate-level online course that focused on the integration of educational technologies. Data were collected from discussion transcripts, student survey, student artifacts, and researcher’s observations. Results demonstrated four phases of students’ cognitive presence: Triggering event, Exploration, Integration, and Resolution. Among the four phases, students’ cognitive presence tended to aggregate at the middle phases: Integration and Exploration. Percentage of the Resolution was very low. The distribution of students’ discussion behaviors further revealed: a) the hierarchical relationship between the four phases: Integration and Resolution involved a higher-level of cognitive engagement, and Triggering event and Exploration involved a lower-level of cognitive engagement; b) the phase of Resolution heavily relied on experiment, while the other three phases heavily relied on making use of personal experience; c) creating of cognitive presence occurred in both the private space of individual activities and the shared space of having dialogues. The conversation analysis of threads and episodes explored the temporal evolvement of cognitive presence. The results showed that, in an ongoing discussion, students’ cognitive presence evolved in a non-linear way, rather than strictly phase by phase as suggested by the PI model. Experiments were designed and conducted to determine the effects of two pedagogical interventions – 1) providing guidance on peer facilitation techniques; 2) asking students to label their posts. The results showed that the Intervention 1 and the combination of two interventions credibly improved students’ cognitive presence. They were especially effective in improving Integration, a higher level of cognitive presence. After having added Intervention 2, cognitive presence increased from the first-half to the second-half semester, although the improvement was not found to be statistically credible. This study confirmed the close association between and among cognitive presence, social interaction, and peer facilitation. The results clearly showed that Intervention 1 – providing guidance on peer facilitation credibly improved students’ social interaction and peer facilitation. However, Mixed findings were obtained for Intervention 2 – asking students to label their posts. It was found that Intervention 2 positively increased students’ social interaction. However, it did not show any impact on students’ peer facilitation behaviors. It is also worth noting that the effect of the combination of two interventions was much larger than any single one of them. Conversation analysis was conducted to zoom in on the dynamic process of discussion. The cases revealed that when students were provided with the guidance on peer facilitation techniques, they tended to use a variety of facilitation techniques in a strategic way to help peers to achieve a sustained and deeper-level conversation. Compared to the control group, the students in the treatment group showed more peer facilitation behaviors, which led to more conversations and more higher-level cognitive presence. This study has unpacked the complexity of students’ cognitive presence in a peer-facilitated discussion environment, especially when students are coached in performing teaching presence. The results shed light on the pedagogical practices and strategies of creating an online learning community that incubates rich cognitive presence. Finally, implications are discussed for the research and practices in online instruction and discussion analytics

Collaborative action research for the governance of climate adaptation - foundations, conditions and pitfalls

This position paper serves as an introductory guide to designing and facilitating an action research process with stakeholders in the context of climate adaptation. Specifically, this is aimed at action researchers who are targeting at involving stakeholders and their expert knowledge in generating knowledge about their own condition and how it can be changed. The core philosophy of our research approach can be described as developing a powerful combination between practice-driven collaborative action research and theoretically-informed scientific research. Collaborative action research means that we take guidance from the hotspots as the primary source of questions, dilemmas and empirical data regarding the governance of adaptation, but also collaborate with them in testing insights and strategies, and evaluating their usefulness. The purpose is to develop effective, legitimate and resilient governance arrangements for climate adaptation. Scientific quality will be achieved by placing this co-production of knowledge in a well-founded and innovative theoretical framework, and through the involvement of the international consortium partners. This position paper provides a methodological starting point of the research program ‘Governance of Climate Adaptation’ and aims: · To clarify the theoretical foundation of collaborative action research and the underlying ontological and epistemological principles · To give an historical overview of the development of action research and its different forms · To enhance the theoretical foundation of collaborative action research in the specific context of governance of climate adaptation. · To translate the philosophy of collaborative action research into practical methods; · To give an overview of the main conditions and pitfalls for action research in complex governance settings Finally, this position paper provides three key instruminstruments developed to support Action Research in the hotspots: 1) Toolbox for AR in hotspots (chapter 6); 2) Set-up of a research design and action plan for AR in hotspots (chapter 7); 3) Quality checklist or guidance for AR in hotspots (chapter 8)

A Gaming Laboratory to Study Distributed Collaboration Processes.

Current events present many examples of situations where a fast and coordinated response is required from many and diverse organizations and stakeholders. Technology-mediated communication and collaboration may be the only option for getting things done in situations like these. There is a real need for research on the kinds of environments and processes that best support fast response on urgent tasks for virtual teams. The paper presents the development and initial test of a gaming laboratory to study such processes. The laboratory is adaptable to different kinds of situations. We discuss the design principles and implementation of the laboratory environment, along with lessons learned from the first experiences with it