Evaluating groupware support for software engineering students

Software engineering tasks, during both development and maintenance, typically involve teamwork using computers. Team members rarely work on isolated computers. An underlying assumption of our research is that software engineering teams will work more effectively if adequately supported by network-based groupware technology. Experience of working with groupware and evaluating groupware systems will also give software engineering students a direct appreciation of the requirements of engineering such systems. This research is investigating the provision of such network-based support for software engineering students and the impact these tools have on their groupwork. We will first describe our experiences gained through the introduction of an asynchronous virtual environment ­ SEGWorld to support groupwork during the Software Engineering Group (SEG) project undertaken by all second year undergraduates within the Department of Computer Science. Secondly we will describe our Computer Supported Cooperative Work (CSCW) module which has been introduced into the students' final year of study as a direct result of our experience with SEG, and in particular its role within Software Engineering. Within this CSCW module the students have had the opportunity to evaluate various groupware tools. This has enabled them to take a retrospective view of their experience of SEGWorld and its underlying system, BSCW, one year on. We report our findings for SEG in the form of a discussion of the hypotheses we formulated on how the SEGs would use SEGWorld, and present an initial qualitative assessment of student feedback from the CSCW module

Using Shared Workspaces in Higher Education

We evaluate the use of BSCW shared workspaces in higher education by means of a comparison of seven courses in which this environment was used. We identify a number of different functions for which the BSCW environment has been used and discuss the relative success of these functions across the cases. In addition, we evaluate the cases with the 4E model of Collis et al. (2000) which predicts the chances of acceptance of ICT in an educational setting. Effectiveness for the given task appears to be a prime success factor for using ICT. But an effective tool may fail due to other factors like ease of use and organisational, socialcultural or technological obstacles. The particular strength of a shared workspace, for which BSCW is most effective and efficient, is providing a repository for objects of collaborative work. Other types of usage showed mixed results. In the future we expect that learning takes place in an integrated, open ICT environment in which different kinds of tools are available for different purposes and users can switch between tools as appropriate. We could observe this in several of the case studies, where non-use of BSCW did not mean that a particular task was not performed, but, on the contrary, a more efficient solution for the same function was available. Shared workspaces have proven to be highly useful, but it seems advisable that their purpose be limited to what they were originally designed for

Factors shaping the evolution of electronic documentation systems

The main goal is to prepare the space station technical and managerial structure for likely changes in the creation, capture, transfer, and utilization of knowledge. By anticipating advances, the design of Space Station Project (SSP) information systems can be tailored to facilitate a progression of increasingly sophisticated strategies as the space station evolves. Future generations of advanced information systems will use increases in power to deliver environmentally meaningful, contextually targeted, interconnected data (knowledge). The concept of a Knowledge Base Management System is emerging when the problem is focused on how information systems can perform such a conversion of raw data. Such a system would include traditional management functions for large space databases. Added artificial intelligence features might encompass co-existing knowledge representation schemes; effective control structures for deductive, plausible, and inductive reasoning; means for knowledge acquisition, refinement, and validation; explanation facilities; and dynamic human intervention. The major areas covered include: alternative knowledge representation approaches; advanced user interface capabilities; computer-supported cooperative work; the evolution of information system hardware; standardization, compatibility, and connectivity; and organizational impacts of information intensive environments

Thereʼs no ʻIʼ in ʻEmergency Management Team:ʼ designing and evaluating a serious game for training emergency managers in group decision making skills

Serious games are games that are designed to educate rather than entertain. The game outlined and evaluated here was commissioned and designed as a tool to improve the group decision making skills of people who manage real-world emergencies such as floods, fires, volcanoes and chemical spills. The game design exploits research on decision making groups and applies pedagogically sound games design principles. An evaluation of the game design was carried out based on a paper prototype. Eight participants were recruited and assigned to two groups of four participants each. These groups were video recorded while playing the game and the video was analysed in terms of game actions and member participation. Results indicate that the group who behaved in a more appropriate manner for a decision making group were rewarded with more positive feedback from the game state. These findings suggest that the game itself delivers appropriate feedback to players on their collaborative behaviour and is thus fit for the purposes intended in the current project

Collaborative video searching on a tabletop

Almost all system and application design for multimedia systems is based around a single user working in isolation to perform some task yet much of the work for which we use computers to help us, is based on working collaboratively with colleagues. Groupware systems do support user collaboration but typically this is supported through software and users still physically work independently. Tabletop systems, such as the DiamondTouch from MERL, are interface devices which support direct user collaboration on a tabletop. When a tabletop is used as the interface for a multimedia system, such as a video search system, then this kind of direct collaboration raises many questions for system design. In this paper we present a tabletop system for supporting a pair of users in a video search task and we evaluate the system not only in terms of search performance but also in terms of user–user interaction and how different user personalities within each pair of searchers impacts search performance and user interaction. Incorporating the user into the system evaluation as we have done here reveals several interesting results and has important ramifications for the design of a multimedia search system

Spacecraft software training needs assessment research, appendices

The appendices to the previously reported study are presented: statistical data from task rating worksheets; SSD references; survey forms; fourth generation language, a powerful, long-term solution to maintenance cost; task list; methodology; SwRI's instructional systems development model; relevant research; and references

Formative peer assessment in a CSCL environment

In this case study our aim was to gain more insight in the possibilities of qualitative formative peer assessment in a computer supported collaborative learning (CSCL) environment. An approach was chosen in which peer assessment was operationalised in assessment assignments and assessment tools that were embedded in the course material. The course concerned a higher education case-based virtual seminar, in which students were asked to conduct research and write a report in small multidisciplinary teams. The assessment assignments contained the discussion of assessment criteria, the assessment of a group report of a fellow group, and writing an assessment report. A list of feedback rules was one of the assessment tools. A qualitative oriented study was conducted, focussing on the attitude of students towards peer assessment and practical use of peer assessment assignments and tools. Results showed that students’ attitude towards peer assessment was positive and that assessment assignments had added value. However, not all students fulfilled all assessment assignments. Recommendations for implementation of peer assessment in CSCL environments as well as suggestions for future research are discussed

Facilitating collaborative knowledge construction in computer-mediated learning with structuring tools

Collaborative knowledge construction in computer-mediated learning environments puts forward difficulties regarding what tasks learners work on and how learners interact with each other. For instance, learners who collaboratively construct knowledge in computer-mediated learning environments sometimes do not participate actively or engage in off-task talk. Computer-mediated learning environments can be endorsed with socio-cognitive structuring tools that structure the contents to be learned and suggest specific interactions for collaborative learners. In this article, two studies will be reported that applied content- and interaction-oriented structuring tools in computer-mediated learning environments based on electronic bulletin boards and videoconferencing technologies. In each study the factors "content-oriented structuring tool" and "interaction-oriented structuring tool" have been independently varied in a 2X2-factorial design. Results show that interaction-oriented structuring tools substantially foster the processes of collaborative knowledge construction as well as learning outcomes. The content-oriented structuring tools facilitate the processes of collaborative knowledge construction, but have no or negative effects on learning outcome. The findings will be discussed against the background of recent literatGemeinsame Wissenskonstruktion in computervermittelten Lernumgebungen birgt Schwierigkeiten in Bezug darauf, welche Aufgaben Lernende bearbeiten und wie sie dabei miteinander interagieren. Lernende, die gemeinsam Wissen in computervermittelten Lernumgebungen konstruieren, nehmen z. B. manchmal nicht aktiv an der Bearbeitung von Lernaufgaben teil oder beschäftigen sich mit inhaltsfremden Themen. Computervermittelte Lernumgebungen können mit Hilfe sozio-kognitiver Strukturierungswerkzeuge unterstützt werden, die die Lerninhalte vorstrukturieren und den Lernenden spezifische Interaktionen nahe legen. In diesem Beitrag werden zwei Studien berichtet, die inhalts- und interaktionsbezogene Strukturierungswerkzeuge in computervermittelten Lernumgebungen, die auf web-basierten Diskussionsforen und Videokonferenz-Technologien beruhen, zum Einsatz gebracht und analysiert haben. In jeder der Studien wurden die Faktoren "inhaltsbezogenes Strukturierungswerkzeug" und "interaktionsbezogenes Strukturierungswerkzeug" unabhängig voneinander in einem 2X2-Design variiert. Die Ergebnisse zeigen, dass interaktionsbezogene Strukturierungswerkzeuge die Prozesse sowie die Ergebnisse gemeinsamer Wissenskonstruktion substanziell fördern können. Die inhaltsbezogenen Strukturierungswerkzeuge unterstützen die Prozesse gemeinsamer Wissenskonstruktion, zeitigen aber keine oder negative Effekte auf die Lernergebnisse. Die Befunde werden vor dem Hintergrund aktueller theoretischer Ansätze diskut

Factors influencing the success of computer mediated communication (CMC) environments in university teaching: a review and case study

Despite its potential benefits, the effectiveness of CMC when used to support learning in higher education is very variable, making it important to identify those factors which best predict successful implementations. A review of the literature from the past few years, presented in the first half of this paper, suggests that, consistent with Activity Theory (Leont'ev, 1978), the critical factors are those which provide a context and rationale for online communication by helping users to establish a shared purpose. However, generating empirical support for this hypothesis presents two kinds of methodological problem: specifying the methods and measures necessary to discern the existence and impact of shared purpose; and dealing with the difficulties of making controlled comparisons in this area. The second half of the paper illustrates, via an implementation case study, something of how these methodological problems might be resolved, and presents evidence in favour of the central importance of shared purpose