Chat-based problem solving in small groups: Developing a multi-dimensional coding scheme

Paper presented at the 11th Biannual Conference of the European Association for Research in Learning and Instruction, EARLI 2005, Nicosia, Cyprus. Retrieved July 18, 2007 from http://www.cis.drexel.edu/faculty/gerry/pub/earli2005jw.pdf.Collaboration through chat communication has been primarily studied in dyadic settings in the domain of Computer-Supported Collaborative Learning (CSCL). In the ‘Virtual Math Teams’ (VMT) project small groups of three to five students collaborate through chat to solve a math problem. As part of a multi-method analysis toolkit a coding scheme was devised to conduct quantitative content analysis. During the calibration several methodological problems emerged. Firstly, the analysis required that the interaction structure (i.e., who responds to whom) would be reconstructed. Secondly, the diversity of processes of interest (e.g., conversational and problem solving acts) proved to be problematic. Although initially assumed independent, ties could not be avoided. Reliability computation for threading and coding proved challenging, for example not all utterances are valid analysis units for a dimension and results in overestimation of reliability. Reliability for most dimensions was satisfactory. Coding of the math dimension proved a bridge too far due to subtle nuances; hence methods like conversation analysis may be more applicable. The implications of the methodological issues for analysis of chat communication are discussed

Content analysis: What are they talking about?

Quantitative content analysis is increasingly used to surpass surface level analyses in Computer-Supported Collaborative Learning (e.g., counting messages), but critical reflection on accepted practice has generally not been reported. A review of CSCL conference proceedings revealed a general vagueness in definitions of units of analysis. In general, arguments for choosing a unit were lacking and decisions made while developing the content analysis procedures were not made explicit. In this article, it will be illustrated that the currently accepted practices concerning the ‘unit of meaning’ are not generally applicable to quantitative content analysis of electronic communication. Such analysis is affected by ‘unit boundary overlap’ and contextual constraints having to do with the technology used. The analysis of e-mail communication required a different unit of analysis and segmentation procedure. This procedure proved to be reliable, and the subsequent coding of these units for quantitative analysis yielded satisfactory reliabilities. These findings have implications and recommendations for current content analysis practice in CSCL research

The effect of functional roles on group efficiency

The usefulness of ‘roles’ as a pedagogical approach to support small group performance can be often read, however, their effect is rarely empirically assessed. Roles promote cohesion and responsibility and decrease so-called ‘process losses’ caused by coordination demands. In addition, roles can increase awareness of intra-group interaction. In this article, the effect of functional roles on group performance, efficiency and collaboration during computer-supported collaborative learning (CSCL) was investigated with questionnaires and quantitative content analysis of e-mail communication. A comparison of thirty-three questionnaire observations, distributed over ten groups in two research conditions: role (n = 5, N = 14) and non-role (n = 5, N = 19), revealed no main effect for performance (grade). A latent variable was interpreted as ‘perceived group efficiency’ (PGE). Multilevel modelling (MLM) yielded a positive marginal effect of PGE. Groups in the role condition appear to be more aware of their efficiency, compared to groups in the ‘non-role’ condition, regardless whether the group performs well or poor. Content analysis reveals that students in the role condition contribute more ‘task content’ focussed statements. This is, however, not as hypothesised due to the premise that roles decrease coordination and thus increase content focused statements; in fact, roles appear to stimulate coordination and simultaneously the amount of ‘task content’ focussed statements increases

Methodological issues in developing a multi-dimensional coding procedure for small group chat communication

In CSCL research, collaboration through chat has primarily been studied in dyadic settings. This article discusses three issues that emerged during the development of a multi-dimensional coding procedure for small group chat communication: a) the unit of analysis and unit fragmentation, b) the reconstruction of the response structure and c) determining reliability without overestimation. Threading, i.e. connections between analysis units, proved essential to handle unit fragmentation, to reconstruct the response structure and for reliability of coding. In addition, a risk for reliability overestimation was illustrated. Implications for analysis methodology in CSCL are discussed

Critical review of the e-loyalty literature: a purchase-centred framework

Over the last few years, the concept of online loyalty has been examined extensively in the literature, and it remains a topic of constant inquiry for both academics and marketing managers. The tremendous development of the Internet for both marketing and e-commerce settings, in conjunction with the growing desire of consumers to purchase online, has promoted two main outcomes: (a) increasing numbers of Business-to-Customer companies running businesses online and (b) the development of a variety of different e-loyalty research models. However, current research lacks a systematic review of the literature that provides a general conceptual framework on e-loyalty, which would help managers to understand their customers better, to take advantage of industry-related factors, and to improve their service quality. The present study is an attempt to critically synthesize results from multiple empirical studies on e-loyalty. Our findings illustrate that 62 instruments for measuring e-loyalty are currently in use, influenced predominantly by Zeithaml et al. (J Marketing. 1996;60(2):31-46) and Oliver (1997; Satisfaction: a behavioral perspective on the consumer. New York: McGraw Hill). Additionally, we propose a new general conceptual framework, which leads to antecedents dividing e-loyalty on the basis of the action of purchase into pre-purchase, during-purchase and after-purchase factors. To conclude, a number of managerial implementations are suggested in order to help marketing managers increase their customers’ e-loyalty by making crucial changes in each purchase stage

A survey on cyber security for smart grid communications

A smart grid is a new form of electricity network with high fidelity power-flow control, self-healing, and energy reliability and energy security using digital communications and control technology. To upgrade an existing power grid into a smart grid, it requires significant dependence on intelligent and secure communication infrastructures. It requires security frameworks for distributed communications, pervasive computing and sensing technologies in smart grid. However, as many of the communication technologies currently recommended to use by a smart grid is vulnerable in cyber security, it could lead to unreliable system operations, causing unnecessary expenditure, even consequential disaster to both utilities and consumers. In this paper, we summarize the cyber security requirements and the possible vulnerabilities in smart grid communications and survey the current solutions on cyber security for smart grid communications. © 2012 IEEE