Between analysis and transformation: technology, methodology and evaluation on the SPLICE project

This paper concerns the ways in which technological change may entail methodological development in e-learning research. The focus of our argument centres on the subject of evaluation in e-learning and how technology can contribute to consensus-building on the value of project outcomes, and the identification of mechanisms behind those outcomes. We argue that a critical approach to the methodology of evaluation which harnesses technology in this way is vital to agile and effective policy and strategy-making in institutions as the challenges of transformation in a rapidly changing educational and technological environment are grappled with. With its focus on mechanisms and multiple stakeholder perspectives, we identify Pawson and Tilley’s ‘Realistic Evaluation’ as an appropriate methodological approach for this purpose, and we report on its use within a JISC-funded project on social software, SPLICE (Social Practices, Learning and Interoperability in Connected Environments). The project created new tools to assist the identification of mechanisms responsible for change to personal and institutional technological practice. These tools included collaborative mind-mapping and focused questioning, and tools for the animated modelling of complex mechanisms. By using these tools, large numbers of project stakeholders could engage in a process where they were encouraged to articulate and share their theories and ideas as to why project outcomes occurred. Using the technology, this process led towards the identification and agreement of common mechanisms which had explanatory power for all stakeholders. In conclusion, we argue that SPLICE has shown the potential of technologically-mediated Realistic Evaluation. Given the technologies we now have, a methodology based on the mass cumulation of stakeholder theories and ideas about mechanisms is feasible. Furthermore, the summative outcomes of such a process are rich in explanatory and predictive power, and therefore useful to the immediate and strategic problems of the sector. Finally, we argue that as well as generating better explanations for phenomena, the evaluation process can itself become transformative for stakeholders

PERCLOS: An Alertness Measure of the Past

The growing number of fatigue related accidents in recent years has become a serious concern. Accidents caused by fatigue, or more precisely impaired alertness, in transportation and in mining operations involving heavy equipment can lead to substantial damage and loss of life. Preventing such fatigue related accidents is universally desirable, but requires techniques for continuously estimating and predicting the operator’s alertness state. PERCLOS (percentage of eye closure) was introduced as an alertness measure. Some years later, it was claimed to be superior in fatigue detection to any other measure, including the general Eye-Tracking Signal (ETS) and even EEG recordings. This study will show that this is not the case. To put things into the prospective a fair and objective comparison between PERCLOS, the general ETS and EEG/EOG has to be established. To achieve this purpose, a protocol was established to investigate the fatigue detection capabilities of PERCLOS, ETS, and EEG/EOG in a simple two class discrimination analysis using an ensemble of Learning Vector Quantization (LVQ) networks as a classification tool. Karolinska Sleepiness Scale (KSS) and Variation of Lane Deviation (VLD) were used in order to obtain independent class labels, whereas KSS provided subjective alertness labels while VLD provided objective alertness labels. The general ETS and the fused EEG/EOG measures contain substantially greater amounts of fatigue information than the PERCLOS measures alone. These conclusions were found to be valid for all three commercially available infrared video camera systems that were utilized in the study. The data utilized in the discrimination analysis were obtained from 16 young volunteers who participated in overnight experiments in the real car driving simulation lab at the University of Schmalkalden

Asymmetric Properties of Heart Rate Variability to Assess Operator Fatigue

The aim of this study is to evaluate the suitability of heart rate recordings for establishing a reliable connection to well-defined fatigue and performance measures in order to estimate fatigue in industrial and transportation applications. An overnight driving simulation scenario with partial sleep deprivation was utilized to induce strong fatigue. An experiment trial was divided into repeated sessions, each of which consisted of a driving performance and two vigilance tasks. Heart rate (HR) was recorded over the entire experiment; HRmeasures were derived and correlated against measures that were established from driving and vigilance task performance and that represent various aspects of operator fatigue. In a previous report (Hefner et al. 2009) we presented on the basis of the data of one volunteer that multiple fatigue measures correlate well with different expressions of heart rate variability (HRV), especially with longterm HRV derived from Poincaré plots. In this work, we intensify the Poincaré analysis by dividing the distribution of HR data in different accelerating and decelerating segments and by establishing properties of asymmetry between these segments. We also show that most of the properties of long-term HRV correlate well with specific fatigue measures for a group of 5 volunteers despite their large inter-individual differences in HR-to-fatigue correlations

Enabling On-Demand Database Computing with MIT SuperCloud Database Management System

The MIT SuperCloud database management system allows for rapid creation and flexible execution of a variety of the latest scientific databases, including Apache Accumulo and SciDB. It is designed to permit these databases to run on a High Performance Computing Cluster (HPCC) platform as seamlessly as any other HPCC job. It ensures the seamless migration of the databases to the resources assigned by the HPCC scheduler and centralized storage of the database files when not running. It also permits snapshotting of databases to allow researchers to experiment and push the limits of the technology without concerns for data or productivity loss if the database becomes unstable.Comment: 6 pages; accepted to IEEE High Performance Extreme Computing (HPEC) conference 2015. arXiv admin note: text overlap with arXiv:1406.492

Lustre, Hadoop, Accumulo

Data processing systems impose multiple views on data as it is processed by the system. These views include spreadsheets, databases, matrices, and graphs. There are a wide variety of technologies that can be used to store and process data through these different steps. The Lustre parallel file system, the Hadoop distributed file system, and the Accumulo database are all designed to address the largest and the most challenging data storage problems. There have been many ad-hoc comparisons of these technologies. This paper describes the foundational principles of each technology, provides simple models for assessing their capabilities, and compares the various technologies on a hypothetical common cluster. These comparisons indicate that Lustre provides 2x more storage capacity, is less likely to loose data during 3 simultaneous drive failures, and provides higher bandwidth on general purpose workloads. Hadoop can provide 4x greater read bandwidth on special purpose workloads. Accumulo provides 10,000x lower latency on random lookups than either Lustre or Hadoop but Accumulo's bulk bandwidth is 10x less. Significant recent work has been done to enable mix-and-match solutions that allow Lustre, Hadoop, and Accumulo to be combined in different ways.Comment: 6 pages; accepted to IEEE High Performance Extreme Computing conference, Waltham, MA, 201