QRTEngine: An easy solution for running online reaction time experiments using Qualtrics

Performing online behavioral research is gaining increased popularity among researchers in psychological and cognitive science. However, the currently available methods for conducting online reaction time experiments are often complicated and typically require advanced technical skills. In this article, we introduce the Qualtrics Reaction Time Engine (QRTEngine), an open-source JavaScript engine that can be embedded in the online survey development environment Qualtrics. The QRTEngine can be used to easily develop browser-based online reaction time experiments with accurate timing within current browser capabilities, and it requires only minimal programming skills. After introducing the QRTEngine, we briefly discuss how to create and distribute a Stroop task. Next, we describe a study in which we investigated the timing accuracy of the engine under different processor loads using external chronometry. Finally, we show that the QRTEngine can be used to reproduce classic behavioral effects in three reaction time paradigms: a Stroop task, an attentional blink task, and a masked-priming task. These findings demonstrate that QRTEngine can be used as a tool for conducting online behavioral research even when this requires accurate stimulus presentation times

Conducting interactive experiments online

Online labor markets provide new opportunities for behavioral research, but conducting economic experiments online raises important methodological challenges. This particularly holds for interactive designs. In this paper, we provide a methodological discussion of the similarities and differences between interactive experiments conducted in the laboratory and online. To this end, we conduct a repeated public goods experiment with and without punishment using samples from the laboratory and the online platform Amazon Mechanical Turk. We chose to replicate this experiment because it is long and logistically complex. It therefore provides a good case study for discussing the methodological and practical challenges of online interactive experimentation. We find that basic behavioral patterns of cooperation and punishment in the laboratory are replicable online. The most important challenge of online interactive experiments is participant dropout. We discuss measures for reducing dropout and show that, for our case study, dropouts are exogenous to the experiment. We conclude that data quality for interactive experiments via the Internet is adequate and reliable, making online interactive experimentation a potentially valuable complement to laboratory studies

A Moment of Mindfulness: Computer-Mediated Mindfulness Practice Increases State Mindfulness

Three studies investigated the use of a 5-minute, computer-mediated mindfulness practice in increasing levels of state mindfulness. In Study 1, 54 high school students completed the computer-mediated mindfulness practice in a lab setting and Toronto Mindfulness Scale (TMS) scores were measured before and after the practice. In Study 2 (N = 90) and Study 3 (N = 61), the mindfulness practice was tested with an entirely online sample to test the delivery of the 5-minute mindfulness practice via the internet. In Study 2 and 3, we found a significant increase in TMS scores in the mindful condition, but not in the control condition. These findings highlight the impact of a brief, mindfulness practice for single-session, computer-mediated use to increase mindfulness as a state

Are all ‘research fields’ equal? Rethinking practice for the use of data from crowd-sourcing market places

New technologies like large-scale social media sides (e.g., Facebook and Twitter) and crowdsourcing services (e.g., Amazon Mechanical Turk, Crowdflower, Clickworker) impact social science research and provide many new and interesting avenues for research. The use of these new technologies for research has not been without challenges and a recently published psychological study on Facebook led to a widespread discussion on the ethics of conducting large-scale experiments online. Surprisingly little has been said about the ethics of conducting research using commercial crowdsourcing market places. In this paper, I want to focus on the question of which ethical questions are raised by data collection with crowdsourcing tools. I briefly draw on implications of internet research more generally and then focus on the specific challenges that research with crowdsourcing tools faces. I identify fair-pay and related issues of respect for autonomy as well as problems with power dynamics between researcher and participant, which has implications for ‘withdrawal-withoutprejudice’, as the major ethical challenges with crowdsourced data. Further, I will to draw attention on how we can develop a ‘best practice’ for researchers using crowdsourcing tools

Cloud Computing As a Tool for Enhancing Ecological Goals?

Cloud computing has been introduced as a promising information technology (IT) that embodies not only economic advantages in terms of increased efficiency but also ecological gains through saving energy. The latter has become particularly important in view of the rising energy costs of IT. The present study analyzes whether necessary preconditions for accepting cloud computing as a new infrastructure, such as awareness and perceived net value, exist on the part of the users. The analysis is based on a combined research framework of the theory of reasoned action (TRA) and the technology acceptance model (TAM) in a cloud computing setting. Two consumer surveys, the one to elicit beliefs and the second to gain insight into the ranking of the variables, are employed. This study uses structural equation modeling (SEM) to evaluate the hypotheses. The results indicate support for the proposed research framework. Surprisingly however, the ecological factor does not play a role in forming cloud computing intentions, regardless of prior knowledge or experience. Empirical evidence of this study suggests increasing efforts for informing actual and potential users, particularly in respect to possible ecological advantages through applying the new IT infrastructure