Measuring motivations of crowdworkers: The multidimensional crowdworker motivation scale

Crowd employment is a new form of short-term and flexible employment which has emerged during the past decade. In order to understand this new form of employment, it is crucial to illuminate the underlying motivations of the workforce involved in it. This paper introduces the Multidimensional Crowdworker Motivation Scale (MCMS), a scale for measuring the motivation of crowdworkers on micro-task platforms. The MCMS is theoretically grounded in self-determination theory and tailored specifically to the context of paid crowdsourced micro-labor. The scale measures the motivation of crowdworkers along six motivational dimensions, ranging from amotivation to intrinsic motivation. We validated the MCMS on data collected in ten countries and three income groups. Factor analyses demonstrated that the MCMS's six dimensions showed good model fit, validity, and reliability. Furthermore, our measurement invariance tests showed that motivations measured with the MCMS are comparable across countries and income groups, and we present a first cross-country comparison of crowdworker motivations. This work constitutes an important first step towards understanding the motivations of the international crowd workforce.Comment: 33 pages; added section; additional validation; corrected typo

Characterizing the Global Crowd Workforce: A Cross-Country Comparison of Crowdworker Demographics

Micro-task crowdsourcing is an international phenomenon that has emerged during the past decade. This paper sets out to explore the characteristics of the international crowd workforce and provides a cross-national comparison of the crowd workforce in ten countries. We provide an analysis and comparison of demographic characteristics and shed light on the significance of micro-task income for workers in different countries. This study is the first large-scale country-level analysis of the characteristics of workers on the platform Figure Eight (formerly CrowdFlower), one of the two platforms dominating the micro-task market. We find large differences between the characteristics of the crowd workforces of different countries, both regarding demography and regarding the importance of micro-task income for workers. Furthermore, we find that the composition of the workforce in the ten countries was largely stable across samples taken at different points in time

Crowdsourcing in China: Exploring the Work Experience of Solo Crowdworkers and Crowdfarm Workers

Recent research highlights the potential of crowdsourcing in China. Yet very few studies explore the workplace context and experiences of Chinese crowdworkers. Those that do, focus mainly on the work experiences of solo crowdworkers but do not deal with issues pertaining to the substantial amount of people working in ‘crowdfarms’. This article addresses this gap as one of its primary concerns. Drawing on a study that involves 48 participants, our research explores, compares and contrasts the work experiences of solo crowdworkers to those of crowdfarm workers. Our findings illustrate that the work experiences and context of the solo workers and crowdfarm workers are substantially different, with regards to their motivations, the ways they engage with crowdsourcing, the tasks they work on, and the crowdsourcing platforms they utilize. Overall, our study contributes to furthering the understandings on the work experiences of crowdworkers in China

Hourly Wages in Crowdworking: A Meta-Analysis

In the past decade, crowdworking on online labor market platforms has become an important source of income for a growing number of people worldwide. This development has led to increasing political and scholarly interest in the wages people can earn on such platforms. This study extends the literature, which is often based on a single platform, region, or category of crowdworking, through a meta-analysis of prevalent hourly wages. After a systematic literature search, the paper considers 22 primary empirical studies, including 105 wages and 76,765 data points from 22 platforms, eight different countries, and 10 years. It is found that, on average, microtasks results in an hourly wage of less than $6. This wage is significantly lower than the mean wage of online freelancers, which is roughly three times higher when not factoring in unpaid work. Hourly wages accounting for unpaid work, such as searching for tasks and communicating with requesters, tend to be significantly lower than wages not considering unpaid work. Legislators and researchers evaluating wages in crowdworking need to be aware of this bias when assessing hourly wages, given that the majority of literature does not account for the effect of unpaid work time on crowdworking wages. To foster the comparability of different research results, the article suggests that scholars consider a wage correction factor to account for unpaid work. Finally, researchers should be aware that remuneration and work processes on crowdworking platforms can systematically affect the data collection method and inclusion of unpaid work

In Their Shoes: A Structured Analysis of Job Demands, Resources, Work Experiences, and Platform Commitment of Crowdworkers in China

Despite the growing interest in crowdsourcing, this new labor model has recently received severe criticism. The most important point of this criticism is that crowdworkers are often underpaid and overworked. This severely affects job satisfaction and productivity. Although there is a growing body of evidence exploring the work experiences of crowdworkers in various countries, there have been a very limited number of studies to the best of our knowledge exploring the work experiences of Chinese crowdworkers. In this paper we aim to address this gap. Based on a framework of well-established approaches, namely the Job Demands-Resources model, the Work Design Questionnaire, the Oldenburg Burnout Inventory, the Utrecht Work Engagement Scale, and the Organizational Commitment Questionnaire, we systematically study the work experiences of 289 crowdworkers who work for ZBJ.com - the most popular Chinese crowdsourcing platform. Our study examines these crowdworker experiences along four dimensions: (1) crowdsourcing job demands, (2) job resources available to the workers, (3) crowdwork experiences, and (4) platform commitment. Our results indicate significant differences across the four dimensions based on crowdworkers\u27 gender, education, income, job nature, and health condition. Further, they illustrate that different crowdworkers have different needs and threshold of demands and resources and that this plays a significant role in terms of moderating the crowdwork experience and platform commitment. Overall, our study sheds light to the work experiences of the Chinese crowdworkers and at the same time contributes to furthering understandings related to the work experiences of crowdworkers

The Dark Side of Recruitment in Crowdsourcing: Ethics and Transparency in Micro-Task Marketplaces

Micro-task crowdsourcing marketplaces like Figure Eight (F8) connect a large pool of workers to employers through a single online platform, by aggregating multiple crowdsourcing platforms (channels) under a unique system. This paper investigates the F8 channels’ demographic distribution and reward schemes by analysing more than 53k crowdsourcing tasks over four years, collecting survey data and scraping marketplace metadata. We reveal an heterogeneous per-channel demographic distribution, and an opaque channel commission scheme, that varies over time and is not communicated to the employer when launching a task: workers often will receive a smaller payment than expected by the employer. In addition, the impact of channel commission schemes on the relationship between requesters and crowdworkers is explored. These observations uncover important issues on ethics, reliability and transparency of crowdsourced experiment when using this kind of marketplaces, especially for academic research

Understanding the Use of HIT Catchers and Crowd Knowledge Sharing: A Case Study of Crowdworkers on Amazon Mechanical Turk

Crowdsourcing platforms have become a vital component of the modern digital economy, offering a wide range of HIT (Human Intelligence Task) opportunities to workers worldwide. Meanwhile, crowdworkers' use of scripting tools and their communication with each other are continuously shaping the entire crowdsourcing ecosystem. This thesis explores the use of HIT catchers by crowdworkers and their sharing of skill-based knowledge that facilitates the popularity of such scripting tools. It is revealed that the use of HIT catchers affects the completion speed and HIT-worker diversity for the whole HIT group, while depriving job opportunities from others. This potentially undermines the stability of the platform under the current reputation system relying on numbers of approvals and approval rates. Subsequently, another study explored how work strategies under the use of HIT catchers, including HIT acceptance, backlog, and completion, affect HIT availability, completion time, and result quality. The study also found differences in work behaviours between workers using and not using HIT catchers. Finally, this thesis investigates the skill-based knowledge sharing behaviour of crowdworkers, which promotes the blooming of scripting tools including HIT catchers, to improve the fairness of work opportunities and mitigate its negative impact on HIT completion. Using PLS-SEM, we assess the factors influencing knowledge sharing in the domain of skills. The study reveals the significance of high performance expectation, low effort expectation, and the joy and satisfaction in motivating the crowd skill-based knowledge sharing. Overall, this study provides an in-depth exploration around these two types of collective behaviour, highlighting the important role of tool use and knowledge sharing in shaping the crowdsourcing ecosystem

Crowdwork, digital liminality and the enactment of culturally recognised alternatives to Western precarity: beyond epistemological terra nullius

Research on crowdwork in developing countries considers it precarious. This reproduces its Western conceptualisation assuming that crowdworkers in developing countries imitate their Western counterparts, without close examination of their experiences and responses to work conditions. This study breaks this epistemological terra nullius to pursue an in-depth examination of workers’ lived experience in a developing country and provide a non-Western perspective. It questions how crowdworkers experience and respond to crowdwork and adopts an inductive approach in examining crowdworkers in Nigeria. Unlike the work precarity thesis, we find that crowdworkers in Nigeria transition and transform crowdwork into long-term employment, drawing on their own cultural heritage, social norms and traditions. Through the lens of the indigenous theory of liminality, we conceptualise crowdwork as liminal digital work and uncover three phases in this transformation process. The study concludes that the agency of workers, their culture and their own context play important roles in their experience of crowdwork. This demonstrates that the in-depth examination of the phenomenon in developing countries could destabilise the dominant knowledge, decoupling it from its origin of production and exposing and examining its implicit and explicit assumptions, and hence advance theorisation