118 research outputs found

    Boomerang: Rebounding the consequences of reputation feedback on crowdsourcing platforms

    Get PDF
    Paid crowdsourcing platforms suffer from low-quality workand unfair rejections, but paradoxically, most workers and requesters have high reputation scores. These inflated scores, which make high-quality work and workers difficult to find,stem from social pressure to avoid giving negative feedback. We introduce Boomerang, a reputation system for crowdsourcing that elicits more accurate feedback by rebounding the consequences of feedback directly back onto the person who gave it. With Boomerang, requesters find that their highly rated workers gain earliest access to their future tasks, and workers find tasks from their highly-rated requesters at the top of their task feed. Field experiments verify that Boomerang causes both workers and requesters to provide feedback that is more closely aligned with their private opinions. Inspired by a game-theoretic notion of incentive-compatibility, Boomerang opens opportunities for interaction design to incentivize honest reporting over strategic dishonesty

    Crowd guilds: Worker-led reputation and feedback on crowdsourcing platforms

    Get PDF
    Crowd workers are distributed and decentralized. While decentralization is designed to utilize independent judgment to promote high-quality results, it paradoxically undercuts behaviors and institutions that are critical to high-quality work. Reputation is one central example: crowdsourcing systems depend on reputation scores from decentralized workers and requesters, but these scores are notoriously inflated and uninformative. In this paper, we draw inspiration from historical worker guilds (e.g., in the silk trade) to design and implement crowd guilds: centralized groups of crowd workers who collectively certify each other’s quality through double-blind peer assessment. A two-week field experiment compared crowd guilds to a traditional decentralized crowd work model. Crowd guilds produced reputation signals more strongly correlated with ground-truth worker quality than signals available on current crowd working platforms, and more accurate than in the traditional model

    Prototype tasks: Improving crowdsourcing results through rapid, iterative task design

    Get PDF
    Low-quality results have been a long-standing problem on microtask crowdsourcing platforms, driving away requesters and justifying low wages for workers. To date, workers have been blamed for low-quality results: they are said to make as little effort as possible, do not pay attention to detail, and lack expertise. In this paper, we hypothesize that requesters may also be responsible for low-quality work: they launch unclear task designs that confuse even earnest workers, under-specify edge cases, and neglect to include examples. We introduce prototype tasks, a crowdsourcing strategy requiring all new task designs to launch a small number of sample tasks. Workers attempt these tasks and leave feedback, enabling the requester to iterate on the design before publishing it. We report a field experiment in which tasks that underwent prototype task iteration produced higher-quality work results than the original task designs. With this research, we suggest that a simple and rapid iteration cycle can improve crowd work, and we provide empirical evidence that requester “quality” directly impacts result quality

    The Daemo crowdsourcing marketplace

    Get PDF
    The success of crowdsourcing markets is dependent on a strong foundation of trust between workers and requesters. In current marketplaces, workers and requesters are often unable to trust each other’s quality, and their mental models of tasks are misaligned due to ambiguous instructions or confusing edge cases. This breakdown of trust typically arises from (1) flawed reputation systems which do not accurately reflect worker and requester quality, and from (2) poorly designed tasks. In this demo, we present how Boomerang and Prototype Tasks, the fundamental building blocks of the Daemo crowdsourcing marketplace, help restore trust between workers and requesters. Daemo’s Boomerang reputation system incentivizes alignment between opinion and ratings by determining the likelihood that workers and requesters will work together in the future based on how they rate each other. Daemo’s Prototype tasks require that new tasks go through a feedback iteration phase with a small number of workers so that requesters can revise their instructions and task designs before launch

    Multifaceted roles of GSK-3 and Wnt/ĂƒĆœĂ‚ÂČ-catenin in hematopoiesis and leukemogenesis: opportunities for therapeutic intervention

    Get PDF
    Glycogen synthase kinase-3 (GSK-3) is well documented to participate in a complex array of critical cellular processes. It was initially identified in rat skeletal muscle as a serine/threonine kinase that phosphorylated and inactivated glycogen synthase. This versatile protein is involved in numerous signaling pathways that influence metabolism, embryogenesis, differentiation, migration, cell cycle progression and survival. Recently, GSK-3 has been implicated in leukemia stem cell pathophysiology and may be an appropriate target for its eradication. In this review, we will discuss the roles that GSK-3 plays in hematopoiesis and leukemogenesis as how this pivotal kinase can interact with multiple signaling pathways such as: Wnt/ÎÂČ-catenin, phosphoinositide 3-kinase (PI3K)/phosphatase and tensin homolog (PTEN)/Akt/mammalian target of rapamycin (mTOR), Ras/Raf/MEK/extracellular signal-regulated kinase (ERK), Notch and others. Moreover, we will discuss how targeting GSK-3 and these other pathways can improve leukemia therapy and may overcome therapeutic resistance. In summary, GSK-3 is a crucial regulatory kinase interacting with multiple pathways to control various physiological processes, as well as leukemia stem cells, leukemia progression and therapeutic resistance. GSK-3 and Wnt are clearly intriguing therapeutic targets

    Molecular mechanisms of cell death: recommendations of the Nomenclature Committee on Cell Death 2018.

    Get PDF
    Over the past decade, the Nomenclature Committee on Cell Death (NCCD) has formulated guidelines for the definition and interpretation of cell death from morphological, biochemical, and functional perspectives. Since the field continues to expand and novel mechanisms that orchestrate multiple cell death pathways are unveiled, we propose an updated classification of cell death subroutines focusing on mechanistic and essential (as opposed to correlative and dispensable) aspects of the process. As we provide molecularly oriented definitions of terms including intrinsic apoptosis, extrinsic apoptosis, mitochondrial permeability transition (MPT)-driven necrosis, necroptosis, ferroptosis, pyroptosis, parthanatos, entotic cell death, NETotic cell death, lysosome-dependent cell death, autophagy-dependent cell death, immunogenic cell death, cellular senescence, and mitotic catastrophe, we discuss the utility of neologisms that refer to highly specialized instances of these processes. The mission of the NCCD is to provide a widely accepted nomenclature on cell death in support of the continued development of the field
    • 

    corecore