Incentivizing High Quality Crowdwork

We study the causal effects of financial incentives on the quality of crowdwork. We focus on performance-based payments (PBPs), bonus payments awarded to workers for producing high quality work. We design and run randomized behavioral experiments on the popular crowdsourcing platform Amazon Mechanical Turk with the goal of understanding when, where, and why PBPs help, identifying properties of the payment, payment structure, and the task itself that make them most effective. We provide examples of tasks for which PBPs do improve quality. For such tasks, the effectiveness of PBPs is not too sensitive to the threshold for quality required to receive the bonus, while the magnitude of the bonus must be large enough to make the reward salient. We also present examples of tasks for which PBPs do not improve quality. Our results suggest that for PBPs to improve quality, the task must be effort-responsive: the task must allow workers to produce higher quality work by exerting more effort. We also give a simple method to determine if a task is effort-responsive a priori. Furthermore, our experiments suggest that all payments on Mechanical Turk are, to some degree, implicitly performance-based in that workers believe their work may be rejected if their performance is sufficiently poor. Finally, we propose a new model of worker behavior that extends the standard principal-agent model from economics to include a worker's subjective beliefs about his likelihood of being paid, and show that the predictions of this model are in line with our experimental findings. This model may be useful as a foundation for theoretical studies of incentives in crowdsourcing markets.Comment: This is a preprint of an Article accepted for publication in WWW \c{opyright} 2015 International World Wide Web Conference Committe

Analyzing collaborative learning processes automatically

In this article we describe the emerging area of text classification research focused on the problem of collaborative learning process analysis both from a broad perspective and more specifically in terms of a publicly available tool set called TagHelper tools. Analyzing the variety of pedagogically valuable facets of learners’ interactions is a time consuming and effortful process. Improving automated analyses of such highly valued processes of collaborative learning by adapting and applying recent text classification technologies would make it a less arduous task to obtain insights from corpus data. This endeavor also holds the potential for enabling substantially improved on-line instruction both by providing teachers and facilitators with reports about the groups they are moderating and by triggering context sensitive collaborative learning support on an as-needed basis. In this article, we report on an interdisciplinary research project, which has been investigating the effectiveness of applying text classification technology to a large CSCL corpus that has been analyzed by human coders using a theory-based multidimensional coding scheme. We report promising results and include an in-depth discussion of important issues such as reliability, validity, and efficiency that should be considered when deciding on the appropriateness of adopting a new technology such as TagHelper tools. One major technical contribution of this work is a demonstration that an important piece of the work towards making text classification technology effective for this purpose is designing and building linguistic pattern detectors, otherwise known as features, that can be extracted reliably from texts and that have high predictive power for the categories of discourse actions that the CSCL community is interested in

Shape Retrieval of Non-rigid 3D Human Models

3D models of humans are commonly used within computer graphics and vision, and so the ability to distinguish between body shapes is an important shape retrieval problem. We extend our recent paper which provided a benchmark for testing non-rigid 3D shape retrieval algorithms on 3D human models. This benchmark provided a far stricter challenge than previous shape benchmarks. We have added 145 new models for use as a separate training set, in order to standardise the training data used and provide a fairer comparison. We have also included experiments with the FAUST dataset of human scans. All participants of the previous benchmark study have taken part in the new tests reported here, many providing updated results using the new data. In addition, further participants have also taken part, and we provide extra analysis of the retrieval results. A total of 25 different shape retrieval methods are compared

Estimation of interdomain flexibility of N-terminus of factor H using residual dipolar couplings

Characterization of segmental flexibility is needed to understand the biological mechanisms of the very large category of functionally diverse proteins, exemplified by the regulators of complement activation, that consist of numerous compact modules or domains linked by short, potentially flexible, sequences of amino acid residues. The use of NMR-derived residual dipolar couplings (RDCs), in magnetically aligned media, to evaluate interdomain motion is established but only for two-domain proteins. We focused on the three N-terminal domains (called CCPs or SCRs) of the important complement regulator, human factor H (i.e. FH1-3). These domains cooperate to facilitate cleavage of the key complement activation-specific protein fragment, C3b, forming iC3b that no longer participates in the complement cascade. We refined a three-dimensional solution structure of recombinant FH1-3 based on nuclear Overhauser effects and RDCs. We then employed a rudimentary series of RDC datasets, collected in media containing magnetically aligned bicelles (disk-like particles formed from phospholipids) under three different conditions, to estimate interdomain motions. This circumvents a requirement of previous approaches for technically difficult collection of five independent RDC datasets. More than 80% of conformers of this predominantly extended three-domain molecule exhibit flexions of < 40 °. Such segmental flexibility (together with the local dynamics of the hypervariable loop within domain 3), could facilitate recognition of C3b via initial anchoring and eventual reorganization of modules to the conformation captured in the previously solved crystal structure of a C3b:FH1-4 complex

National records of 3000 European bee and hoverfly species: A contribution to pollinator conservation

Pollinators play a crucial role in ecosystems globally, ensuring the seed production of most flowering plants. They are threatened by global changes and knowledge of their distribution at the national and continental levels is needed to implement efficient conservation actions, but this knowledge is still fragmented and/or difficult to access. As a step forward, we provide an updated list of around 3000 European bee and hoverfly species, reflecting their current distributional status at the national level (in the form of present, absent, regionally extinct, possibly extinct or non-native). This work was attainable by incorporating both published and unpublished data, as well as knowledge from a large set of taxonomists and ecologists in both groups. After providing the first National species lists for bees and hoverflies for many countries, we examine the current distributional patterns of these species and designate the countries with highest levels of species richness. We also show that many species are recorded in a single European country, highlighting the importance of articulating European and national conservation strategies. Finally, we discuss how the data provided here can be combined with future trait and Red List data to implement research that will further advance pollinator conservation

Sensitive and Specific Fluorescent Probes for Functional Analysis of the Three Major Types of Mammalian ABC Transporters

An underlying mechanism for multi drug resistance (MDR) is up-regulation of the transmembrane ATP-binding cassette (ABC) transporter proteins. ABC transporters also determine the general fate and effect of pharmaceutical agents in the body. The three major types of ABC transporters are MDR1 (P-gp, P-glycoprotein, ABCB1), MRP1/2 (ABCC1/2) and BCRP/MXR (ABCG2) proteins. Flow cytometry (FCM) allows determination of the functional expression levels of ABC transporters in live cells, but most dyes used as indicators (rhodamine 123, DiOC2(3), calcein-AM) have limited applicability as they do not detect all three major types of ABC transporters. Dyes with broad coverage (such as doxorubicin, daunorubicin and mitoxantrone) lack sensitivity due to overall dimness and thus may yield a significant percentage of false negative results. We describe two novel fluorescent probes that are substrates for all three common types of ABC transporters and can serve as indicators of MDR in flow cytometry assays using live cells. The probes exhibit fast internalization, favorable uptake/efflux kinetics and high sensitivity of MDR detection, as established by multidrug resistance activity factor (MAF) values and Kolmogorov-Smirnov statistical analysis. Used in combination with general or specific inhibitors of ABC transporters, both dyes readily identify functional efflux and are capable of detecting small levels of efflux as well as defining the type of multidrug resistance. The assay can be applied to the screening of putative modulators of ABC transporters, facilitating rapid, reproducible, specific and relatively simple functional detection of ABC transporter activity, and ready implementation on widely available instruments

Heavy genealogy: mapping the currents, contraflows and conflicts of the emergent field of metal studies, 1978-2010

What is metal studies? How can we define and characterize it? How has it emerged as a body of academic enquiry? What are its dominant disciplinary strands, theoretical concepts and preferred methodologies? Which studies have claimed most attention, defined the goals of scholarship, typical research strategies and values? How has the claim for the legitimacy or symbolic value of metal scholarship been achieved (if it has): over time and through gradual acceptance or through conflict and contestation? How can this process of formation, or strategy of legitimation, be mapped, examined and interrogated and which methods of historical, institutional and cultural analysis are best suited to this task? Working with the most complete bibliography to date of published research on heavy metal, music and culture (the MSBD), this article employs Foucault’s archaeological “method” to examine the institutional, cultural and political contexts and conflicts that inform the genealogy of this scholarship. Such analysis reveals a formative, largely negative account of heavy metal to be found in the “sociology of rock”; a large volume of psychology work, examining heavy metal music preference as an indicator of youth risk, deviance and delinquency; sociological work on youth and deviancy critical of the values of this research and its links to social policy and politics; culminating in the work of Weinstein and Walser, who advocate a perspective sympathetic to the values of heavy metal fans themselves. Following Bourdieu, I interpret such symbolic strategies as claims for expertise within the academic field that are high or low in symbolic capital to the extent they can attain disciplinary autonomy. I then go on to examine the most recent strands of research, within cultural studies and ethnomusicology, concerned with the global metal music diaspora, and consider to what extent such work is constitutive of a coherent subfield of metal studies that can be distinguished from earlier work and what the implications of this might be

Duration of adjuvant chemotherapy for breast cancer: a joint analysis of two randomised trials investigating three versus six courses of CMF

Cyclophosphamide, methotrexate and fluorouracil adjuvant combination chemotherapy for breast cancer is currently used for the duration of six monthly courses. We performed a joint analysis of two studies on the duration of adjuvant cyclophosphamide, methotrexate and fluorouracil in patients with node-positive breast cancer to investigate whether three courses of cyclophosphamide, methotrexate and fluorouracil might suffice. The International Breast Cancer Study Group Trial VI randomly assigned 735 pre- and perimenopausal patients to receive ‘classical’ cyclophosphamide, methotrexate and fluorouracil for three consecutive cycles, or the same chemotherapy for six consecutive cycles. The German Breast Cancer Study Group randomised 289 patients to receive either three or six cycles of i.v. cyclophosphamide, methotrexate and fluorouracil day 1, 8. Treatment effects were estimated using Cox regression analysis stratified by clinical trial without further adjustment for covariates. The 5-year disease-free survival per cents (±s.e.) were 54±2% for three cycles and 55±2% for six cycles (n=1024; risk ratio (risk ratio: CMF×3/CMF×6), 1.00; 95% confidence interval, 0.85 to 1.18; P=0.99). Use of three rather than six cycles was demonstrated to be adequate in both studies for patients at least 40-years-old with oestrogen-receptor-positive tumours (n=594; risk ratio, 0.86; 95% confidence interval, 0.68 to 1.08; P=0.19). In fact, results slightly favoured three cycles over six for this subgroup, and the 95% confidence interval excluded an adverse effect of more than 2% with respect to absolute 5-year survival. In contrast, three cycles appeared to be possibly inferior to six cycles for women less than 40-years-old (n=190; risk ratio, 1.25; 95% confidence interval, 0.87 to 1.80; P=0.22) and for women with oestrogen-receptor-negative tumours (n=302; risk ratio, 1.15; 95% confidence interval, 0.85 to 1.57; P=0.37). Thus, three initial cycles of adjuvant cyclophosphamide, methotrexate and fluorouracil chemotherapy were as effective as six cycles for older patients (40-years-old) with oestrogen-receptor-positive tumours, while six cycles of adjuvant cyclophosphamide, methotrexate and fluorouracil might still be required for other cohorts. Because endocrine therapy with tamoxifen and GnRH analogues is now available for younger women with oestrogen-receptor-positive tumours, the need for six cycles of cyclophosphamide, methotrexate and fluorouracil is unclear and requires further investigation