How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets

Crowdsourced annotation is vital to both collecting labelled data to train and test automated content moderation systems and to support human-in-the-loop review of system decisions. However, annotation tasks such as judging hate speech are subjective and thus highly sensitive to biases stemming from annotator beliefs, characteristics and demographics. We conduct two crowdsourcing studies on Mechanical Turk to examine annotator bias in labelling sexist and misogynistic hate speech. Results from 109 annotators show that annotator political inclination, moral integrity, personality traits, and sexist attitudes significantly impact annotation accuracy and the tendency to tag content as hate speech. In addition, semi-structured interviews with nine crowd workers provide further insights regarding the influence of subjectivity on annotations. In exploring how workers interpret a task - shaped by complex negotiations between platform structures, task instructions, subjective motivations, and external contextual factors - we see annotations not only impacted by worker factors but also simultaneously shaped by the structures under which they labour.Comment: Accepted to the 11th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2023

Update on the global epidemiology of intussusception: a systematic review of incidence rates, age distributions and case-fatality ratios among children aged <5 years, before the introduction of rotavirus vaccination.

BACKGROUND: In some countries that have introduced oral rotavirus vaccines, a small but elevated risk of intussusception-a rare bowel disorder-has been reported. Updated estimates on the global epidemiology of intussusception are needed to help predict the potential number of intussusception cases that could be caused by the vaccine in different settings. METHODS: We estimated incidence rates, age distributions and case-fatality ratios (CFRs) for intussusception hospital admissions among children aged <5 years, before the introduction of rotavirus vaccines. We included all articles identified in a systematic review between January 2002 and January 2018, and contacted authors for more granular unpublished data on age distributions. RESULTS: We identified 128 articles containing 227 country datasets (61 age distributions, 71 incidence rates and 95 CFRs). The median age of intussusception ranged from 29 weeks in Africa (83% of cases in the first year of life) to 70 weeks in the Western Pacific region (35% of cases in the first year of life). The median (range) annual incidence of intussusception hospital admissions per 100 000 aged <1 year ranged from 34 (13-56) in Africa to 90 (9-380) in the Western Pacific region. We found extreme differences between the CFRs in Africa (1 death in every 10 hospital admissions) and the rest of the world (fewer than 1 death in every 100-2000 hospital admissions). CONCLUSION: Intussusception epidemiology varies by country and region. Understanding and recognizing these differences will be important when assessing the potential number of intussusception cases associated with rotavirus vaccines

Exome array analysis of adverse reactions to fluoropyrimidine-based therapy for gastrointestinal cancer.

Fluoropyrimidines, including 5-fluororacil (5FU) and its pro-drug Capecitabine, are the common treatment for colorectal, breast, neck and head cancers-either as monotherapy or in combination therapy. Adverse reactions (ADRs) to the treatment are common and often result in treatment discontinuation or dose reduction. Factors contributing to ADRs, including genetic variation, are poorly characterized. We performed exome array analysis to identify genetic variants that contribute to adverse reactions. Our final dataset consisted of 504 European ancestry individuals undergoing fluoropyrimidine-based therapy for gastrointestinal cancer. A subset of 254 of these were treated with Capecitabine. All individuals were genotyped on the Illumina HumanExome Array. Firstly, we performed SNP and gene-level analyses of protein-altering variants on the array to identify novel associations the following ADRs, which were grouped into four phenotypes based on symptoms of diarrhea, mucositis, and neutropenia and hand-and-foot syndrome. Secondly, we performed detailed analyses of the HLA region on the same phenotypes after imputing the HLA alleles and amino acids. No protein-altering variants, or sets of protein-altering variants collapsed into genes, were associated with the main outcomes after Bonferroni correction. We found evidence that the HLA region was enriched for associations with Hand-and-Foot syndrome (p = 0.023), but no specific SNPs or HLA alleles were significant after Bonferroni correction. Larger studies will be required to characterize the genetic contribution to ADRs to 5FU. Future studies that focus on the HLA region are likely to be fruitful

An Inventory and Assessment of Sample Sources for Survey Research with Agricultural Producers in the U.S.

Researchers need probability samples to collect representative survey data about the behaviors and attitudes of agricultural producers they study in relation to the natural resources that they manage, yet obtaining accurate and complete sampling frames is challenging. We extract data from a publication database to identify the most commonly used sampling frame sources in survey research of agricultural producers in the U.S., finding that government program participant lists are used most often, while private vendor samples are increasingly being purchased. Based on our research experience, we find that for many projects, private vendors can provide the most rigorous samples. Given that survey methods remain a useful and popular method for studying the behaviors and attitudes of producers on a variety of topics, such an assessment and guide is needed for researchers and practitioners

Best emollients for eczema (BEE) – comparing four types of emollients in children with eczema: protocol for randomised trial and nested qualitative study

Introduction Atopic dermatitis/eczema affects around 20% of children and is characterised by inflamed, dry, itchy skin. Guidelines recommend ‘leave-on’ emollients that are applied directly to the skin to add or trap moisture and used regularly, they can soothe, enhance the skin barrier and may prevent disease ‘flares’. However, the suitability of the many different emollients varies between people and there is little evidence to help prescribers and parents and carers decide which type to try first.Methods and analysis Design: pragmatic, multicentre, individually randomised, parallel group superiority trial of four types of emollient (lotions, creams, gel or ointments).Setting: general practitioner surgeries in England.Participants: children aged over 6 months and less than 12 years with mild-to-severe eczema and no known sensitivity to study emollients.Interventions: study-approved lotion, cream, gel or ointment as the only leave-on emollient for 16 weeks, with directions to apply twice daily and as required. Other treatments, such as topical corticosteroids, used as standard care.Follow-up: 52 weeks.Primary outcome: validated patient-orientated eczema measure measured weekly for 16 weeks.Secondary outcomes: eczema signs (Eczema Area Severity Index) by masked researcher, treatment use, parent satisfaction, adverse events, child and family quality of life (Atopic Dermatitis Quality of Life, Child Health Utility 9D and Dermatitis Family Impact).Sample size: 520 participants (130 per group).Analysis: intention-to-treat using linear mixed models for repeated measures.Nested qualitative study: audio-recording of sample of baseline appointments and up to 60 interviews with participants at 4 and 16 weeks, interviews to be transcribed and analysed thematically.Ethics and dissemination Ethics approval granted by the NHS REC (South West - Central Bristol Research Ethics Committee 17/SW/0089). Findings will be presented at conferences, published in open-access peer-reviewed journals and the study website; and summaries shared with key stakeholders

Parameterization Effects in the analysis of AMI Sunyaev-Zel'dovich Observations

Most Sunyaev--Zel'dovich (SZ) and X-ray analyses of galaxy clusters try to constrain the cluster total mass and/or gas mass using parameterised models and assumptions of spherical symmetry and hydrostatic equilibrium. By numerically exploring the probability distributions of the cluster parameters given the simulated interferometric SZ data in the context of Bayesian methods, and assuming a beta-model for the electron number density we investigate the capability of this model and analysis to return the simulated cluster input quantities via three rameterisations. In parameterisation I we assume that the T is an input parameter. We find that parameterisation I can hardly constrain the cluster parameters. We then investigate parameterisations II and III in which fg(r200) replaces temperature as a main variable. In parameterisation II we relate M_T(r200) and T assuming hydrostatic equilibrium. We find that parameterisation II can constrain the cluster physical parameters but the temperature estimate is biased low. In parameterisation III, the virial theorem replaces the hydrostatic equilibrium assumption. We find that parameterisation III results in unbiased estimates of the cluster properties. We generate a second simulated cluster using a generalised NFW (GNFW) pressure profile and analyse it with an entropy based model to take into account the temperature gradient in our analysis and improve the cluster gas density distribution. This model also constrains the cluster physical parameters and the results show a radial decline in the gas temperature as expected. The mean cluster total mass estimates are also within 1 sigma from the simulated cluster true values. However, we find that for at least interferometric SZ analysis in practice at the present time, there is no differences in the AMI visibilities between the two models. This may of course change as the instruments improve.Comment: 19 pages, 13 tables, 24 figure

Association of cardiometabolic microRNAs with COVID-19 severity and mortality

AIMS: Coronavirus disease 2019 (COVID-19) can lead to multiorgan damage. MicroRNAs (miRNAs) in blood reflect cell activation and tissue injury. We aimed to determine the association of circulating miRNAs with COVID-19 severity and 28 day intensive care unit (ICU) mortality. METHODS AND RESULTS: We performed RNA-Seq in plasma of healthy controls (n = 11), non-severe (n = 18), and severe (n = 18) COVID-19 patients and selected 14 miRNAs according to cell- and tissue origin for measurement by reverse transcription quantitative polymerase chain reaction (RT–qPCR) in a separate cohort of mild (n = 6), moderate (n = 39), and severe (n = 16) patients. Candidates were then measured by RT–qPCR in longitudinal samples of ICU COVID-19 patients (n = 240 samples from n = 65 patients). A total of 60 miRNAs, including platelet-, endothelial-, hepatocyte-, and cardiomyocyte-derived miRNAs, were differentially expressed depending on severity, with increased miR-133a and reduced miR-122 also being associated with 28 day mortality. We leveraged mass spectrometry-based proteomics data for corresponding protein trajectories. Myocyte-derived (myomiR) miR-133a was inversely associated with neutrophil counts and positively with proteins related to neutrophil degranulation, such as myeloperoxidase. In contrast, levels of hepatocyte-derived miR-122 correlated to liver parameters and to liver-derived positive (inverse association) and negative acute phase proteins (positive association). Finally, we compared miRNAs to established markers of COVID-19 severity and outcome, i.e. SARS-CoV-2 RNAemia, age, BMI, D-dimer, and troponin. Whilst RNAemia, age and troponin were better predictors of mortality, miR-133a and miR-122 showed superior classification performance for severity. In binary and triplet combinations, miRNAs improved classification performance of established markers for severity and mortality. CONCLUSION: Circulating miRNAs of different tissue origin, including several known cardiometabolic biomarkers, rise with COVID-19 severity. MyomiR miR-133a and liver-derived miR-122 also relate to 28 day mortality. MiR-133a reflects inflammation-induced myocyte damage, whilst miR-122 reflects the hepatic acute phase response

Detailed SZ study of 19 LoCuSS galaxy clusters: masses and temperatures out to the virial radius

We present 16-GHz AMI SZ observations of 19 clusters with L_X >7x10^37 W (h50=1) selected from the LoCuS survey (0.142<z<0.295) and of A1758b, in the FoV of A1758a. We detect 17 clusters with 5-23sigma peak surface brightnesses. Cluster parameters are obtained using a Bayesian cluster analysis. We fit isothermal beta-models to our data and assume the clusters are virialized (with all the kinetic energy in gas internal energy). Our gas temperature, T_AMI, is derived from AMI SZ data, not from X-ray spectroscopy. Cluster parameters internal to r500 are derived assuming HSE. We find: (i) Different gNFW parameterizations yield significantly different parameter degeneracies. (ii) For h70 = 1, we find the virial radius r200 to be typically 1.6+/-0.1 Mpc and the total mass M_T(r200) typically to be 2.0-2.5xM_T(r500).(iii) Where we have found M_T X-ray (X) and weak-lensing (WL) values in the literature, there is good agreement between WL and AMI estimates (with M_{T,AMI}/M_{T,WL} =1.2^{+0.2}_{-0.3} and =1.0+/-0.1 for r500 and r200, respectively). In comparison, most Suzaku/Chandra estimates are higher than for AMI (with M_{T,X}/M_{T,AMI}=1.7+/-0.2 within r500), particularly for the stronger mergers.(iv) Comparison of T_AMI to T_X sheds light on high X-ray masses: even at large r, T_X can substantially exceed T_AMI in mergers. The use of these higher T_X values will give higher X-ray masses. We stress that large-r T_SZ and T_X data are scarce and must be increased. (v) Despite the paucity of data, there is an indication of a relation between merger activity and SZ ellipticity. (vi) At small radius (but away from any cooling flow) the SZ signal (and T_AMI) is less sensitive to ICM disturbance than the X-ray signal (and T_X) and, even at high r, mergers affect n^2-weighted X-ray data more than n-weighted SZ, implying significant shocking or clumping or both occur even in the outer parts of mergers.Comment: 45 pages, 33 figures, 13 tables Accepted for publication in MNRA