Citizen science frontiers: Efficiency, engagement, and serendipitous discovery with human–machine systems

Citizen science has proved to be a unique and effective tool in helping science and society cope with the ever-growing data rates and volumes that characterize the modern research landscape. It also serves a critical role in engaging the public with research in a direct, authentic fashion and by doing so promotes a better understanding of the processes of science. To take full advantage of the onslaught of data being experienced across the disciplines, it is essential that citizen science platforms leverage the complementary strengths of humans and machines. This Perspectives piece explores the issues encountered in designing human–machine systems optimized for both efficiency and volunteer engagement, while striving to safeguard and encourage opportunities for serendipitous discovery. We discuss case studies from Zooniverse, a large online citizen science platform, and show that combining human and machine classifications can efficiently produce results superior to those of either one alone and how smart task allocation can lead to further efficiencies in the system. While these examples make clear the promise of human–machine integration within an online citizen science system, we then explore in detail how system design choices can inadvertently lower volunteer engagement, create exclusionary practices, and reduce opportunity for serendipitous discovery. Throughout we investigate the tensions that arise when designing a human–machine system serving the dual goals of carrying out research in the most efficient manner possible while empowering a broad community to authentically engage in this research

Citizen science frontiers: Efficiency, engagement, and serendipitous discovery with human–machine systems

Citizen science has proved to be a unique and effective tool in helping science and society cope with the ever-growing data rates and volumes that characterize the modern research landscape. It also serves a critical role in engaging the public with research in a direct, authentic fashion and by doing so promotes a better understanding of the processes of science. To take full advantage of the onslaught of data being experienced across the disciplines, it is essential that citizen science platforms leverage the complementary strengths of humans and machines. This Perspectives piece explores the issues encountered in designing human–machine systems optimized for both efficiency and volunteer engagement, while striving to safeguard and encourage opportunities for serendipitous discovery. We discuss case studies from Zooniverse, a large online citizen science platform, and show that combining human and machine classifications can efficiently produce results superior to those of either one alone and how smart task allocation can lead to further efficiencies in the system. While these examples make clear the promise of human–machine integration within an online citizen science system, we then explore in detail how system design choices can inadvertently lower volunteer engagement, create exclusionary practices, and reduce opportunity for serendipitous discovery. Throughout we investigate the tensions that arise when designing a human–machine system serving the dual goals of carrying out research in the most efficient manner possible while empowering a broad community to authentically engage in this research

Integrating human and machine intelligence in galaxy morphology classification tasks

Quantifying galaxy morphology is a challenging yet scientifically rewarding task. As the scale of data continues to increase with upcoming surveys, traditional classification methods will struggle to handle the load. We present a solution through an integration of visual and automated classifications, preserving the best features of both human and machine. We demonstrate the effectiveness of such a system through a re-analysis of visual galaxy morphology classifications collected during the Galaxy Zoo 2 (GZ2) project. We reprocess the top-level question of the GZ2 decision tree with a Bayesian classification aggregation algorithm dubbed SWAP, originally developed for the Space Warps gravitational lens project. Through a simple binary classification scheme, we increase the classification rate nearly 5-fold classifying 226 124 galaxies in 92 d of GZ2 project time while reproducing labels derived from GZ2 classification data with 95.7 per cent accuracy. We next combine this with a Random Forest machine learning algorithm that learns on a suite of non-parametric morphology indicators widely used for automated morphologies. We develop a decision engine that delegates tasks between human and machine and demonstrate that the combined system provides at least a factor of 8 increase in the classification rate, classifying 210 803 galaxies in just 32 d of GZ2 project time with 93.1 per cent accuracy. As the Random Forest algorithm requires a minimal amount of computational cost, this result has important implications for galaxy morphology identification tasks in the era of Euclid and other large-scale surveys

Galaxy Zoo: morphological classifications for 120 000 galaxies in HST legacy imaging

We present the data release paper for the Galaxy Zoo: Hubble (GZH) project. This is the third phase in a large effort to measure reliable, detailed morphologies of galaxies by using crowdsourced visual classifications of colour composite images. Images in GZH were selected from various publicly-released Hubble Space Telescope Legacy programs conducted with the Advanced Camera for Surveys, with filters that probe the rest-frame optical emission from galaxies out to $z \sim 1$. The bulk of the sample is selected to have m_{I814W} < 23.5,but goes as faint as m_{I814W} < 26.8 for deep images combined over 5 epochs. The median redshift of the combined samples is $z = 0.9 \pm 0.6$, with a tail extending out to $z \sim 4$. The GZH morphological data include measurements of both bulge- and disk-dominated galaxies, details on spiral disk structure that relate to the Hubble type, bar identification, and numerous measurements of clump identification and geometry. This paper also describes a new method for calibrating morphologies for galaxies of different luminosities and at different redshifts by using artificially-redshifted galaxy images as a baseline. The GZH catalogue contains both raw and calibrated morphological vote fractions for 119,849 galaxies, providing the largest dataset to date suitable for large-scale studies of galaxy evolution out to $z \sim 1$

Galaxy Zoo: Are Bars Responsible for the Feeding of Active Galactic Nuclei at 0.2 &lt; z &lt; 1.0?

We present a new study investigating whether active galactic nuclei (AGN) beyond the local universe are preferentially fed via large-scale bars. Our investigation combines data from Chandra and Galaxy Zoo: Hubble (GZH) in the AEGIS, COSMOS, and GOODS-S surveys to create samples of face-on, disc galaxies at 0.2 &lt; z &lt; 1.0. We use a novel method to robustly compare a sample of 120 AGN host galaxies, defined to have 10^42 erg/s &lt; L_X &lt; 10^44 erg/s, with inactive control galaxies matched in stellar mass, rest-frame colour, size, Sersic index, and redshift. Using the GZH bar classifications of each sample, we demonstrate that AGN hosts show no statistically significant enhancement in bar fraction or average bar likelihood compared to closely-matched inactive galaxies. In detail, we find that the AGN bar fraction cannot be enhanced above the control bar fraction by more than a factor of two, at 99.7% confidence. We similarly find no significant difference in the AGN fraction among barred and non-barred galaxies. Thus we find no compelling evidence that large-scale bars directly fuel AGN at 0.21, our findings suggest that large-scale bars have likely never directly been a dominant fueling mechanism for supermassive black hole growth.</z<1.0.