A hidden Markov model-based acoustic cicada detector for crowdsourced smartphone biodiversity monitoring

In recent years, the field of computational sustainability has striven to apply artificial intelligence techniques to solve ecological and environmental problems. In ecology, a key issue for the safeguarding of our planet is the monitoring of biodiversity. Automated acoustic recognition of species aims to provide a cost-effective method for biodiversity monitoring. This is particularly appealing for detecting endangered animals with a distinctive call, such as the New Forest cicada. To this end, we pursue a crowdsourcing approach, whereby the millions of visitors to the New Forest, where this insect was historically found, will help to monitor its presence by means of a smartphone app that can detect its mating call. Existing research in the field of acoustic insect detection has typically focused upon the classification of recordings collected from fixed field microphones. Such approaches segment a lengthy audio recording into individual segments of insect activity, which are independently classified using cepstral coefficients extracted from the recording as features. This paper reports on a contrasting approach, whereby we use crowdsourcing to collect recordings via a smartphone app, and present an immediate feedback to the users as to whether an insect has been found. Our classification approach does not remove silent parts of the recording via segmentation, but instead uses the temporal patterns throughout each recording to classify the insects present. We show that our approach can successfully discriminate between the call of the New Forest cicada and similar insects found in the New Forest, and is robust to common types of environment noise. A large scale trial deployment of our smartphone app collected over 6000 reports of insect activity from over 1000 users. Despite the cicada not having been rediscovered in the New Forest, the effectiveness of this approach was confirmed for both the detection algorithm, which successfully identified the same cicada through the app in countries where the same species is still present, and of the crowdsourcing methodology, which collected a vast number of recordings and involved thousands of contributors.</p

Listening to the forest and its curators: lessons learnt from a bioacoustic smartphone application deployment

Our natural environment is complex and sensitive, and is home to a number of species on the verge of extinction. Surveying is one approach to their preservation, and can be supported by technology. This paper presents the deployment of a smartphone-based citizen science biodiversity application. Our findings from interviews with members of the biodiversity community revealed a tension between the technology and their established working practices. From our experience, we present a series of general guidelines for those designing citizen science apps Full Citation Moran, Stuart, Pantidi, Nadia, Rodden, Tom, Chamberlain, Alan, Griffiths, Chloe, Zilli, Davide, Merrett, Geoff V. and Rogers, Alex (2014) Listening to the forest and its curators: lessons learnt from a bioacoustic smartphone application deployment. In, ACM CHI Conference on Human Factors in Computing Systems, Toronto, CA, 26 Apr - 01 May 2014. (doi:10.1145/2556288.255702)

Mosquito Detection with Neural Networks: The Buzz of Deep Learning

Many real-world time-series analysis problems are characterised by scarce data. Solutions typically rely on hand-crafted features extracted from the time or frequency domain allied with classification or regression engines which condition on this (often low-dimensional) feature vector. The huge advances enjoyed by many application domains in recent years have been fuelled by the use of deep learning architectures trained on large data sets. This paper presents an application of deep learning for acoustic event detection in a challenging, data-scarce, real-world problem. Our candidate challenge is to accurately detect the presence of a mosquito from its acoustic signature. We develop convolutional neural networks (CNNs) operating on wavelet transformations of audio recordings. Furthermore, we interrogate the network's predictive power by visualising statistics of network-excitatory samples. These visualisations offer a deep insight into the relative informativeness of components in the detection problem. We include comparisons with conventional classifiers, conditioned on both hand-tuned and generic features, to stress the strength of automatic deep feature learning. Detection is achieved with performance metrics significantly surpassing those of existing algorithmic methods, as well as marginally exceeding those attained by individual human experts.Comment: For data and software related to this paper, see http://humbug.ac.uk/kiskin2017/. Submitted as a conference paper to ECML 201

Field testing a rare species bioacoustic smartphone application: Challenges and future considerations

The New Forest cicada is a declining species native to the UK, and the last unconfirmed sighting was in 2000. One of the difficulties in identifying the cicada is that it sings at a high frequency typically inaudible to adults. In this paper we describe a field test of a novel citizen science smartphone application designed to detect and classify the cicada's call. We discuss some of the obstacles to studying this novel technology, and describe the results from a user trial with a simulated cicada. Our observations are then used to inform a series of design considerations for those developing a similar class of application, and improvements for the application itself

Automated classification of bees and hornet using acoustic analysis of their flight sounds

International audienceAbstractTo investigate how to accurately identify bee species using their sounds, we conducted acoustic analysis to identify three pollinating bee species (Apis mellifera, Bombus ardens, Tetralonia nipponensis) and a hornet (Vespa simillima xanthoptera) by their flight sounds. Sounds of the insects and their environment (background noises and birdsong) were recorded in the field. The use of fundamental frequency and mel-frequency cepstral coefficients to describe feature values of the sounds, and supported vector machines to classify the sounds, correctly distinguished sound samples from environmental sounds with high recalls and precision (0.96–1.00). At the species level, our approach could classify the insect species with relatively high recalls and precisions (0.7–1.0). The flight sounds of V.s. xanthoptera, in particular, were perfectly identified (precision and recall 1.0). Our results suggest that insect flight sounds are potentially useful for detecting bees and quantifying their activity

Automated classification of bees and hornet using acoustic analysis of their flight sounds

To investigate how to accurately identify bee species using their sounds, we conducted acoustic analysis to identify three pollinating bee species (Apis mellifera, Bombus ardens, Tetralonia nipponensis) and a hornet (Vespa simillima xanthoptera) by their flight sounds. Sounds of the insects and their environment (background noises and birdsong) were recorded in the field. The use of fundamental frequency and mel-frequency cepstral coefficients to describe feature values of the sounds, and supported vector machines to classify the sounds, correctly distinguished sound samples from environmental sounds with high recalls and precision (0.96–1.00). At the species level, our approach could classify the insect species with relatively high recalls and precisions (0.7–1.0). The flight sounds of V.s. xanthoptera, in particular, were perfectly identified (precision and recall 1.0). Our results suggest that insect flight sounds are potentially useful for detecting bees and quantifying their activity

Is the Insect Apocalypse upon us? How to Find Out

In recent decades, entomologists have documented alarming declines in occurrence, taxonomic richness, and geographic range of insects around the world. Additionally, some recent studies have reported that insect abundance and biomass, often of common species, are rapidly declining, which has led some to dub the phenomenon an “Insect Apocalypse”. Recent reports are sufficiently robust to justify immediate actions to protect insect biodiversity worldwide. We caution, however, that we do not yet have the data to assess large-scale spatial patterns in the severity of insect trends. Most documented collapses are from geographically restricted studies and, alone, do not allow us to draw conclusions about insect declines on continental or global scales, especially with regards to future projections of total insect biomass, abundance, and extinction. There are many challenges to understanding insect declines: only a small fraction of insect species have had any substantial population monitoring, millions of species remain unstudied, and most of the long-term population data for insects come from human-dominated landscapes in western and northern Europe. But there are still concrete steps we can take to improve our understanding of potential declines. Here, we review the challenges scientists face in documenting insect population and diversity trends, including communicating their findings, and recommend research approaches needed to address these challenges

Emerging opportunities and challenges for passive acoustics in ecological assessment and monitoring

1. High-throughput environmental sensing technologies are increasingly central to global monitoring of the ecological impacts of human activities. In particular, the recent boom in passive acoustic sensors has provided efficient, noninvasive, and taxonomically broad means to study wildlife populations and communities, and monitor their responses to environmental change. However, until recently, tech-nological costs and constraints have largely confined research in passive acoustic monitoring (PAM) to a handful of taxonomic groups (e.g., bats, cetaceans, birds), often in relatively small-scale, proof-of-concept studies.2. The arrival of low-cost, open-source sensors is now rapidly expanding access to PAM technologies, making it vital to evaluate where these tools can contribute to broader efforts in ecology and biodiversity research. Here, we synthesise and critically assess the current emerging opportunities and challenges for PAM for ecological assessment and monitoring of both species populations and communities.3. We show that terrestrial and marine PAM applications are advancing rapidly, fa-cilitated by emerging sensor hardware, the application of machine learning inno-vations to automated wildlife call identification, and work towards developing acoustic biodiversity indicators. However, the broader scope of PAM research remains constrained by limited availability of reference sound libraries and open-source audio processing tools, especially for the tropics, and lack of clarity around the accuracy, transferability and limitations of many analytical methods.4. In order to improve possibilities for PAM globally, we emphasise the need for col-laborative work to develop standardised survey and analysis protocols, publicly archived sound libraries, multiyear audio datasets, and a more robust theoretical and analytical framework for monitoring vocalising animal communities