PlanktonID – Combining deep learning, in situ imaging and citizen science to resolve the distribution of zooplanktonin major upwelling regions

Recent publications revealed the global importance of single-celled zooplankton, belonging to the super group Rhizaria and highlighted the need of in-situ imaging to study these fragile organisms. The advance of in situ plankton imaging techniques leads to increasing amounts of image data sets that require identification to different taxonomic levels. Automatic classification by computer algorithms provides the means for fast data availability, however the accuracy of those algorithms still requires manual identification by humans. We combined state of the art automatic image classification by convolutional neural networks (deep learning) with a citizen science project to classify a large dataset of ~ 3 million images from an Underwater Vision Profiler 5 (UVP5). On our website https://planktonid.geomar.de, citizen scientists can confirm or reject the automatic assignment of UVP5 images to different plankton categories in a memory-like game. Inbuilt quality controls and multiple validations per image enable scientific analysis of the citizen science data. In total more than 500 users have validated more than 300.000 images until now. We will present further data on citizen scientist engagement, data quality assessment and the distribution analysis of large protists (Rhizaria) in the Mauretanian, Benguela and Humboldt Current upwelling systems

The value of remote sensing techniques in supporting effective extrapolation across multiple marine spatial scales

The reporting of ecological phenomena and environmental status routinely required point observations, collected with traditional sampling approaches to be extrapolated to larger reporting scales. This process encompasses difficulties that can quickly entrain significant errors. Remote sensing techniques offer insights and exceptional spatial coverage for observing the marine environment. This review provides guidance on (i) the structures and discontinuities inherent within the extrapolative process, (ii) how to extrapolate effectively across multiple spatial scales, and (iii) remote sensing techniques and data sets that can facilitate this process. This evaluation illustrates that remote sensing techniques are a critical component in extrapolation and likely to underpin the production of high-quality assessments of ecological phenomena and the regional reporting of environmental status. Ultimately, is it hoped that this guidance will aid the production of robust and consistent extrapolations that also make full use of the techniques and data sets that expedite this process

A data extraction system for underwater particle holography

Pulsed laser holography is an extremely powerful technique for the study of particle fields as it allows instantaneous, noninvasive high-resolution recording of substantial volumes. By replaying the real image one can obtain the size, shape, position and - if multiple exposures are made - velocity of every object in the recorded field. Manual analysis of large volumes containing thousands of particles is, however, an enormous and time-consuming task, with operator fatigue an unpredictable source of errors. Clearly the value of holographic measurements also depends crucially on the quality of the reconstructed image: not only will poor resolution degrade size and shape measurements, but aberrations such as coma and astigmatism can change the perceived centroid of a particle, affecting position and velocity measurements. For large-scale applications of particle field holography, specifically the in situ recording of marine plankton with 'HoloCam,' we have developed an automated data extraction system that can be readily switched between the in-line and off-axis geometries and provides optimised reconstruction from holograms recorded underwater. As a videocamera is automatically stepped through the 200 by 200 by 1000mm sample volume, image processing and object tracking routines locate and extract particle images for further classification by a separate software module

RAPID : research on automated plankton identification

Author Posting. © Oceanography Society, 2007. This article is posted here by permission of Oceanography Society for personal use, not for redistribution. The definitive version was published in Oceanography 20, 2 (2007): 172-187.When Victor Hensen deployed the first true plankton1 net in 1887, he and his colleagues were attempting to answer three fundamental questions: What planktonic organisms are present in the ocean? How many of each type are present? How does the plankton’s composition change over time? Although answering these questions has remained a central goal of oceanographers, the sophisticated tools available to enumerate planktonic organisms today offer capabilities that Hensen probably could never have imagined.This material is based upon work supported by the National Science Foundation under Grants OCE-0325018, OCE-0324937, OCE-0325167 and OCE-9423471, and the European Union under grants Q5CR-2002-71699, MAS3-ct98-0188, and MAS2-ct92-0015

Automatic plankton quantification using deep features

The study of marine plankton data is vital to monitor the health of the world’s oceans. In recent decades, automatic plankton recognition systems have proved useful to address the vast amount of data collected by specially engineered in situ digital imaging systems. At the beginning, these systems were developed and put into operation using traditional automatic classification techniques, which were fed with handdesigned local image descriptors (such as Fourier features), obtaining quite successful results. In the past few years, there have been many advances in the computer vision community with the rebirth of neural networks. In this paper, we leverage how descriptors computed using Convolutional Neural Networks (CNNs) trained with out-of-domain data are useful to replace hand-designed descriptors in the task of estimating the prevalence of each plankton class in a water sample. To achieve this goal, we have designed a broad set of experiments that show how effective these deep features are when working in combination with state-of-the-art quantification algorithms

Vision-based techniques for automatic marine plankton classification

Plankton are an important component of life on Earth. Since the 19th century, scientists have attempted to quantify species distributions using many techniques, such as direct counting, sizing, and classification with microscopes. Since then, extraordinary work has been performed regarding the development of plankton imaging systems, producing a massive backlog of images that await classification. Automatic image processing and classification approaches are opening new avenues for avoiding time-consuming manual procedures. While some algorithms have been adapted from many other applications for use with plankton, other exciting techniques have been developed exclusively for this issue. Achieving higher accuracy than that of human taxonomists is not yet possible, but an expeditious analysis is essential for discovering the world beyond plankton. Recent studies have shown the imminent development of real-time, in situ plankton image classification systems, which have only been slowed down by the complex implementations of algorithms on low-power processing hardware. This article compiles the techniques that have been proposed for classifying marine plankton, focusing on automatic methods that utilize image processing, from the beginnings of this field to the present day.Funding for open access charge: Universidad de Málaga / CBUA. Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. The authors wish to thank Alonso Hernández-Guerra for his frm support in the development of oceanographic technology. Special thanks to Laia Armengol for her help in the domain of plankton. This study has been funded by Feder of the UE through the RES-COAST Mac-Interreg pro ject (MAC2/3.5b/314). We also acknowledge the European Union projects SUMMER (Grant Agreement 817806) and TRIATLAS (Grant Agreement 817578) from the Horizon 2020 Research and Innovation Programme and the Ministry of Science from the Spanish Government through the Project DESAFÍO (PID2020-118118RB-I00)

Automatic identification and enumeration of algae

A good understanding of the population dynamics of algal communities is vital in many ecological and pollution studies of freshwater and oceanic systems. Present methods require manual counting and identification of algae and can take up to 90 min to obtain a statistically reliable count on a complex population. Several alternative techniques to accelerate the process have been tried on marine samples but none have been completely successful because insufficient effort has been put into verifying the technique before field trials. The objective of the present study has been to assess the potential of in vivo fluorescence of algal pigments as a means of automatically identifying algae. For this work total fluorescence spectroscopy was chosen as the observation technique

In situ analysis for intelligent control

We report a pilot study on in situ analysis of backscatter data for intelligent control of a scientific instrument on an Autonomous Underwater Vehicle (AUV) carried out at the Monterey Bay Aquarium Research Institute (MBARI). The objective of the study is to investigate techniques which use machine intelligence to enable event-response scenarios. Specifically we analyse a set of techniques for automated sample acquisition in the water-column using an electro-mechanical "Gulper", designed at MBARI. This is a syringe-like sampling device, carried onboard an AUV. The techniques we use in this study are clustering algorithms, intended to identify the important distinguishing characteristics of bodies of points within a data sample. We demonstrate that the complementary features of two clustering approaches can offer robust identification of interesting features in the water-column, which, in turn, can support automatic event-response control in the use of the Gulper

Applications of Machine Learning in Chemical and Biological Oceanography

Machine learning (ML) refers to computer algorithms that predict a meaningful output or categorize complex systems based on a large amount of data. ML is applied in various areas including natural science, engineering, space exploration, and even gaming development. This review focuses on the use of machine learning in the field of chemical and biological oceanography. In the prediction of global fixed nitrogen levels, partial carbon dioxide pressure, and other chemical properties, the application of ML is a promising tool. Machine learning is also utilized in the field of biological oceanography to detect planktonic forms from various images (i.e., microscopy, FlowCAM, and video recorders), spectrometers, and other signal processing techniques. Moreover, ML successfully classified the mammals using their acoustics, detecting endangered mammalian and fish species in a specific environment. Most importantly, using environmental data, the ML proved to be an effective method for predicting hypoxic conditions and harmful algal bloom events, an essential measurement in terms of environmental monitoring. Furthermore, machine learning was used to construct a number of databases for various species that will be useful to other researchers, and the creation of new algorithms will help the marine research community better comprehend the chemistry and biology of the ocean.Comment: 58 Pages, 5 Figure