The DeepFaune initiative: a collaborative effort towards the automatic identification of the French fauna in camera-trap images

Abstract Camera-traps have revolutionized the way ecologists monitor biodiversity and population abundances. Their full potential is however only realized when the hundreds of thousands of images collected can be rapidly classified with minimal human intervention. Machine learning approaches, and in particular deep learning methods, have allowed extraordinary progress towards this end. Trained classification models remain rare however, and for instance are only emerging for the European fauna. This can be explained by the technical expertise they require but also by the limited availability of large datasets of annotated pictures, which are key to obtaining successful recognition models. In this context, we set-up the DeepFaune initiative ( https://deepfaune.cnrs.fr ), a large-scale collaboration between dozens of partners involved in research, conservation and management of wildlife in France. The aim of DeepFaune is to aggregate individual datasets of annotated pictures to train species classification models based on convolutional neural networks, an established deeplearning approach. Here we report on our first milestone, a two-step pipeline built upon the MegaDetector algorithm for detection (discarding empty pictures and cropping the animal) and a classification model for 18 species or higher-level taxa as well as people and vehicles. The classification model achieved 92% validation accuracy and showed > 90% sensitivity and specificity for many classes. Most importantly, these performances were generally conserved when tested on an independent out-of-sample dataset. In addition, we developed a cross-platform graphical-user-interface that allows running the pipeline on images stored locally on a personal computer. In conclusion, the DeepFaune initiative provides a freely available (for non-commercial purposes) toolbox with high performance to classify the French fauna in camera-trap images

The DeepFaune initiative: a collaborative effort towards the automatic identification of Europeanfauna in camera trap images

Camera traps have revolutionized how ecologists monitor wildlife, but their full potential is realized only when the hundreds of thousands of collected images can be readily classified with minimal human intervention. Deep-learning classification models have allowed extraordinary progress towards this end, but trained models remain rare and are only now emerging for European fauna. We report on the first milestone of the DeepFaune initiative (https://www.deepfaune.cnrs.fr), a large-scale collaboration between more than 50 partners involved in wildlife research, conservation and management in France. We developed aclassification model trained to recognize 26 species or higher-level taxa that are common in Europe, with an emphasis on mammals. The classification model achieved 0.97 validation accuracy and often >0.95 precision and recall for many classes. These performances were generally higher than 0.90 when tested on independent out-of-sample datasets for which we used image redundancy contained in sequences of images. We implemented our model in a software to classify images stored locally on a personal computer, so as to provide a free, user-friendly and high-performance tool for wildlife practitioners to automatically classify camera trap images. The DeepFaune initiative is an ongoing project, with new partners joining regularly,which allows us to continuously add new species to the classification model