Perspectives in machine learning for wildlife conservation

Data acquisition in animal ecology is rapidly accelerating due to inexpensive and accessible sensors such as smartphones, drones, satellites, audio recorders and bio-logging devices. These new technologies and the data they generate hold great potential for large-scale environmental monitoring and understanding, but are limited by current data processing approaches which are inefficient in how they ingest, digest, and distill data into relevant information. We argue that machine learning, and especially deep learning approaches, can meet this analytic challenge to enhance our understanding, monitoring capacity, and conservation of wildlife species. Incorporating machine learning into ecological workflows could improve inputs for population and behavior models and eventually lead to integrated hybrid modeling tools, with ecological models acting as constraints for machine learning models and the latter providing data-supported insights. In essence, by combining new machine learning approaches with ecological domain knowledge, animal ecologists can capitalize on the abundance of data generated by modern sensor technologies in order to reliably estimate population abundances, study animal behavior and mitigate human/wildlife conflicts. To succeed, this approach will require close collaboration and cross-disciplinary education between the computer science and animal ecology communities in order to ensure the quality of machine learning approaches and train a new generation of data scientists in ecology and conservation

Applications of ISES for vegetation and land use

Remote sensing relative to applications involving vegetation cover and land use is reviewed to consider the potential benefits to the Earth Observing System (Eos) of a proposed Information Sciences Experiment System (ISES). The ISES concept has been proposed as an onboard experiment and computational resource to support advanced experiments and demonstrations in the information and earth sciences. Embedded in the concept is potential for relieving the data glut problem, enhancing capabilities to meet real-time needs of data users and in-situ researchers, and introducing emerging technology to Eos as the technology matures. These potential benefits are examined in the context of state-of-the-art research activities in image/data processing and management

Expanding NEON biodiversity surveys with new instrumentation and machine learning approaches

A core goal of the National Ecological Observatory Network (NEON) is to measure changes in biodiversity across the 30-yr horizon of the network. In contrast to NEON’s extensive use of automated instruments to collect environmental data, NEON’s biodiversity surveys are almost entirely conducted using traditional human-centric field methods. We believe that the combination of instrumentation for remote data collection and machine learning models to process such data represents an important opportunity for NEON to expand the scope, scale, and usability of its biodiversity data collection while potentially reducing long-term costs. In this manuscript, we first review the current status of instrument-based biodiversity surveys within the NEON project and previous research at the intersection of biodiversity, instrumentation, and machine learning at NEON sites. We then survey methods that have been developed at other locations but could potentially be employed at NEON sites in future. Finally, we expand on these ideas in five case studies that we believe suggest particularly fruitful future paths for automated biodiversity measurement at NEON sites: acoustic recorders for sound-producing taxa, camera traps for medium and large mammals, hydroacoustic and remote imagery for aquatic diversity, expanded remote and ground-based measurements for plant biodiversity, and laboratory-based imaging for physical specimens and samples in the NEON biorepository. Through its data science-literate staff and user community, NEON has a unique role to play in supporting the growth of such automated biodiversity survey methods, as well as demonstrating their ability to help answer key ecological questions that cannot be answered at the more limited spatiotemporal scales of human-driven surveys

Modelagem de abundância com drones : detectabilidade, desenho amostral e revisão automática de imagens em um estudo com cervos-do-pantanal

Entender como a abundância de uma espécie se distribui no espaço e/ou no tempo é uma questão fundamental em ecologia e conservação e ajuda, por exemplo, a elucidar relações entre a heterogeneidade de paisagens e populações ou compreender influência de predação na distribuição de indivíduos. Informações de tamanho populacional também são essenciais para avaliar risco de extinção, monitorar populações ameaçadas e planejar ações de conservação. Modelar a abundância de cervos-do-pantanal (Blastocerus dichotomus), sendo um grande herbívoro da América do Sul, pode ser importante para entender relações da espécie com a variação espacial da produtividade primária, das áreas úmidas que a espécie ocupa e do seu principal predador, a onça- pintada. Além disso, por estar ameaçado de extinção, estimar a abundância de cervos pode contribuir para avaliar populações relictuais da espécie, assim como monitorar populações após grandes eventos, como os incêndios de 2020 no Pantanal. Porém, acessar estimativas de abundância confiáveis de maneira eficiente requer métodos robustos que levem em conta os possíveis erros nas contagens e que forneçam as estimativas em tempo hábil, além de um desenho amostral otimizado para aproveitar os recursos geralmente escassos. Os drones tem aparecido como uma ferramenta versátil e custo-efetiva para amostragem de populações animais e vêm sendo aplicados para várias espécies diferentes nos mais variados contextos ecológicos. Como um método emergente, o uso de drones na ecologia fornece oportunidades para explorar novas possibilidades de amostragem e análise de dados, ao mesmo tempo em que pode apresentar novos desafios. Nesta tese, i) exploro oportunidade e desafios na utilização de drones para modelagem de abundância de animais, abordando questões de erros de detecção, desenho amostral e como lidar com os grandes bancos de imagens gerados; e ii) aplico os métodos desenvolvidos para estudar a variação na abundância de cervo-do- pantanal, assim como estabelecer uma abordagem para monitoramento robusto e efetivo dessa espécie. Assim, no primeiro capítulo, conduzo uma revisão na literatura descrevendo os potenciais erros de detecção que podem enviesar estimativas de abundância com drones, buscando soluções atuais para lidar com esses erros e identificando lacunas que precisam de desenvolvimento. Nessa revisão, destaco o potencial dos modelos hierárquicos para estimar abundância em amostragens com drone. No segundo capítulo, aplico amostragens espaço-temporalmente replicadas com drone, analisadas com modelos hierárquicos N-mixture, para entender o efeito de processos topo-base (distribuição de onças-pintadas) e base-topo (disponibilidade de forragem de qualidade e corpos d’água) na distribuição da abundância de cervos-do- pantanal. Nesse estudo, encontrei que, na época seca, os cervos se concentram em áreas de alta qualidade (maior disponibilidade de forragem e próximas a corpos d’água), mesmo sendo a região em que é esperado maior efeito da predação. No capítulo 3, em um estudo com simulações, avalio o desempenho de modelos N-mixture para estimativas de abundância a partir de amostragens espaço-temporalmente replicadas, explorando otimização de esforço amostral e o impacto de um protocolo com observadores duplos na acurácia das estimativas. No capítulo 4, desenvolvo uma abordagem para estimar abundância com drone usando observadores múltiplos na revisão das imagens, sendo um dos observadores baseado em um processamento semiautomático usando algoritmos de inteligência artificial. Nesse estudo, exploro técnicas de aprendizado profundo de máquina, com redes neurais convolucionais, acessíveis para ecólogos, treinando algoritmos para detectar cervos nas imagens de drone. Além de ajudar a elucidar questões sobre as relações do cervo-do-pantanal com aspectos diferentes da paisagem do Pantanal, as abordagens exploradas e desenvolvidas aqui têm um grande potencial de aplicação, ajudando a estabelecer os drones como uma ferramenta eficiente para modelagem e monitoramento populacional de diversas espécies animais, e particularmente de cervos.Understanding how abundance distributes in space and/or time is a fundamental question in ecology and conservation, and it helps, for example, to elucidate relationships between landscape heterogeneity or predation and populations. Information on the population size also is essential to evaluate extinction risk, monitor threatened species and plan conservation actions. Abundance modeling of marsh deer (Blastocerus dichotomus), as a large herbivore of South America, may be important to understand the relationships of this species with spatial variation in primary productivity, in the availability of wetlands that the species inhabits, and in the distribution of its main predator, the jaguar. Moreover, since marsh deer threatened to extinction, estimating its abundance can be contribute in assessments of relictual populations, as well as in monitoring the species after big events, such as the Pantanal 2020 megafires. However, efficiently assessing reliable abundance estimates require robust methods that account for possible sources of error in counts while providing the estimates timely. An optimized sampling design is also important, in order to make the best use of the usual scarce resources. Drones have raised as a versatile and cost- effective tool for sampling animal populations, and they have been applied for several species in a wide variety of ecological contexts. As being an emergent method, the use of drones in ecology provides opportunities to explore novel possibilities of sampling and analyzing data, while potentially presenting new challenges. In this thesis I: i) explore opportunities and challenges in the use of drones for animal abundance modeling, approaching issues about detection errors, sampling design and how to deal with the huge image sets generated from drone flights; and ii) apply the developed methods to study the spatial variation in marsh deer abundance and to establish an approach to monitor this species robustly and efficiently. Thus, in the first chapter, I carry on a literature review describing potential sources of errors that may bias abundance estimation with drones and the current solutions to address them, identifying gaps that need development. In this review, I highlight the potential of hierarchical models for abundance estimations from drone-based surveys. In the second chapter, I apply spatiotemporally replicated drone surveys, analyzed with N-mixture models, to understand the influence of bottom-up (forage and water) and top-down (jaguar density) variables on the spatial variation of marsh deer local abundance. In such study, I found that, in the dry season, the deer concentrate in high quality areas (high-quality forage available and close to water bodies), even these regions being expected to present higher predation risks. In chapter 3, in a simulation study, I evaluate the performance of N- mixture models for abundance estimation from spatiotemporally replicated surveys, exploring optimization of sampling effort and the impact of a double-observer protocol on estimation accuracy. In chapter 4, I develop a pipeline to estimate abundance from drone-based surveys using a multiple-observer protocol in which one of the observer is a semiautomated procedure based on deep learning algorithms. In such study, I explore deep learning techniques with convolutional neural networks that are accessible for ecologists, and train algorithms to detect marsh deer in drone imagery. Besides helping to elucidate questions about the relationships of marsh deer with landscape variables in Pantanal, the approaches explored and developed here have a great potential of application in order to establish drones as an efficient technique for population modeling and monitoring of several wildlife species, and particularly the marsh deer

Fluvial Processes in Motion: Measuring Bank Erosion and Suspended Sediment Flux using Advanced Geomatic Methods and Machine Learning

Excessive erosion and fine sediment delivery to river corridors and receiving waters degrade aquatic habitat, add to nutrient loading, and impact infrastructure. Understanding the sources and movement of sediment within watersheds is critical for assessing ecosystem health and developing management plans to protect natural and human systems. As our changing climate continues to cause shifts in hydrological regimes (e.g., increased precipitation and streamflow in the northeast U.S.), the development of tools to better understand sediment dynamics takes on even greater importance. In this research, advanced geomatics and machine learning are applied to improve the (1) monitoring of streambank erosion, (2) understanding of event sediment dynamics, and (3) prediction of sediment loading using meteorological data as inputs. Streambank movement is an integral part of geomorphic changes along river corridors and also a significant source of fine sediment to receiving waters. Advances in unmanned aircraft systems (UAS) and photogrammetry provide opportunities for rapid and economical quantification of streambank erosion and deposition at variable scales. We assess the performance of UAS-based photogrammetry to capture streambank topography and quantify bank movement. UAS data were compared to terrestrial laser scanner (TLS) and GPS surveying from Vermont streambank sites that featured a variety of bank conditions and vegetation. Cross-sectional analysis of UAS and TLS data revealed that the UAS reliably captured the bank surface and was able to quantify the net change in bank area where movement occurred. Although it was necessary to consider overhanging bank profiles and vegetation, UAS-based photogrammetry showed significant promise for capturing bank topography and movement at fine resolutions in a flexible and efficient manner. This study also used a new machine-learning tool to improve the analysis of sediment dynamics using three years of high-resolution suspended sediment data collected in the Mad River watershed. A restricted Boltzmann machine (RBM), a type of artificial neural network (ANN), was used to classify individual storm events based on the visual hysteresis patterns present in the suspended sediment-discharge data. The work expanded the classification scheme typically used for hysteresis analysis. The results provided insights into the connectivity and sources of sediment within the Mad River watershed and its tributaries. A recurrent counterpropagation network (rCPN) was also developed to predict suspended sediment discharge at ungauged locations using only local meteorological data as inputs. The rCPN captured the nonlinear relationships between meteorological data and suspended sediment discharge, and outperformed the traditional sediment rating curve approach. The combination of machine-learning tools for analyzing storm-event dynamics and estimating loading at ungauged locations in a river network provides a robust method for estimating sediment production from catchments that informs watershed management

Digital Image Access & Retrieval

The 33th Annual Clinic on Library Applications of Data Processing, held at the University of Illinois at Urbana-Champaign in March of 1996, addressed the theme of "Digital Image Access & Retrieval." The papers from this conference cover a wide range of topics concerning digital imaging technology for visual resource collections. Papers covered three general areas: (1) systems, planning, and implementation; (2) automatic and semi-automatic indexing; and (3) preservation with the bulk of the conference focusing on indexing and retrieval.published or submitted for publicatio