Crop classification from Sentinel-2 time series with temporal convolutional neural networks

Automated crop identification tools are of interest to a wide range of applications related to the environment and agriculture including the monitoring of related policies such as the European Common Agriculture Policy. In this context, this work presents a parcel-based crop classification system which leverages on 1D convolutional neural network supervised learning capacity. For the training and evaluation of the model, we employ open and free data: (i) time series of Sentinel-2 optical data selected to cover the crop season of one year, and (ii) a cadastre-derived database providing detailed delineation of parcels. By considering the most dominant crop types and the temporal features of the optical data, the proposed lightweight approach discriminates a considerable number of crops with high accuracy

A systematic review of the use of Deep Learning in Satellite Imagery for Agriculture

Agricultural research is essential for increasing food production to meet the requirements of an increasing population in the coming decades. Recently, satellite technology has been improving rapidly and deep learning has seen much success in generic computer vision tasks and many application areas which presents an important opportunity to improve analysis of agricultural land. Here we present a systematic review of 150 studies to find the current uses of deep learning on satellite imagery for agricultural research. Although we identify 5 categories of agricultural monitoring tasks, the majority of the research interest is in crop segmentation and yield prediction. We found that, when used, modern deep learning methods consistently outperformed traditional machine learning across most tasks; the only exception was that Long Short-Term Memory (LSTM) Recurrent Neural Networks did not consistently outperform Random Forests (RF) for yield prediction. The reviewed studies have largely adopted methodologies from generic computer vision, except for one major omission: benchmark datasets are not utilised to evaluate models across studies, making it difficult to compare results. Additionally, some studies have specifically utilised the extra spectral resolution available in satellite imagery, but other divergent properties of satellite images - such as the hugely different scales of spatial patterns - are not being taken advantage of in the reviewed studies.Comment: 25 pages, 2 figures and lots of large tables. Supplementary materials section included here in main pd

Mapping intra- and inter-annual dynamics in wetlands with multispectral, thermal and SAR time series

Kartierung der intra- und interannuellen Dynamik von Feuchtgebieten mit multispektralen, thermischen und SAR-Zeitreihen Die Analyse der aktuellen räumlichen Verbreitung und der zeitlichen Entwicklung von Feuchtgebieten stellt eine äußerst komplexe Aufgabe dar, welche durch die Saisonalität, die schwierige Zugänglichkeit und die besonderen Eigenschaften als Ökoton bedingt ist. Erdbeobachtungssysteme sind somit das am besten geeignete Werkzeug, um zeitliche und räumliche Muster von Feuchtgebieten auf globaler Ebene zu beobachten (saisonale Veränderungen und Langzeit-Trends) und um den Einfluss der menschlichen Aktivitäten auf ihre physischen und biologischen Eigenschaften zu untersuchen. Zur Kartierung von raum-zeitlichen Mustern wurden Zeitreihen von Radar- (Sentinel-1), Multispektral- (Sentinel-2) und Thermal-Satellitendaten (MODIS) in fünf Untersuchungsgebieten, mit für Feuchtgebiete unterschiedlichen typischen Charakteristika, untersucht. In Kapitel 1 werden die Problematik in Bezug auf die Definition von Feuchtgebieten erläutert und allgemeine Degradations-Trends beschrieben. Die Kapitel 2 und 3 behandeln einen Algorithmus, der Veränderungen mithilfe von SAR-Zeitreihen feststellt, sowie die Vorteile des Cloud-Computings für das operationelle Monitoring saisonaler Muster und die Erkennung kurzfristig auftretender Veränderungen. In den Kapiteln 4 und 5 werden die zwei Hauptursachen für den Verlust von Feuchtgebieten betrachtet: der Staudammbau und die Ausdehnung landwirtschaftlicher Flächen. In Kapitel 4 werden dichte Zeitreihen multispektraler (Sentinel-2) und SAR-Daten (Sentinel-1) verwendet, um die Feuchtgebiete Albaniens – eines Landes in dem konträre Pläne zum Ausbau seines Wasserkraftpotentials und dem Schutz intakter Flussökosysteme zu Spannungen führen – landesweit zu kartieren. Die synergetischen Vorteile, die sich durch die Fusionierung von multispektralen und SAR-Daten für die Klassifikation ergeben, werden dabei herausgestellt. Kapitel 5 veranschaulicht, dass die Kilombero-Überschwemmungsebene in Tansania ein großes und bedeutendes Feuchtgebiet ist, das in den vergangenen Jahren infolge der weitgehend unkontrollierten Ausbreitung landwirtschaftlicher Flächen in seiner Ausdehnung und seiner Ökologie stark beeinträchtigt wurde. Um die Auswirkungen der Landnutzungsänderungen des Feuchtgebietes während der vergangenen 18 Jahre zu analysieren, wurden eine Zeitreihe (2000 bis 2017) thermaler Daten (MODIS) analysiert. Die drei für die Zeitreihenanalyse angewandten Modelle zeigen, wie landwirtschaftliche Praktiken die Landoberflächentemperatur in den landwirtschaftlich genutzten Gebieten sowie in den angrenzenden natürlichen Feuchtgebieten erhöht haben.Due to wetlands’ seasonality, their difficult access and ecotone character, determining their actual extension and trends over time is a complex task. Earth Observation systems are the most appropriate tool to monitor their spatio-temporal patterns (seasonal changes and long term trends) at global scales, and to study the effects that human activities have in their physical and biological properties. In this work I use time series of radar (Sentinel-1), multispectral (Sentinel-2) and thermal (MODIS) imagery to map the spatio-temporal patterns in 5 wetlands of different characteristics. First, I introduce in chapter 1 the problematic of wetlands’ definitions and their degradation trends. I continue with a brief introduction on remote sensing, time series analysis, and their applications on wetlands’ research and management. In chapters 2 and 3 I implement an algorithm for change detection of time series of Sentinel-1 images and demonstrate the advantages of cloud computation for operational monitoring. In chapters 4 and 5 I address two of the main causes of wetland degradation: dam building and agricultural expansion. In chapter 4 I use dense time series of Sentinel-1 and Sentinel-2 images map all the wetlands of Albania; a country struggling between developing its large hydropower potential or preserving its intact and valuable river ecosystems. I evaluate the synergic advantages of fusing multispectral and radar imagery in combination with knowledge-based rules to produce classification of higher thematic and spatial resolutions. In chapter 5 I present how the Kilombero Floodplain, in Tanzania, has been degraded during the last years due to uncontrolled farmland expansion. I use a time series of thermal imagery (MODIS) from 2000 until 2017 to analyze the effect of land use changes on the wetland. I compare three models for time series analysis and reveal how farming practices have increased the surface temperature of the farmed area, as well as in adjacent natural wetlands.Mapeo de las dinámicas inter- e intra-anuales en humedales con series temporales de imágenes multiespectrales, termales y de radar Debido a la estacionalidad de los humedales, su difícil acceso y sus características de ecotono, determinar su actual extensión y sus tendencias a lo largo del tiempo es una tarea compleja. Los sistemas de observación terrestres son la herramienta más apropiada para monitorear sus patrones espacio-temporales (estacionalidad y tendencias a largo plazo) a escalas globales, y para estudiar los efectos que las actividades humanas causan en sus propiedades físicas y biológicas. En esta tesis uso series temporales de imágenes radar (Sentinel-1), multiespectrales (Sentinel-2) y termales (MODIS) para mapear los patrones espacio-temporales de 5 humedales de diferentes características. En el capítulo 1 describo los retos que derivan de las diferentes definiciones que existen de los humedales. También presento las tendencias globales de degradación que la mayoría de los humedales continúan experimentando en los últimos años. Continúo con una breve introducción de los sistemas de teledetección remota, análisis de series temporales, y sus aplicaciones a la investigación y gestión de los humedales. En los capítulos 2 y 3 implemento un algoritmo de detección de cambios para series temporales de imágenes radar, y muestro las ventajas de usar sistemas de computación en la nube para monitorear cambios en la cobertura del suelo a corto plazo. En los capítulos 4 y 5 trato con dos de las causas más comunes de degradación de humedales: la construcción de presas y la expansión de la agricultura. En el capítulo 4 uso series temporales de imágenes multiespectrales (Sentinel-2) y radar (Sentinel-1) para mapear todos los humedales Albania; un país que se debate entre desarrollar su potencial hidroenergético o preservar sus valiosos e intactos ecosistemas de rivera. Mediante la fusión de imágenes radar y multiespectrales y el uso de reglas de decisión genero un mapa de suficiente resolución espacial y temática para que pueda ser usado por sectores interesados y gestores. En el capítulo 5 presento como las llanuras inundables de Kilombero, en Tanzania, han sido degradadas durante los últimos años debido a la expansión incontrolada de la agricultura. Usando series temporales de imágenes termales (MODIS) desde 2000 hasta 2017 y mapas de cambios de usos del suelo, determino los efectos que estos cambios han tenido en el humedal. Comparo 3 modelos diferentes de análisis de series temporales y muestro cómo la expansión de la agricultura ha incrementado la temperatura superficial terrestre, no solo de la zona cultivada, sino también de zonas adyacentes aún naturales

An Overview of Deep Learning Networks for Remote Sensing Applications

To study and understand the world around us, remote sensing specialists rely on aerial and satellite photographs. Today, deep learning models necessitating extensive data or specialised data are employed in many remote sensing applications. Sometimes, the spatial and spectral resolution of Observation satellites of the planet earth will fall short of requirements due to technological constraints in optics and sensors, as well as the expensive expense of upgrading sensors and equipment. Insufficient information might reduce a model's efficiency. The efficiency of deep learning frameworks that rely on data can be improved by the use of a adversarial networks, which is a type of technique that can generate synthetic data. This is one of the best innovative developments in Deep Learning  in past decade. GANs have seen rapid adoption and widespread success in the Remote Sensing sector. GANs can also perform picture-to-image translation, such as clearing cloud cover from a satellite image.This paper aims to investigate the applications of different Adversarial Networks in the remote sensing area and the databases used for training of GANs and metrics of evaluation

Habitat classification using convolutional neural networks and multitemporal multispectral aerial imagery

The monitoring of threatened habitats is a key objective of European environmental policies. Due to the high cost of current field-based habitat mapping techniques, there is keen interest in proposing solutions that can reduce cost through increased levels of automation. Our study aims to propose a habitat mapping solution that benefits both from the merits of convolutional neural networks (CNNs) for image classification tasks, as well as from the high spatial, spectral, and multitemporal unmanned aerial vehicle image data, which shows great potential for accurate vegetation classification. The proposed CNN-based method uses multitemporal multispectral aerial imagery for the classification of threatened coastal habitats in the Maharees (Ireland) and shows a high level of classification accuracy.This project has received funding from the European Union’s Horizon 2020 Research and Innovation program under the Marie Skłodowska-Curie Grant Agreement No. 847402. The authors would like to thank the EPA-funded iHabiMap project for providing the data used in this work. We thank the anonymous reviewers whose comments and suggestions helped improve and clarify this manuscript. The authors declare no conflicts of interes

Hyperparameters analysis of long short-term memory architecture for crop classification

Deep learning (DL) has seen a massive rise in popularity for remote sensing (RS) based applications over the past few years. However, the performance of DL algorithms is dependent on the optimization of various hyperparameters since the hyperparameters have a huge impact on the performance of deep neural networks. The impact of hyperparameters on the accuracy and reliability of DL models is a significant area for investigation. In this study, the grid Search algorithm is used for hyperparameters optimization of long short-term memory (LSTM) network for the RS-based classification. The hyperparameters considered for this study are, optimizer, activation function, batch size, and the number of LSTM layers. In this study, over 1,000 hyperparameter sets are evaluated and the result of all the sets are analyzed to see the effects of various combinations of hyperparameters as well the individual parameter effect on the performance of the LSTM model. The performance of the LSTM model is evaluated using the performance metric of minimum loss and average loss and it was found that classification can be highly affected by the choice of optimizer; however, other parameters such as the number of LSTM layers have less influence