How well do deep learning-based methods for land cover classification and object detection perform on high resolution remote sensing imagery?

© 2020 by the authors. Land cover information plays an important role in mapping ecological and environmental changes in Earth's diverse landscapes for ecosystem monitoring. Remote sensing data have been widely used for the study of land cover, enabling efficient mapping of changes of the Earth surface from Space. Although the availability of high-resolution remote sensing imagery increases significantly every year, traditional land cover analysis approaches based on pixel and object levels are not optimal. Recent advancement in deep learning has achieved remarkable success on image recognition field and has shown potential in high spatial resolution remote sensing applications, including classification and object detection. In this paper, a comprehensive review on land cover classification and object detection approaches using high resolution imagery is provided. Through two case studies, we demonstrated the applications of the state-of-the-art deep learning models to high spatial resolution remote sensing data for land cover classification and object detection and evaluated their performances against traditional approaches. For a land cover classification task, the deep-learning-based methods provide an end-to-end solution by using both spatial and spectral information. They have shown better performance than the traditional pixel-based method, especially for the categories of different vegetation. For an objective detection task, the deep-learning-based object detection method achieved more than 98% accuracy in a large area; its high accuracy and efficiency could relieve the burden of the traditional, labour-intensive method. However, considering the diversity of remote sensing data, more training datasets are required in order to improve the generalisation and the robustness of deep learning-based models

How Well Do Deep Learning-Based Methods for Land Cover Classification and Object Detection Perform on High Resolution Remote Sensing Imagery?

Land cover information plays an important role in mapping ecological and environmental changes in Earth’s diverse landscapes for ecosystem monitoring. Remote sensing data have been widely used for the study of land cover, enabling efficient mapping of changes of the Earth surface from Space. Although the availability of high-resolution remote sensing imagery increases significantly every year, traditional land cover analysis approaches based on pixel and object levels are not optimal. Recent advancement in deep learning has achieved remarkable success on image recognition field and has shown potential in high spatial resolution remote sensing applications, including classification and object detection. In this paper, a comprehensive review on land cover classification and object detection approaches using high resolution imagery is provided. Through two case studies, we demonstrated the applications of the state-of-the-art deep learning models to high spatial resolution remote sensing data for land cover classification and object detection and evaluated their performances against traditional approaches. For a land cover classification task, the deep-learning-based methods provide an end-to-end solution by using both spatial and spectral information. They have shown better performance than the traditional pixel-based method, especially for the categories of different vegetation. For an objective detection task, the deep-learning-based object detection method achieved more than 98% accuracy in a large area; its high accuracy and efficiency could relieve the burden of the traditional, labour-intensive method. However, considering the diversity of remote sensing data, more training datasets are required in order to improve the generalisation and the robustness of deep learning-based models

Object detection algorithms to identify skeletal components in carbonate cores

Identification of constituent grains in carbonate rocks requires specialist experience. A carbonate sedimentologist must be able to distinguish between skeletal grains that change through geological ages, preserved in differing alteration stages, and cut in random orientations across core sections. Recent studies have demonstrated the effectiveness of machine learning in classifying lithofacies from thin section, core, and seismic images, with faster analysis times and reduction of natural biases. In this study, we explore the application and limitations of convolutional neural network (CNN) based object detection frameworks to identify and quantify multiple types of carbonate grains within close-up core images of carbonate lithologies. We compiled nearly 400 images of high-resolution core images from three ODP and IODP expeditions. Over 9000 individual carbonate components of 11 different classes were manually labelled from this dataset. Using pre-trained weights, a transfer learning approach was applied to evaluate one-stage (YOLO v5) and two-stage (Faster R–CNN) detectors under different feature extractors (CSP-Darknet53 and ResNet50-FPN, respectively). Despite the current popularity of one-stage detectors, our results show Faster R–CNN with ResNet50-FPN backbone provides the most robust performance, achieving 0.73 mean average precision (mAP). Furthermore, we extend the approach by deploying the trained model to two ODP sites from Leg 194 that were not part of the training set (ODP Sites 1196 and 1199), providing a performance comparison with benchmark human interpretation

A Review on Deep Learning in UAV Remote Sensing

Deep Neural Networks (DNNs) learn representation from data with an impressive capability, and brought important breakthroughs for processing images, time-series, natural language, audio, video, and many others. In the remote sensing field, surveys and literature revisions specifically involving DNNs algorithms' applications have been conducted in an attempt to summarize the amount of information produced in its subfields. Recently, Unmanned Aerial Vehicles (UAV) based applications have dominated aerial sensing research. However, a literature revision that combines both "deep learning" and "UAV remote sensing" thematics has not yet been conducted. The motivation for our work was to present a comprehensive review of the fundamentals of Deep Learning (DL) applied in UAV-based imagery. We focused mainly on describing classification and regression techniques used in recent applications with UAV-acquired data. For that, a total of 232 papers published in international scientific journal databases was examined. We gathered the published material and evaluated their characteristics regarding application, sensor, and technique used. We relate how DL presents promising results and has the potential for processing tasks associated with UAV-based image data. Lastly, we project future perspectives, commentating on prominent DL paths to be explored in the UAV remote sensing field. Our revision consists of a friendly-approach to introduce, commentate, and summarize the state-of-the-art in UAV-based image applications with DNNs algorithms in diverse subfields of remote sensing, grouping it in the environmental, urban, and agricultural contexts.Comment: 38 pages, 10 figure

Estuarine Shoreline Mapping using Object-based Ensemble Analysis, Aerial Imagery, and LiDAR: A Case Study in the Neuse River Estuary, NC

Estuarine shorelines are highly dynamic due to their unique geological history, wave and weather conditions, and human modifications to the shoreline. These interactions are heightened as sea level rise intensifies and extreme storms become more frequent due to climate change. Estuarine shoreline classification maps are critical to understanding the context and magnitude of storm-induced erosion as well as ad hoc efforts to shoreline stabilization. Here, an object-based ensemble analysis is used to map natural and engineered shoreline types observed within the Neuse River Estuary (NRE), NC. Object-based ensemble analysis has emerged as a successful framework to improve image classification but has yet to be tested in classifying an estuarine shoreline environment. This approach used in-situ reference data, high-resolution aerial imagery, and LiDAR point data to train an ensemble of five machine learning algorithms (Random Forest, Support Vector Machine, LibLINEAR, Artificial Neural Network, and k-Nearest Neighbors). The object-based ensemble produced the highest overall classification accuracy at 76.4% (Kappa value = 0.66), 6.3% higher than the top performing pixel-based model, justifying its use to produce the final shoreline classification map. NRE shoreline change and erosion vulnerability were classified using the object-based image analysis and produced comparable erosion rates to those observed in past studies. The object-based ensemble approach was an effective way to map shoreline classifications in the NRE and should continue to be explored within other shoreline management applications

Service robotics and machine learning for close-range remote sensing

L'abstract è presente nell'allegato / the abstract is in the attachmen