Machine Learning and Citizen Science Approaches for Monitoring the Changing Environment

This dissertation will combine new tools and methodologies to answer pressing questions regarding inundation area and hurricane events in complex, heterogeneous changing environments. In addition to remote sensing approaches, citizen science and machine learning are both emerging fields that harness advancing technology to answer environmental management and disaster response questions.Comment: PhD thesis, Environment and Resources, U Wisconson Madison (2021

The earth observing one (EO-1) Hyperion and Advanced land imager sensors for use in tundra classification studies within the Upper Kuparuk river basin, Alaska

The heterogeneity of Arctic vegetation can make land cover classification very difficult when using medium to small resolution imagery (Schneider et al., 2009; Muller et al., 1999). Using high radiometric and spatial resolution imagery, such as the SPOT 5 and IKONOS satellites, have helped arctic land cover classification accuracies rise into the 80 and 90 percentiles (Allard, 2003; Stine et al., 2010; Muller et al., 1999). However, those increases usually come at a high price. High resolution imagery is very expensive and can often add tens of thousands of dollars onto the cost of the research. The EO-1 satellite launched in 2002 carries two sensors that have high spectral and/or high spatial resolutions and can be an acceptable compromise between the resolution versus cost issues. The Hyperion is a hyperspectral sensor with the capability of collecting 242 spectral bands of information. The Advanced Land Imager (ALI) is an advanced multispectral sensor whose spatial resolution can be sharpened to 10 meters. This dissertation compares the accuracies of arctic land cover classifications produced by the Hyperion and ALI sensors to the classification accuracies produced by the Systeme Pour l' Observation de le Terre (SPOT), the Landsat Thematic Mapper (TM) and the Landsat Enhanced Thematic Mapper Plus (ETM+) sensors. Hyperion and ALI images from August 2004 were collected over the Upper Kuparuk River Basin, Alaska. Image processing included the stepwise discriminant analysis of pixels that were positively classified from coinciding ground control points, geometric and radiometric correction, and principle component analysis. Finally, stratified random sampling was used to perform accuracy assessments on satellite derived land cover classifications. Accuracy was estimated from an error matrix (confusion matrix) that provided the overall, producer's and user's accuracies. This research found that while the Hyperion sensor produced classification accuracies that were equivalent to the TM and ETM+ sensor (approximately 78%), the Hyperion could not obtain the accuracy of the SPOT 5 HRV sensor. However, the land cover classifications derived from the ALI sensor exceeded most classification accuracies derived from the TM and ETM+ sensors and were even comparable to most SPOT 5 HRV classifications (87%). With the deactivation of the Landsat series satellites, the monitoring of remote locations such as in the Arctic on an uninterrupted basis throughout the world is in jeopardy. The utilization of the Hyperion and ALI sensors are a way to keep that endeavor operational. By keeping the ALI sensor active at all times, uninterrupted observation of the entire Earth can be accomplished. Keeping the Hyperion sensor as a "tasked" sensor can provide scientists with additional imagery and options for their studies without overburdening storage issues

An Evolutionary Approach to Adaptive Image Analysis for Retrieving and Long-term Monitoring Historical Land Use from Spatiotemporally Heterogeneous Map Sources

Land use changes have become a major contributor to the anthropogenic global change. The ongoing dispersion and concentration of the human species, being at their orders unprecedented, have indisputably altered Earth’s surface and atmosphere. The effects are so salient and irreversible that a new geological epoch, following the interglacial Holocene, has been announced: the Anthropocene. While its onset is by some scholars dated back to the Neolithic revolution, it is commonly referred to the late 18th century. The rapid development since the industrial revolution and its implications gave rise to an increasing awareness of the extensive anthropogenic land change and led to an urgent need for sustainable strategies for land use and land management. By preserving of landscape and settlement patterns at discrete points in time, archival geospatial data sources such as remote sensing imagery and historical geotopographic maps, in particular, could give evidence of the dynamic land use change during this crucial period. In this context, this thesis set out to explore the potentials of retrospective geoinformation for monitoring, communicating, modeling and eventually understanding the complex and gradually evolving processes of land cover and land use change. Currently, large amounts of geospatial data sources such as archival maps are being worldwide made online accessible by libraries and national mapping agencies. Despite their abundance and relevance, the usage of historical land use and land cover information in research is still often hindered by the laborious visual interpretation, limiting the temporal and spatial coverage of studies. Thus, the core of the thesis is dedicated to the computational acquisition of geoinformation from archival map sources by means of digital image analysis. Based on a comprehensive review of literature as well as the data and proposed algorithms, two major challenges for long-term retrospective information acquisition and change detection were identified: first, the diversity of geographical entity representations over space and time, and second, the uncertainty inherent to both the data source itself and its utilization for land change detection. To address the former challenge, image segmentation is considered a global non-linear optimization problem. The segmentation methods and parameters are adjusted using a metaheuristic, evolutionary approach. For preserving adaptability in high level image analysis, a hybrid model- and data-driven strategy, combining a knowledge-based and a neural net classifier, is recommended. To address the second challenge, a probabilistic object- and field-based change detection approach for modeling the positional, thematic, and temporal uncertainty adherent to both data and processing, is developed. Experimental results indicate the suitability of the methodology in support of land change monitoring. In conclusion, potentials of application and directions for further research are given

Geoscience-aware deep learning:A new paradigm for remote sensing

Information extraction is a key activity for remote sensing images. A common distinction exists between knowledge-driven and data-driven methods. Knowledge-driven methods have advanced reasoning ability and interpretability, but have difficulty in handling complicated tasks since prior knowledge is usually limited when facing the highly complex spatial patterns and geoscience phenomena found in reality. Data-driven models, especially those emerging in machine learning (ML) and deep learning (DL), have achieved substantial progress in geoscience and remote sensing applications. Although DL models have powerful feature learning and representation capabilities, traditional DL has inherent problems including working as a black box and generally requiring a large number of labeled training data. The focus of this paper is on methods that integrate domain knowledge, such as geoscience knowledge and geoscience features (GK/GFs), into the design of DL models. The paper introduces the new paradigm of geoscience-aware deep learning (GADL), in which GK/GFs and DL models are combined deeply to extract information from remote sensing data. It first provides a comprehensive summary of GK/GFs used in GADL, which forms the basis for subsequent integration of GK/GFs with DL models. This is followed by a taxonomy of approaches for integrating GK/GFs with DL models. Several approaches are detailed using illustrative examples. Challenges and research prospects in GADL are then discussed. Developing more novel and advanced methods in GADL is expected to become the prevailing trend in advancing remotely sensed information extraction in the future.</p

ExtremeEarth meets satellite data from space

Bringing together a number of cutting-edge technologies that range from storing extremely large volumesof data all the way to developing scalable machine learning and deep learning algorithms in a distributed manner, and having them operate over the same infrastructure poses unprecedentedchallenges. One of these challenges is the integration of European Space Agency (ESA)s Thematic Exploitation Platforms (TEPs) and data information access service platforms with a data platform, namely Hopsworks, that enables scalable data processing, machine learning, and deep learning on Copernicus data, and development of very large training datasets for deep learning architectures targeting the classification of Sentinel images. In this paper, we present the software architecture of ExtremeEarth that aims at the development of scalable deep learning and geospatial analytics techniques for processing and analyzing petabytes of Copernicus data. The ExtremeEarth software infrastructure seamlessly integrates existing and novel software platforms and tools for storing, accessing, processing, analyzing, and visualizing large amounts of Copernicus data. New techniques in the areas of remote sensing and artificial intelligence with an emphasis on deep learning are developed. These techniques and corresponding software presented in thispaper are to be integrated with and used in two ESA TEPs, namely Polar and Food Security TEPs. Furthermore, we presentthe integration of Hopsworks with the Polar and Food Securityuse cases and the flow of events for the products offered through the TEPs

Development of an earth observation processing chain for crop biophysical parameters at local and global scale

This thesis’ topics embrace remote sensing for Earth observation, specifically in Earth vegetation monitoring. The Thesis’ main objective is to develop and implement an operational processing chain for crop biophysical parameters estimation at both local and global scales from remote sensing data. Conceptually, the components of the chain are the same at both scales: First, a radiative transfer model is run in forward mode to build a database composed by simulations of vegetation surface reflectance and concomitant biophysical parameters associated to those spectrum. Secondly, the simulated database is used for training and testing nonlinear and non-parametric machine learning regression algorithms. The best model in terms of accuracy, bias and goodness-of-fit is then selected to be used in the operational retrieval chain. Once the model is trained, remote sensing surface reflectance data is fed into the trained model as input in the inversion process to retrieve the biophysical parameters of interest at both local and global scales depending on the inputs spatial resolution and coverage. Eventually, the validation of the leaf area index estimates is performed at local scale by a set of ground measurements conducted during coordinated field campaigns in three countries during 2015 and 2016 European rice seasons. At global scale, the validation is performed through intercomparison with the most relevant and widely validated reference biophysical products. The work elaborated in this Thesis is structured in six chapters including an introduction of remote sensing for Earth observation, the developed processing chain at local scale, the ground LAI measurements acquired with smartphones, the developed chain at global scale, a chapter discussing the conclusions of the work, and a chapter which includes an extended abstract in Valencian. The Thesis is completed by an annex which include a compendium of peer-reviewed publications in remote sensing international journals

VGC 2023 - Unveiling the dynamic Earth with digital methods: 5th Virtual Geoscience Conference: Book of Abstracts

Conference proceedings of the 5th Virtual Geoscience Conference, 21-22 September 2023, held in Dresden. The VGC is a multidisciplinary forum for researchers in geoscience, geomatics and related disciplines to share their latest developments and applications.:Short Courses 9 Workshops Stream 1 10 Workshop Stream 2 11 Workshop Stream 3 12 Session 1 – Point Cloud Processing: Workflows, Geometry & Semantics 14 Session 2 – Visualisation, communication & Teaching 27 Session 3 – Applying Machine Learning in Geosciences 36 Session 4 – Digital Outcrop Characterisation & Analysis 49 Session 5 – Airborne & Remote Mapping 58 Session 6 – Recent Developments in Geomorphic Process and Hazard Monitoring 69 Session 7 – Applications in Hydrology & Ecology 82 Poster Contributions 9

Detecting european aspen (Populus tremula L.) in boreal forests using airborne hyperspectral and airborne laser scanning data

Sustainable forest management increasingly highlights the maintenance of biological diversity and requires up-to-date information on the occurrence and distribution of key ecological features in forest environments. European aspen (Populus tremula L.) is one key feature in boreal forests contributing significantly to the biological diversity of boreal forest landscapes. However, due to their sparse and scattered occurrence in northern Europe, the explicit spatial data on aspen remain scarce and incomprehensive, which hampers biodiversity management and conservation efforts. Our objective was to study tree-level discrimination of aspen from other common species in northern boreal forests using airborne high-resolution hyperspectral and airborne laser scanning (ALS) data. The study contained multiple spatial analyses: First, we assessed the role of different spectral wavelengths (455–2500 nm), principal component analysis, and vegetation indices (VI) in tree species classification using two machine learning classifiers—support vector machine (SVM) and random forest (RF). Second, we tested the effect of feature selection for best classification accuracy achievable and third, we identified the most important spectral features to discriminate aspen from the other common tree species. SVM outperformed the RF model, resulting in the highest overall accuracy (OA) of 84% and Kappa value (0.74). The used feature set affected SVM performance little, but for RF, principal component analysis was the best. The most important common VI for deciduous trees contained Conifer Index (CI), Cellulose Absorption Index (CAI), Plant Stress Index 3 (PSI3), and Vogelmann Index 1 (VOG1), whereas Green Ratio (GR), Red Edge Inflection Point (REIP), and Red Well Position (RWP) were specific for aspen. Normalized Difference Red Edge Index (NDRE) and Modified Normalized Difference Index (MND705) were important for coniferous trees. The most important wavelengths for discriminating aspen from other species included reflectance bands of red edge range (724–727 nm) and shortwave infrared (1520–1564 nm and 1684–1706 nm). The highest classification accuracy of 92% (F1-score) for aspen was achieved using the SVM model with mean reflectance values combined with VI, which provides a possibility to produce a spatially explicit map of aspen occurrence that can contribute to biodiversity management and conservation efforts in boreal forests