35 research outputs found

    Haze and Smoke Removal for Visualization of Multispectral Images: A DNN Physics Aware Architecture

    Get PDF
    Remote sensing multispectral images are extensively used by applications in various fields. The degradation generated by haze or smoke negatively influences the visual analysis of the represented scene. In this paper, a deep neural network based method is proposed to address the visualization improvement of hazy and smoky images. The method is able to entirely exploit the information contained by all spectral bands, especially by the SWIR bands, which are usually not contaminated by haze or smoke. A dimensionality reduction of the spectral signatures or angular signatures is rapidly obtained by using a stacked autoencoders (SAE) trained based on contaminated images only. The latent characteristics obtained by the encoder are mapped to the R - G - B channels for visualization. The haze and smoke removal results of several Sentinel 2 scenes present an increased contrast and show the haze hidden areas from the initial natural color images

    Assessing Wildfire Damage from High Resolution Satellite Imagery Using Classification Algorithms

    Get PDF
    Wildfire damage assessments are important information for first responders, govern- ment agencies, and insurance companies to estimate the cost of damages and to help provide relief to those affected by a wildfire. With the help of Earth Observation satellite technology, determining the burn area extent of a fire can be done with traditional remote sensing methods like Normalized Burn Ratio. Using Very High Resolution satellites can help give even more accurate damage assessments but will come with some tradeoffs; these satellites can provide higher spatial and temporal resolution at the expense of better spectral resolution. As a wildfire burn area cannot be determined by traditional remote sensing methods with higher spatial resolution satellites, the use of machine learning can help predict the extent of the wildfire. This research project proposes an object-based classification method to train and compare several machine learning algorithms to detect the remaining burn scars after the event of a wildfire. Then, a building damage assessment approach is provided. The results of this research project shows that random forests can predict the burn scars with an accuracy of 86% using high resolution image data

    Predicting Species and Structural Diversity of Temperate Forests with Satellite Remote Sensing and Deep Learning

    Get PDF
    Anthropogenically-driven climate change, land-use changes, and related biodiversity losses are threatening the capability of forests to provide a variety of valuable ecosystem services. The magnitude and diversity of these services are governed by tree species richness and structural complexity as essential regulators of forest biodiversity. Sound conservation and sustainable management strategies rely on information from biodiversity indicators that is conventionally derived by field-based, periodical inventory campaigns. However, these data are usually site-specific and not spatially explicit, hampering their use for large-scale monitoring applications. Therefore, the main objective of our study was to build a robust method for spatially explicit modeling of biodiversity variables across temperate forest types using open-access satellite data and deep learning models. Field data were obtained from the Biodiversity Exploratories, a research infrastructure platform that supports ecological research in Germany. A total of 150 forest plots were sampled between 2014 and 2018, covering a broad range of environmental and forest management gradients across Germany. From field data, we derived key indicators of tree species diversity (Shannon Wiener Index) and structural heterogeneity (standard deviation of tree diameter) as proxies of forest biodiversity. Deep neural networks were used to predict the selected biodiversity variables based on Sentinel-1 and Sentinel-2 images from 2017. Predictions of tree diameter variation achieved good accuracy (r2 = 0.51) using Sentinel-1 winter-based backscatter data. The best models of species diversity used a set of Sentinel-1 and Sentinel-2 features but achieved lower accuracies (r2 = 0.25). Our results demonstrate the potential of deep learning and satellite remote sensing to predict forest parameters across a broad range of environmental and management gradients at the landscape scale, in contrast to most studies that focus on very homogeneous settings. These highly generalizable and spatially continuous models can be used for monitoring ecosystem status and functions, contributing to sustainable management practices, and answering complex ecological questions.publishedVersio

    Current Trends in Deep Learning for Earth Observation: An Open-source Benchmark Arena for Image Classification

    Full text link
    We present 'AiTLAS: Benchmark Arena' -- an open-source benchmark framework for evaluating state-of-the-art deep learning approaches for image classification in Earth Observation (EO). To this end, we present a comprehensive comparative analysis of more than 400 models derived from nine different state-of-the-art architectures, and compare them to a variety of multi-class and multi-label classification tasks from 22 datasets with different sizes and properties. In addition to models trained entirely on these datasets, we also benchmark models trained in the context of transfer learning, leveraging pre-trained model variants, as it is typically performed in practice. All presented approaches are general and can be easily extended to many other remote sensing image classification tasks not considered in this study. To ensure reproducibility and facilitate better usability and further developments, all of the experimental resources including the trained models, model configurations and processing details of the datasets (with their corresponding splits used for training and evaluating the models) are publicly available on the repository: https://github.com/biasvariancelabs/aitlas-arena

    GeoAI approach to Vineyard Yield Estimation

    Get PDF
    A thesis submitted in partial fulfillment of the requirements for the degree of Doctor in Information Management, specialization in Geographic Information SystemsKnowing in advance vineyard yield is a key issue for growers, winemakers, policy makers, and regulators being fundamental to achieve the best balance between vegetative and reproductive growth, and to allow more informed decisions like thinning, irrigation and nutrient management, schedule harvest, optimize winemaking operations, program crop insurance, fraud detection and grape picking workforce demand. In a long-term scenario of perceived climate change, it is also essential for planning and regulatory purposes at the regional level. Estimating yield is complex and requires knowing driving factors related to climate, plant, and crop management that directly influence the number of clusters per vine, berries per cluster, and berry weight. These three yield components explain 60%, 30%, and 10% of the yield. The traditional methods are destructive, labor-demanding, and time-consuming, with low accuracy primarily due to operator errors and sparse sampling (compared to the inherent spatial variability in a production vineyard). Those are supported by manual sampling, where yield is estimated by sampling clusters weight and the number of clusters per vine, historical data, and extrapolation considering the number of vines in a plot. As the extensive research in the area clearly shows, improved applied methodologies are needed at different spatial scales. The methodological approaches for yield estimation based on indirect methods are primarily applicable at small scale and can provide better estimates than the traditional manual sampling. They mainly depend on computer vision and image processing algorithms, data-driven models based on vegetation indices and pollen data, and on relating climate, soil, vegetation, and crop management variables that can support dynamic crop simulation models. Despite surpassing the limitations assigned to traditional manual sampling methods with the same or better results on accuracy, they still lack a fundamental key aspect: the real application in commercial vineyards. Another gap is the lack of solutions for estimating yield at broader scales (e.g., regional level). The perception is that decisions are more likely to take place on a smaller scale, which in some cases is inaccurate. It might be the case in regulated areas and areas where support for small viticulturists is needed and made by institutions with proper resources and a large area of influence. This is corroborated by the fact that data-driven models based on Trellis Tension and Pollen traps are being used for yield estimation at regional scales in real environments in different regions of the world. The current dissertation consists of the first study to identify through a systematic literature review the research approaches for predicting yield in vineyards for wine production that can serve as an alternative to traditional estimation methods, to characterize the different new approaches identifying and comparing their applicability under field conditions, scalability concerning the objective, accuracy, advantages, and shortcomings. In the second study following the identified research gap, a yield estimation model based on Geospatial Artificial Intelligence (GeoAI) with remote sensing and climate data and a machine-learning approach was developed. Using a satellite-based time-series of Normalized Difference Vegetation Index (NDVI) calculated from Sentinel 2 images and climate data acquired by local automatic weather stations, a system for yield prediction based on a Long Short-Term Memory (LSTM) neural network was implemented. The results show that this approach makes it possible to estimate wine grape yield accurately in advance at different scales

    A visual multivariate dynamic egocentric network exploration tool

    Get PDF
    Visualizing multivariate dynamic networks is a challenging task. The evolution of the dynamic network within the temporal axis must be depicted in conjunction with the associated multivariate attributes. In this thesis, an exploratory visual analytics tool is proposed to display multivariate dynamic networks with spatial attributes. The proposed tool displays the distribution of multivariate temporal domain and network attributes in scattered views. Moreover, in order to expose the evolution of a single or a group of nodes in the dynamic network along the temporal axis, an egocentric approach is applied in which a node is represented with its neighborhood as an ego-network. This approach allows users to observe a node's surrounding environment along the temporal axis. On top of the traditional ego-network visualization methods, such as timelines, the proposed tool encodes ego-networks as feature vectors consisting of the domain and network attributes and projects them onto 2D views. As a result, distances between projected ego-networks represent the dissimilarity across temporal axis in a single view. The proposed tool is demonstrated with a real-world use case scenario on merchant networks obtained from a one-year long credit card transaction

    Hydrocarbon quantification using neural networks and deep learning based hyperspectral unmixing

    Get PDF
    Hydrocarbon (HC) spills are a global issue, which can seriously impact human life and the environment, therefore early identification and remedial measures taken at an early stage are important. Thus, current research efforts aim at remotely quantifying incipient quantities of HC mixed with soils. The increased spectral and spatial resolution of hyperspectral sensors has opened ground-breaking perspectives in many industries including remote inspection of large areas and the environment. The use of subpixel detection algorithms, and in particular the use of the mixture models, has been identified as a future advance that needs to be incorporated in remote sensing. However, there are some challenging tasks since the spectral signatures of the targets of interest may not be immediately available. Moreover, real time processing and analysis is required to support fast decision-making. Progressing in this direction, this thesis pioneers and researches novel methodologies for HC quantification capable of exceeding the limitations of existing systems in terms of reduced cost and processing time with improved accuracy. Therefore the goal of this research is to develop, implement and test different methods for improving HC detection and quantification using spectral unmixing and machine learning. An efficient hybrid switch method employing neural networks and hyperspectral is proposed and investigated. This robust method switches between state of the art hyperspectral unmixing linear and nonlinear models, respectively. This procedure is well suited for the quantification of small quantities of substances within a pixel with high accuracy as the most appropriate model is employed. Central to the proposed approach is a novel method for extracting parameters to characterise the non-linearity of the data. These parameters are fed into a feedforward neural network which decides in a pixel by pixel fashion which model is more suitable. The quantification process is fully automated by applying further classification techniques to the acquired hyperspectral images. A deep learning neural network model is designed for the quantification of HC quantities mixed with soils. A three-term backpropagation algorithm with dropout is proposed to avoid overfitting and reduce the computational complexity of the model. The above methods have been evaluated using classical repository datasets from the literature and a laboratory controlled dataset. For that, an experimental procedure has been designed to produce a labelled dataset. The data was obtained by mixing and homogenizing different soil types with HC substances, respectively and measuring the reflectance with a hyperspectral sensor. Findings from the research study reveal that the two proposed models have high performance, they are suitable for the detection and quantification of HC mixed with soils, and surpass existing methods. Improvements in sensitivity, accuracy, computational time are achieved. Thus, the proposed approaches can be used to detect HC spills at an early stage in order to mitigate significant pollution from the spill areas

    Proceedings of the 10th International Conference on Ecological Informatics: translating ecological data into knowledge and decisions in a rapidly changing world: ICEI 2018

    Get PDF
    The Conference Proceedings are an impressive display of the current scope of Ecological Informatics. Whilst Data Management, Analysis, Synthesis and Forecasting have been lasting popular themes over the past nine biannual ICEI conferences, ICEI 2018 addresses distinctively novel developments in Data Acquisition enabled by cutting edge in situ and remote sensing technology. The here presented ICEI 2018 abstracts captures well current trends and challenges of Ecological Informatics towards: • regional, continental and global sharing of ecological data, • thorough integration of complementing monitoring technologies including DNA-barcoding, • sophisticated pattern recognition by deep learning, • advanced exploration of valuable information in ‘big data’ by means of machine learning and process modelling, • decision-informing solutions for biodiversity conservation and sustainable ecosystem management in light of global changes

    Proceedings of the 10th International Conference on Ecological Informatics: translating ecological data into knowledge and decisions in a rapidly changing world: ICEI 2018

    Get PDF
    The Conference Proceedings are an impressive display of the current scope of Ecological Informatics. Whilst Data Management, Analysis, Synthesis and Forecasting have been lasting popular themes over the past nine biannual ICEI conferences, ICEI 2018 addresses distinctively novel developments in Data Acquisition enabled by cutting edge in situ and remote sensing technology. The here presented ICEI 2018 abstracts captures well current trends and challenges of Ecological Informatics towards: • regional, continental and global sharing of ecological data, • thorough integration of complementing monitoring technologies including DNA-barcoding, • sophisticated pattern recognition by deep learning, • advanced exploration of valuable information in ‘big data’ by means of machine learning and process modelling, • decision-informing solutions for biodiversity conservation and sustainable ecosystem management in light of global changes

    Earth orbital experiment program and requirements study, volume 1, sections 1 - 6

    Get PDF
    A reference manual for planners of manned earth-orbital research activity is presented. The manual serves as a systems approach to experiment and mission planning based on an integrated consideration of candidate research programs and the appropriate vehicle, mission, and technology development requirements. Long range goals and objectives for NASA activities during the 1970 to 1980 time period are analyzed. The useful and proper roles of manned and automated spacecraft for implementing NASA experiments are described. An integrated consideration of NASA long range goals and objectives, the system and mission requirements, and the alternative implementation plans are developed. Specific areas of investigation are: (1) manned space flight requirements, (2) space biology, (3) spaceborne astronomy, (4) space communications and navigation, (5) earth observation, (6) supporting technology development requirements, (7) data management system matrices, (8) instrumentation matrices, and (9) biotechnology laboratory experiments
    corecore