Remote sensing big data computing: challenges and opportunities

As we have entered an era of high resolution earth observation, the RS data are undergoing an explosive growth. The proliferation of data also give rise to the increasing complexity of RS data, like the diversity and higher dimensionality characteristic of the data. RS data are regarded as RS ‘‘Big Data’’. Fortunately, we are witness the coming technological leapfrogging. In this paper, we give a brief overview on the Big Data and data-intensive problems, including the analysis of RS Big Data, Big Data challenges, current techniques and works for processing RS Big Data

Virtual Globes for UAV-based data integration: Sputnik GIS and Google Earth™ applications

“This is an Accepted Manuscript of an article published by Taylor & Francis in International Journal of Digital Earth on 03 May 2018, available online: https://www.tandfonline.com/doi/abs/10.1080/17538947.2018.1470205"The integration of local measurements and monitoring via global-scale Earth observations has become a new challenge in digital Earth science. The increasing accessibility and ease of use of virtual globes (VGs) represent primary advantages of this integration, and the digital Earth scientific community has adopted this technology as one of the main methods for disseminating the results of scientific studies. In this study, the best VG software for the dissemination and analysis of high-resolution UAV (Unmanned Aerial Vehicle) data is identified for global and continuous geographic scope support. The VGs Google Earth and Sputnik Geographic Information System (GIS) are selected and compared for this purpose. Google Earth is a free platform and one of the most widely used VGs, and one of its best features its ability to provide users with quality visual results. The proprietary software Sputnik GIS more closely approximates the analytical capacity of a traditional GIS and provides outstanding advantages, such as DEM overlapping and visualization for its disseminationThis work was supported by Xunta de Galicia under the Grant “Financial aid for the consolidation and structure of competitive units of investigation in the universities of the University Galician System (2016-18)” (Ref. ED431B 2016/030 and Ref. ED341D R2016/023). The authors also acknowledge support provided by “Realización de vuelos virtuales en las parcelas del proyecto Green deserts LIFE09 / ENV/ES / 000447”S

GeoAI-enhanced Techniques to Support Geographical Knowledge Discovery from Big Geospatial Data

abstract: Big data that contain geo-referenced attributes have significantly reformed the way that I process and analyze geospatial data. Compared with the expected benefits received in the data-rich environment, more data have not always contributed to more accurate analysis. “Big but valueless” has becoming a critical concern to the community of GIScience and data-driven geography. As a highly-utilized function of GeoAI technique, deep learning models designed for processing geospatial data integrate powerful computing hardware and deep neural networks into various dimensions of geography to effectively discover the representation of data. However, limitations of these deep learning models have also been reported when People may have to spend much time on preparing training data for implementing a deep learning model. The objective of this dissertation research is to promote state-of-the-art deep learning models in discovering the representation, value and hidden knowledge of GIS and remote sensing data, through three research approaches. The first methodological framework aims to unify varied shadow into limited number of patterns, with the convolutional neural network (CNNs)-powered shape classification, multifarious shadow shapes with a limited number of representative shadow patterns for efficient shadow-based building height estimation. The second research focus integrates semantic analysis into a framework of various state-of-the-art CNNs to support human-level understanding of map content. The final research approach of this dissertation focuses on normalizing geospatial domain knowledge to promote the transferability of a CNN’s model to land-use/land-cover classification. This research reports a method designed to discover detailed land-use/land-cover types that might be challenging for a state-of-the-art CNN’s model that previously performed well on land-cover classification only.Dissertation/ThesisDoctoral Dissertation Geography 201

Development of a Flood Warning Simulation System:A Case Study of 2007 Tewkesbury Flood

Many flood warning systems were developed for 2D environments and limited on specific flood hazard. With the purpose of overcoming these disadvantages, it is necessary to propose new methodologies and techniques for 3D real time flood simulation. In this paper, a novel flood hazard warning system has been proposed. It describes and defines the relationship between the different parts of the simulation system in order to offer not only numeric data or figures, but also more meaningful and appealing 3D visual information. Consequently, the performance of this simulation system depends on the quality of the three sub systems: 3D real world modelling system with GIS data, 3D environment reconstruction system and 3D flood simulation system. A new flooding model has been developed which can handle dynamic flood behaviour and predict inundation areas in real time. In order to validate our flood warning system, the region of Tewkesbury in England has been simulated with a potential flood. The flood spreading process is shown during different time and the detailed inundation area is presented for further disaster evaluation. The study achieved two main objectives: implementing a useful flood simulation with real world model and reconstructed environment for flood hazard warning; producing a friendly simulation system interface for either a decision maker or experienced user

Open software and standards in the realm of laser scanning technology

Abstract This review aims at introducing laser scanning technology and providing an overview of the contribution of open source projects for supporting the utilization and analysis of laser scanning data. Lidar technology is pushing to new frontiers in mapping and surveying topographic data. The open source community has supported this by providing libraries, standards, interfaces, modules all the way to full software. Such open solutions provide scientists and end-users valuable tools to access and work with lidar data, fostering new cutting-edge investigation and improvements of existing methods. The first part of this work provides an introduction on laser scanning principles, with references for further reading. It is followed by sections respectively reporting on open standards and formats for lidar data, tools and finally web-based solutions for accessing lidar data. It is not intended to provide a thorough review of state of the art regarding lidar technology itself, but to provide an overview of the open source toolkits available to the community to access, visualize, edit and process point clouds. A range of open source features for lidar data access and analysis is provided, providing an overview of what can be done with alternatives to commercial end-to-end solutions. Data standards and formats are also discussed, showing what are the challenges for storing and accessing massive point clouds. The desiderata are to provide scientists that have not yet worked with lidar data an overview of how this technology works and what open source tools can be a valid solution for their needs in analysing such data. Researchers that are already involved with lidar data will hopefully get ideas on integrating and improving their workflow through open source solutions

Raster Time Series: Learning and Processing

As the amount of remote sensing data is increasing at a high rate, due to great improvements in sensor technology, efficient processing capabilities are of utmost importance. Remote sensing data from satellites is crucial in many scientific domains, like biodiversity and climate research. Because weather and climate are of particular interest for almost all living organisms on earth, the efficient classification of clouds is one of the most important problems. Geostationary satellites such as Meteosat Second Generation (MSG) offer the only possibility to generate long-term cloud data sets with high spatial and temporal resolution. This work, therefore, addresses research problems on efficient and parallel processing of MSG data to enable new applications and insights. First, we address the lack of a suitable processing chain to generate a long-term Fog and Low Stratus (FLS) time series. We present an efficient MSG data processing chain that processes multiple tasks simultaneously, and raster data in parallel using the Open Computing Language (OpenCL). The processing chain delivers a uniform FLS classification that combines day and night approaches in a single method. As a result, it is possible to calculate a year of FLS rasters quite easy. The second topic presents the application of Convolutional Neural Networks (CNN) for cloud classification. Conventional approaches to cloud detection often only classify single pixels and ignore the fact that clouds are highly dynamic and spatially continuous entities. Therefore, we propose a new method based on deep learning. Using a CNN image segmentation architecture, the presented Cloud Segmentation CNN (CS-CNN) classifies all pixels of a scene simultaneously. We show that CS-CNN is capable of processing multispectral satellite data to identify continuous phenomena such as highly dynamic clouds. The proposed approach provides excellent results on MSG satellite data in terms of quality, robustness, and runtime, in comparison to Random Forest (RF), another widely used machine learning method. Finally, we present the processing of raster time series with a system for Visualization, Transformation, and Analysis (VAT) of spatio-temporal data. It enables data-driven research with explorative workflows and uses time as an integral dimension. The combination of various raster and vector data time series enables new applications and insights. We present an application that combines weather information and aircraft trajectories to identify patterns in bad weather situations

Earth Observation Open Science and Innovation

geospatial analytics; social observatory; big earth data; open data; citizen science; open innovation; earth system science; crowdsourced geospatial data; citizen science; science in society; data scienc

Impact of Geographical Information Systems on Geotechnical Engineering

Over the last four decades Geographical Information Systems (GIS) have emerged as the predominant medium for graphic representation of geospatial data, including geotechnical, geologic and hydrologic information routinely used by geotechnical and geoenvironmental engineers. GIS allow unlimited forms of spatial data to be co-mingled, weighted and sorted with any number of physical or environmental factors. These data can also be combined with weighted political and aesthetic values to create hybrid graphic products capable of swaying public perceptions and decision making. The downside of some GIS products is that their apparent efficacy and crispness can also be deceptive, if data of unparalleled reliability is absorbed in the mix. Disparities in data age and quality are common when compiling geotechnical and geoenvironmental data. Despite these inherent shortcomings, GIS will continue to grow and evolve as the principal technical communication medium over the foreseeable future and engineers will be forced to prepare their work products in GIS formats which can be widely disseminated through the world wide web. This paper presents the historical evolution of GIS technologies as it relates to the impact in geotechnical engineering, concluding with four case histories on the application of this emerging technology