Cybergis-enabled remote sensing data analytics for deep learning of landscape patterns and dynamics

Mapping landscape patterns and dynamics is essential to various scientific domains and many practical applications. The availability of large-scale and high-resolution light detection and ranging (LiDAR) remote sensing data provides tremendous opportunities to unveil complex landscape patterns and better understand landscape dynamics from a 3D perspective. LiDAR data have been applied to diverse remote sensing applications where large-scale landscape mapping is among the most important topics. While researchers have used LiDAR for understanding landscape patterns and dynamics in many fields, to fully reap the benefits and potential of LiDAR is increasingly dependent on advanced cyberGIS and deep learning approaches. In this context, the central goal of this dissertation is to develop a suite of innovative cyberGIS-enabled deep-learning frameworks for combining LiDAR and optical remote sensing data to analyze landscape patterns and dynamics with four interrelated studies. The first study demonstrates a high-accuracy land-cover mapping method by integrating 3D information from LiDAR with multi-temporal remote sensing data using a 3D deep-learning model. The second study combines a point-based classification algorithm and an object-oriented change detection strategy for urban building change detection using deep learning. The third study develops a deep learning model for accurate hydrological streamline detection using LiDAR, which has paved a new way of harnessing LiDAR data to map landscape patterns and dynamics at unprecedented computational and spatiotemporal scales. The fourth study resolves computational challenges in handling remote sensing big data and deep learning of landscape feature extraction and classification through a cutting-edge cyberGIS approach

REMOTE DETECTION OF EPHEMERAL WETLANDS IN MID- ATLANTIC COASTAL PLAIN ECOREGIONS: LIDAR AND HIGH-THROUGHPUT COMPUTING

Ephemeral wetlands are ecologically important freshwater ecosystems that occur frequently throughout the Atlantic coastal plain ecoregions of North America. Despite the growing consensus of their importance and imperilment, these systems historically have not been a national conservation priority. They are often cryptic on the landscape and methods to detect ephemeral wetlands remotely have been ineffective at the landscape scales necessary for conservation planning and resource management. Therefore, this study fills information gaps by employing high-resolution light detection and ranging (LiDAR) data to create local relief models that elucidate small localized changes in concavity. Relief models were then processed with local indicators of spatial association (LISA) in order to automate their detection by measuring autocorrelation among model indices. Following model development and data processing, field validation of 114 predicted wetland locations was conducted using a random stratified design proportional to landcover, to measure model commission (α) and omission (β) error rates. Wetland locations were correctly predicted at 85% of visited sites with α error rate = 15% and β error rate = 5%. These results suggest that devised local relief models captured small geomorphologic changes that successfully predict ephemeral wetland boundaries in low-relief ecosystems. Small wetlands are often centers of biodiversity in forested landscapes and this analysis will facilitate their detection, the first step towards long-term management

A Virtual Tile Approach to Rastel-based Calculations of Large Digital Elevation Models in a Shared-Memory System

Grid digital elevation models (DEMs) are commonly used in hydrology to derive information related to topographically driven flow. Advances in technology for creating DEMs have increased their resolution and data size with the result that algorithms for processing them are frequently memory limited. This paper presents a new approach to the management of memory in the parallel solution of hydrologic terrain processing using a user-level virtual memory system for shared-memory multithreaded systems. The method includes tailored virtual memory management of raster-based calculations for datasets that are larger than available memory and a novel order-of-calculations approach to parallel hydrologic terrain analysis applications. The method is illustrated for the pit filling algorithm used first in most hydrologic terrain analysis workflows

Realistic reconstruction and rendering of detailed 3D scenarios from multiple data sources

During the last years, we have witnessed significant improvements in digital terrain modeling, mainly through photogrammetric techniques based on satellite and aerial photography, as well as laser scanning. These techniques allow the creation of Digital Elevation Models (DEM) and Digital Surface Models (DSM) that can be streamed over the network and explored through virtual globe applications like Google Earth or NASA WorldWind. The resolution of these 3D scenes has improved noticeably in the last years, reaching in some urban areas resolutions up to 1m or less for DEM and buildings, and less than 10 cm per pixel in the associated aerial imagery. However, in rural, forest or mountainous areas, the typical resolution for elevation datasets ranges between 5 and 30 meters, and typical resolution of corresponding aerial photographs ranges between 25 cm to 1 m. This current level of detail is only sufficient for aerial points of view, but as the viewpoint approaches the surface the terrain loses its realistic appearance. One approach to augment the detail on top of currently available datasets is adding synthetic details in a plausible manner, i.e. including elements that match the features perceived in the aerial view. By combining the real dataset with the instancing of models on the terrain and other procedural detail techniques, the effective resolution can potentially become arbitrary. There are several applications that do not need an exact reproduction of the real elements but would greatly benefit from plausibly enhanced terrain models: videogames and entertainment applications, visual impact assessment (e.g. how a new ski resort would look), virtual tourism, simulations, etc. In this thesis we propose new methods and tools to help the reconstruction and synthesis of high-resolution terrain scenes from currently available data sources, in order to achieve realistically looking ground-level views. In particular, we decided to focus on rural scenarios, mountains and forest areas. Our main goal is the combination of plausible synthetic elements and procedural detail with publicly available real data to create detailed 3D scenes from existing locations. Our research has focused on the following contributions: - An efficient pipeline for aerial imagery segmentation - Plausible terrain enhancement from high-resolution examples - Super-resolution of DEM by transferring details from the aerial photograph - Synthesis of arbitrary tree picture variations from a reduced set of photographs - Reconstruction of 3D tree models from a single image - A compact and efficient tree representation for real-time rendering of forest landscapesDurant els darrers anys, hem presenciat avenços significatius en el modelat digital de terrenys, principalment gràcies a tècniques fotogramètriques, basades en fotografia aèria o satèl·lit, i a escàners làser. Aquestes tècniques permeten crear Models Digitals d'Elevacions (DEM) i Models Digitals de Superfícies (DSM) que es poden retransmetre per la xarxa i ser explorats mitjançant aplicacions de globus virtuals com ara Google Earth o NASA WorldWind. La resolució d'aquestes escenes 3D ha millorat considerablement durant els darrers anys, arribant a algunes àrees urbanes a resolucions d'un metre o menys per al DEM i edificis, i fins a menys de 10 cm per píxel a les fotografies aèries associades. No obstant, en entorns rurals, boscos i zones muntanyoses, la resolució típica per a dades d'elevació es troba entre 5 i 30 metres, i per a les corresponents fotografies aèries varia entre 25 cm i 1m. Aquest nivell de detall només és suficient per a punts de vista aeris, però a mesura que ens apropem a la superfície el terreny perd tot el realisme. Una manera d'augmentar el detall dels conjunts de dades actuals és afegint a l'escena detalls sintètics de manera plausible, és a dir, incloure elements que encaixin amb les característiques que es perceben a la vista aèria. Així, combinant les dades reals amb instàncies de models sobre el terreny i altres tècniques de detall procedural, la resolució efectiva del model pot arribar a ser arbitrària. Hi ha diverses aplicacions per a les quals no cal una reproducció exacta dels elements reals, però que es beneficiarien de models de terreny augmentats de manera plausible: videojocs i aplicacions d'entreteniment, avaluació de l'impacte visual (per exemple, com es veuria una nova estació d'esquí), turisme virtual, simulacions, etc. En aquesta tesi, proposem nous mètodes i eines per ajudar a la reconstrucció i síntesi de terrenys en alta resolució partint de conjunts de dades disponibles públicament, per tal d'aconseguir vistes a nivell de terra realistes. En particular, hem decidit centrar-nos en escenes rurals, muntanyes i àrees boscoses. El nostre principal objectiu és la combinació d'elements sintètics plausibles i detall procedural amb dades reals disponibles públicament per tal de generar escenes 3D d'ubicacions existents. La nostra recerca s'ha centrat en les següents contribucions: - Un pipeline eficient per a segmentació d'imatges aèries - Millora plausible de models de terreny a partir d'exemples d’alta resolució - Super-resolució de models d'elevacions transferint-hi detalls de la fotografia aèria - Síntesis d'un nombre arbitrari de variacions d’imatges d’arbres a partir d'un conjunt reduït de fotografies - Reconstrucció de models 3D d'arbres a partir d'una única fotografia - Una representació compacta i eficient d'arbres per a navegació en temps real d'escenesPostprint (published version

Advancement of Computing on Large Datasets via Parallel Computing and Cyberinfrastructure

Large datasets require efficient processing, storage and management to efficiently extract useful information for innovation and decision-making. This dissertation demonstrates novel approaches and algorithms using virtual memory approach, parallel computing and cyberinfrastructure. First, we introduce a tailored user-level virtual memory system for parallel algorithms that can process large raster data files in a desktop computer environment with limited memory. The application area for this portion of the study is to develop parallel terrain analysis algorithms that use multi-threading to take advantage of common multi-core processors for greater efficiency. Second, we present two novel parallel WaveCluster algorithms that perform cluster analysis by taking advantage of discrete wavelet transform to reduce large data to coarser representations so data is smaller and more easily managed than the original data in size and complexity. Finally, this dissertation demonstrates an HPC gateway service that abstracts away many details and complexities involved in the use of HPC systems including authentication, authorization, and data and job management

Application of new science tools in integrated watershed management for enhancing impacts.

Not AvailableApplication of new science tools in rainfed agriculture opens up new vistas for development through IWMPs. These tools can help in improving the rural livelihoods and contributing substantially to meet the millennium development goals of halving the number of hungry people by 2015 and achieving food security through enhanced use efficiency of scarce natural resources such as land and water in the tropical countries. Till now rainfed areas of the SAT did not get much benefit of new science tools but the recent research using these tools such as simulation modeling, remote sensing, GIS as well as satellite-based monitoring of the natural resources in the SAT has shown that not only the effectiveness of the research is enhanced substantially but also the cost efficiency and impact are enhanced. The remarkable developments in space technology currently offer satellites which provide better spatial and spectral resolutions, more frequent revisits, stereo viewing, and on-board recording capabilities. Thus, the high spatial and temporal resolution satellite data could be effectively used for watershed management and monitoring activities at land ownership level. By using crop simulation modeling approach, yield gap analyses for the major crops in Asia, Africa, and WANA regions revealed that the yields could be doubled with the existing technologies if the improved crop land, nutrient, and water management options are scaled-out. Similarly, technology application domains could be easily identified for better success and greater adoption of the particular technologies considering the biophysical as well as socioeconomic situations. GIS helped in speedy analysis of voluminous data and more rationale decision in less time to target the investments as well as to monitor the large number of interventions in the SAT. The satellite-based techniques along with GIS helped in identifying the vast fallow areas (2 million ha) in Madhya Pradesh during the rainy season. Similarly, 14 million ha rice-fallows in the Indo-Gangetic Plain offer excellent potential to grow second crop on residual soil moisture by using shortduration chickpea cultivars and simple seed priming technology. These techniques are also successfully used for preparing detailed thematic maps, watershed development plans, and continuous monitoring of the natural resources in the country in rainfed areas. Further, such data could be of immense help in tracking the implementation, applying midcourse corrections, and for assessing long-term effectiveness of the program implemented. The synergy of GIS and Web Technology allows access to dynamic geospatial watershed information without burdening the users with complicated and expensive software. Further, these web-based technologies help the field data collection and analysis in a collaborative way. However the availability of suitable software for watershed studies and their management in open GIS platform is very limited. Hence, there is a requirement to strengthen this area through collaborative efforts between various line organizations. Use of ICT in IWMP can bridge the existing gap to reach millions of small farm holders who have no access to new technologies for enhancing agricultural productivity on their farms. Use of smart sensor network along with GIS, remote sensing, Wani Ch006.tex 8/7/2011 19: 41 Page 201 Application of new science tools in integrated watershed management 201 simulation modeling and ICT opens up new opportunities for developing intelligent watershed management information systems. However, it calls for a new partnership involving corporates, development agencies, researchers from various disciplines and most importantly to reach millions of small farm holders in rainfed areas of the world. Application of new science tools in IWMP have helped to substantially enhance productivity as well as income from rainfed agriculture and improved livelihoods of the rural people.Not Availabl

AUTOMATED TREE-LEVEL FOREST QUANTIFICATION USING AIRBORNE LIDAR

Traditional forest management relies on a small field sample and interpretation of aerial photography that not only are costly to execute but also yield inaccurate estimates of the entire forest in question. Airborne light detection and ranging (LiDAR) is a remote sensing technology that records point clouds representing the 3D structure of a forest canopy and the terrain underneath. We present a method for segmenting individual trees from the LiDAR point clouds without making prior assumptions about tree crown shapes and sizes. We then present a method that vertically stratifies the point cloud to an overstory and multiple understory tree canopy layers. Using the stratification method, we modeled the occlusion of higher canopy layers with respect to point density. We also present a distributed computing approach that enables processing the massive data of an arbitrarily large forest. Lastly, we investigated using deep learning for coniferous/deciduous classification of point cloud segments representing individual tree crowns. We applied the developed methods to the University of Kentucky Robinson Forest, a natural, majorly deciduous, closed-canopy forest. 90% of overstory and 47% of understory trees were detected with false positive rates of 14% and 2% respectively. Vertical stratification improved the detection rate of understory trees to 67% at the cost of increasing their false positive rate to 12%. According to our occlusion model, a point density of about 170 pt/m² is needed to segment understory trees located in the third layer as accurately as overstory trees. Using our distributed processing method, we segmented about two million trees within a 7400-ha forest in 2.5 hours using 192 processing cores, showing a speedup of ~170. Our deep learning experiments showed high classification accuracies (~82% coniferous and ~90% deciduous) without the need to manually assemble the features. In conclusion, the methods developed are steps forward to remote, accurate quantification of large natural forests at the individual tree level

Understanding Hydroclimatic Controls on Stream Network Dynamics using LiDAR Data

This dissertation investigates the hydroclimatic controls on drainage network dynamics and characterizes the variation of drainage density in various climate regions. The methods were developed to extract the valley and wet channel networks based on Light Detection and Ranging (LiDAR) data including the elevation and intensity of laser returns. The study watersheds were selected based on the availability of streamflow observations and LiDAR data. Climate aridity index was used as a quantitative indicator for climate. The climate controls on drainage density were re-visited using watersheds with minimal anthropogenic interferences and compared with the U-shape relationship reported in the previous studies. A curvature-based method was developed to extract a valley network from 1-m LiDAR-based Digital Elevation Models. The relationship between drainage density and climate aridity index showed a monotonic increasing trend and the discrepancy was explained by human interventions and underestimated drainage density due to the coarse spatial resolution (30-meter) of the topographic maps used in previous research. Observations of wet channel networks are limited, especially in headwater catchments in comparison with the importance of stream network expansion and contraction. A systematic method was developed to extract wet channel networks based on the signal intensities of LiDAR ground returns, which are lower on water surfaces than on dry surfaces. The frequency distributions of intensities associated with wet surface and dry surface returns were constructed. With the aid of LiDAR-based ground elevations, signal intensity thresholds were identified for extracting wet channels. The developed method was applied to Lake Tahoe area during recession periods in five watersheds. A power-law relationship between streamflow and wet channel length was obtained and the scaling exponent was consistent with the reported findings from field work in other regions. Perennial streams flow for the most of the time during normal years and are usually defined based on a flow duration threshold. The streamflow characteristics of perennial streams in this research were assessed using the relationship between streamflow exceedance probability and wet channel ratio based on wet channel networks extracted from LiDAR data. Non-dimensional analysis based on the relationship between streamflow exceedance probability and wet channel ratio showed that results were consistent with previous research about perennial stream definition, and provided the possibility to use wet channel ratio to define perennial streams. Wetlands are important natural resources and need to be monitored regularly in order to understand their inundation dynamics, function and health. Wetland mapping is a key part of monitoring programs. A framework for detecting wetland was developed based on LiDAR elevation and intensity information. After masking out densely vegetated areas, wet areas were identified based on signal intensity of ground returns for barrier islands in East-Central Florida. The intensity threshold of wet surface was identified by decomposing composite probability distribution functions using a Gamma mixture model and the Expectation-Maximization algorithm. This method showed good potential for wetland mapping. The methodology developed in this dissertation demonstrated that incorporating LiDAR data into the drainage networks, stream network dynamics and wetlands results in enhanced understanding of hydroclimatic controls on stream network dynamics. LiDAR data provide a rich information source including elevation and intensity, and are of great benefit to hydrologic research community

Deep learning in agriculture: A survey

Deep learning constitutes a recent, modern technique for image processing and data analysis, with promising results and large potential. As deep learning has been successfully applied in various domains, it has recently entered also the domain of agriculture. In this paper, we perform a survey of 40 research efforts that employ deep learning techniques, applied to various agricultural and food production challenges. We examine the particular agricultural problems under study, the specific models and frameworks employed, the sources, nature and pre-processing of data used, and the overall performance achieved according to the metrics used at each work under study. Moreover, we study comparisons of deep learning with other existing popular techniques, in respect to differences in classification or regression performance. Our findings indicate that deep learning provides high accuracy, outperforming existing commonly used image processing techniques.info:eu-repo/semantics/acceptedVersio

Deep learning in agriculture: A survey

Deep learning constitutes a recent, modern technique for image processing and data analysis, with promising results and large potential. As deep learning has been successfully applied in various domains, it has recently entered also the domain of agriculture. In this paper, we perform a survey of 40 research efforts that employ deep learning techniques, applied to various agricultural and food production challenges. We examine the particular agricultural problems under study, the specific models and frameworks employed, the sources, nature and pre-processing of data used, and the overall performance achieved according to the metrics used at each work under study. Moreover, we study comparisons of deep learning with other existing popular techniques, in respect to differences in classification or regression performance. Our findings indicate that deep learning provides high accuracy, outperforming existing commonly used image processing techniques