Remote sensing image fusion on 3D scenarios: A review of applications for agriculture and forestry

Three-dimensional (3D) image mapping of real-world scenarios has a great potential to provide the user with a more accurate scene understanding. This will enable, among others, unsupervised automatic sampling of meaningful material classes from the target area for adaptive semi-supervised deep learning techniques. This path is already being taken by the recent and fast-developing research in computational fields, however, some issues related to computationally expensive processes in the integration of multi-source sensing data remain. Recent studies focused on Earth observation and characterization are enhanced by the proliferation of Unmanned Aerial Vehicles (UAV) and sensors able to capture massive datasets with a high spatial resolution. In this scope, many approaches have been presented for 3D modeling, remote sensing, image processing and mapping, and multi-source data fusion. This survey aims to present a summary of previous work according to the most relevant contributions for the reconstruction and analysis of 3D models of real scenarios using multispectral, thermal and hyperspectral imagery. Surveyed applications are focused on agriculture and forestry since these fields concentrate most applications and are widely studied. Many challenges are currently being overcome by recent methods based on the reconstruction of multi-sensorial 3D scenarios. In parallel, the processing of large image datasets has recently been accelerated by General-Purpose Graphics Processing Unit (GPGPU) approaches that are also summarized in this work. Finally, as a conclusion, some open issues and future research directions are presented.European Commission 1381202-GEU PYC20-RE-005-UJA IEG-2021Junta de Andalucia 1381202-GEU PYC20-RE-005-UJA IEG-2021Instituto de Estudios GiennesesEuropean CommissionSpanish Government UIDB/04033/2020DATI-Digital Agriculture TechnologiesPortuguese Foundation for Science and Technology 1381202-GEU FPU19/0010

Hyperspectral Imaging for Fine to Medium Scale Applications in Environmental Sciences

The aim of the Special Issue “Hyperspectral Imaging for Fine to Medium Scale Applications in Environmental Sciences” was to present a selection of innovative studies using hyperspectral imaging (HSI) in different thematic fields. This intention reflects the technical developments in the last three decades, which have brought the capacity of HSI to provide spectrally, spatially and temporally detailed data, favoured by e.g., hyperspectral snapshot technologies, miniaturized hyperspectral sensors and hyperspectral microscopy imaging. The present book comprises a suite of papers in various fields of environmental sciences—geology/mineral exploration, digital soil mapping, mapping and characterization of vegetation, and sensing of water bodies (including under-ice and underwater applications). In addition, there are two rather methodically/technically-oriented contributions dealing with the optimized processing of UAV data and on the design and test of a multi-channel optical receiver for ground-based applications. All in all, this compilation documents that HSI is a multi-faceted research topic and will remain so in the future

An under-ice hyperspectral and RGB imaging system to capture fine-scale biophysical properties of sea ice

Sea-ice biophysical properties are characterized by high spatio-temporal variability ranging from the meso- to the millimeter scale. Ice coring is a common yet coarse point sampling technique that struggles to capture such variability in a non-invasive manner. This hinders quantification and understanding of ice algae biomass patchiness and its complex interaction with some of its sea ice physical drivers. In response to these limitations, a novel under-ice sled system was designed to capture proxies of biomass together with 3D models of bottom topography of land-fast sea-ice. This system couples a pushbroom hyperspectral imaging (HI) sensor with a standard digital RGB camera and was trialed at Cape Evans, Antarctica. HI aims to quantify per-pixel chlorophyll-a content and other ice algae biological properties at the ice-water interface based on light transmitted through the ice. RGB imagery processed with digital photogrammetry aims to capture under-ice structure and topography. Results from a 20 m transect capturing a 0.61 m wide swath at sub-mm spatial resolution are presented. We outline the technical and logistical approach taken and provide recommendations for future deployments and developments of similar systems. A preliminary transect subsample was processed using both established and novel under-ice bio-optical indices (e.g., normalized difference indexes and the area normalized by the maximal band depth) and explorative analyses (e.g., principal component analyses) to establish proxies of algal biomass. This first deployment of HI and digital photogrammetry under-ice provides a proof-of-concept of a novel methodology capable of delivering non-invasive and highly resolved estimates of ice algal biomass in-situ, together with some of its environmental drivers. Nonetheless, various challenges and limitations remain before our method can be adopted across a range of sea-ice conditions. Our work concludes with suggested solutions to these challenges and proposes further method and system developments for future research

UAVs for the Environmental Sciences

This book gives an overview of the usage of UAVs in environmental sciences covering technical basics, data acquisition with different sensors, data processing schemes and illustrating various examples of application

Assessing The Biophysical Naturalness Of Grassland In Eastern North Dakota With Hyperspectral Imagery

Over the past two decades, non-native species within grassland communities have quickly developed due to human migration and commerce. Invasive species like Smooth Brome grass (Bromus inermis) and Kentucky Blue Grass (Poa pratensis), seriously threaten conservation of native grasslands. This study aims to discriminate between native grasslands and planted hayfields and conservation areas dominated by introduced grasses using hyperspectral imagery. Hyperspectral imageries from the Hyperion sensor on EO-1 were acquired in late spring and late summer on 2009 and 2010. Field spectra for widely distributed species as well as smooth brome grass and Kentucky blue grass were collected from the study sites throughout the growing season. Imagery was processed with an unmixing algorithm to estimate fractional cover of green and dry vegetation and bare soil. As the spectrum is significantly different through growing season, spectral libraries for the most common species are then built for both the early growing season and late growing season. After testing multiple methods, the Adaptive Coherence Estimator (ACE) was used for spectral matching analysis between the imagery and spectral libraries. Due in part to spectral similarity among key species, the results of spectral matching analysis were not definitive. Additional indexes, Level of Dominance and Band variance , were calculated to measure the predominance of spectral signatures in any area. A Texture co-occurrence analysis was also performed on both Level of Dominance and Band variance indexes to extract spatial characteristics. The results suggest that compared with disturbed area, native prairie tend to have generally lower Level of Dominance and Band variance as well as lower spatial dissimilarity. A final decision tree model was created to predict presence of native or introduced grassland. The model was more effective for identification of Mixed Native Grassland than for grassland dominated by a single species. The discrimination of native and introduced grassland was limited by the similarity of spectral signatures between forb-dominated native grasslands and brome-grass stands. However, saline native grasslands were distinguishable from brome grass

Very High Resolution (VHR) Satellite Imagery: Processing and Applications

Recently, growing interest in the use of remote sensing imagery has appeared to provide synoptic maps of water quality parameters in coastal and inner water ecosystems;, monitoring of complex land ecosystems for biodiversity conservation; precision agriculture for the management of soils, crops, and pests; urban planning; disaster monitoring, etc. However, for these maps to achieve their full potential, it is important to engage in periodic monitoring and analysis of multi-temporal changes. In this context, very high resolution (VHR) satellite-based optical, infrared, and radar imaging instruments provide reliable information to implement spatially-based conservation actions. Moreover, they enable observations of parameters of our environment at greater broader spatial and finer temporal scales than those allowed through field observation alone. In this sense, recent very high resolution satellite technologies and image processing algorithms present the opportunity to develop quantitative techniques that have the potential to improve upon traditional techniques in terms of cost, mapping fidelity, and objectivity. Typical applications include multi-temporal classification, recognition and tracking of specific patterns, multisensor data fusion, analysis of land/marine ecosystem processes and environment monitoring, etc. This book aims to collect new developments, methodologies, and applications of very high resolution satellite data for remote sensing. The works selected provide to the research community the most recent advances on all aspects of VHR satellite remote sensing

Automated Synthetic Scene Generation

First principles, physics-based models help organizations developing new remote sensing instruments anticipate sensor performance by enabling the ability to create synthetic imagery for proposed sensor before a sensor is built. One of the largest challenges in modeling realistic synthetic imagery, however, is generating the spectrally attributed, three-dimensional scenes on which the models are based in a timely and affordable fashion. Additionally, manual and semi-automated approaches to synthetic scene construction which rely on spectral libraries may not adequately capture the spectral variability of real-world sites especially when the libraries consist of measurements made in other locations or in a lab. This dissertation presents a method to fully automate the generation of synthetic scenes when coincident lidar, Hyperspectral Imagery (HSI), and high-resolution imagery of a real-world site are available. The method, called the Lidar/HSI Direct (LHD) method, greatly reduces the time and manpower needed to generate a synthetic scene while also matching the modeled scene as closely as possible to a real-world site both spatially and spectrally. Furthermore, the LHD method enables the generation of synthetic scenes over sites in which ground access is not available providing the potential for improved military mission planning and increased ability to fuse information from multiple modalities and look angles. The LHD method quickly and accurately generates three-dimensional scenes providing the community with a tool to expand the library of synthetic scenes and therefore expand the potential applications of physics-based synthetic imagery modeling

An investigation in the use of advanced remote sensing and geographic information system techniques for post-fire impact assessment on vegetation.

2006/2007Gli incendi boschivi rappresentano uno dei maggiori problemi ambientali nella regione Mediterranea con vaste superfici colpite ogni estate. Una stima dell’impatto ambientale degli incendi (a breve e a lungo termine) richiede la raccolta di informazioni accurate post-incendio relative al tipo di incendio, all’intensità, alla rigenerazione forestale ed al ripristino della vegetazione. L’utilizzo di tecniche avanzate di telerilevamento può fornire un valido strumento per lo studio di questi fenomeni. L’importanza di queste ricerche è stata più volte sottolineata dalla Commissione Europea che si è concentrata sullo studio degli incendi boschivi ed il loro effetto sulla vegetazione attraverso lo sviluppo di adeguati metodi di stima dell’impatto e di mitigazione. Scopo di questo lavoro è la stima dell’impatto post-incendio sulla vegetazione in ambiente Mediterraneo per mezzo di immagini satellitari ad alta risoluzione, di rilievi a terra e mediante tecniche avanzate di analisi dei dati. Il lavoro ha riguardato lo sviluppo di un sistema per l’integrazione di dati telerilevati ad altissima risoluzione spaziale e spettrale. Per la stima dell’impatto a breve termine, un modello di classificazione ad oggetti è stato sviluppato utilizzando immagini Ikonos ad altissima risoluzione spaziale per cartografare il tipo di incendio, differenziando l’incendio radente dall’incendio di chioma. I risultati mostrano che la classificazione ad oggetti potrebbe essere utilizzata per distinguere con elevata accuratezza (87% di accuratezza complessiva) le due tipologie di incendio, in particolare nei boschi Mediterranei aperti. È stata inoltre valutata la capacità della classificazione ad oggetti di distinguere e cartografare tre livelli di intensità del fuoco utilizzando le immagini Ikonos e l’accuratezza del risultato è stimata all’ 83%. Per la stima dell’impatto a lungo termine, la mappatura della rigenerazione post-incendio (pino) e la ripresa della vegetazione arbustiva sono state valutate mediante tre approcci: 1) la classificazione ad oggetti di immagini ad altissima risoluzione QuickBird che ha permesso di mappare la ripresa della vegetazione e l’impatto sulla copertura a seguito dell’incendio distinguendo due livelli di intensità dell’incendio (accuratezza della classificazione 86%). 2) l’analisi statistica di dati iperspettrali rilevati in campo che ha permesso una riduzione del 97% del volume di dati e la selezione delle migliori 14 bande per discriminare l’età e le specie di pino e le 18 migliori bande per la caratterizzazione delle specie arbustive. Successivamente, i dati iperspettrali Hyperion sono stati utlizzati per mappare la rigenerazione forestale e la ripresa della vegetazione. L’accuratezza complessiva della classificazione è stata del 75.1% considerando due diverse specie di pino ed altre specie vegetali. 3) una classificazione ad oggetti che ha combinato l’analisi dei dati QuickBird ed Hyperion. Si è registrato un aumento dell’accuratezza della classificazione pari all’8.06% rispetto all’utilizzo dei soli dati Hyperion. Complessivamente, si osserva che strumenti avanzati di telerilevamento consentono di raccogliere le informazioni relative alle aree incendiate, la rigenerazione forestale e la ripresa della vegetazione in modo accurato e vantaggioso in termini di costi e tempi.Forest fires are a major environmental problem in the Mediterranean region, where large areas are affected each summer. An assessment of the environmental impact of forest fires (in the short-term and in the long-term) requires the collection of accurate and detailed post-fire information related to fire type, fire severity, forest regeneration and vegetation recovery. Advanced tools in remote sensing provide a powerful tool for the study of this phenomenon. The importance of this work was often emphasized by the European Commission, which focused on the studying of forest fires and their effect on vegetation through the development of appropriate impact assessment and mitigation methods. The aim of this study was to assess the post-fire impact on vegetation in a Mediterranean environment by employing high quality satellite and field data and by using advanced data processing techniques. The work entailed the development of a whole system integrating very high spatial and spectral resolution remotely sensed data. For short-term impact assessment, an object-oriented model was developed using very high spatial resolution Ikonos imagery to map the type of fire, namely, canopy fire and surface fire. The results showed that object-oriented classification could be used to accurately distinguish and map areas of surface and crown fire spread (overall accuracy of 87%), especially that occurring in open Mediterranean forests. Also, the performance of object-based classification in mapping three levels of fire severity by employing high spatial resolution Ikonos imagery was evaluated, and accuracy of the obtained results was estimated to be 83%. As for long-term impact assessment, the mapping of post-fire forest regeneration (pine) and vegetation recovery (shrub) was performed by following three different approaches. First, the developed object-based classification of QuickBird (very high spatial resolution) allowed post-fire vegetation recovery and survival mapping of canopy within two different fire severity levels (86% of classification accuracy). The main effect of fire has been to create a more homogeneous landscape. Second, statistical analysis of field hyperspectral data allowed a 97% reduction in data volume and recommended 14 best narrowbands to discriminate among pine trees (age and species) and 18 bands that best characterize the different shrub species. Then, hyperspectral Hyperion was employed for mapping post-fire forest regeneration and vegetation recovery. The overall classification accuracy was found to be 75.81% when mapping two different regenerated pine species and other species of vegetation recovery. Third, an object-oriented combined analysis of QuickBird and Hyperion was investigated for the same objective. An improvement in classification accuracy of 8.06% was recorded when combining both Hyperion and QuickBird imageries than by using only the Hyperion image. Overall, it was observed that advanced tools in remote sensing provided the necessary means for gathering information about the burned areas, the regenerated forests and the recovered vegetations in a successful and a timely/cost effective manner.XX Ciclo197