Nonparametric image registration of airborne LiDAR, hyperspectral and photographic imagery of wooded landscapes

There is much current interest in using multisensor airborne remote sensing to monitor the structure and biodiversity of woodlands. This paper addresses the application of nonparametric (NP) image-registration techniques to precisely align images obtained from multisensor imaging, which is critical for the successful identification of individual trees using object recognition approaches. NP image registration, in particular, the technique of optimizing an objective function, containing similarity and regularization terms, provides a flexible approach for image registration. Here, we develop a NP registration approach, in which a normalized gradient field is used to quantify similarity, and curvature is used for regularization (NGF-Curv method). Using a survey of woodlands in southern Spain as an example, we show that NGF-Curv can be successful at fusing data sets when there is little prior knowledge about how the data sets are interrelated (i.e., in the absence of ground control points). The validity of NGF-Curv in airborne remote sensing is demonstrated by a series of experiments. We show that NGF-Curv is capable of aligning images precisely, making it a valuable component of algorithms designed to identify objects, such as trees, within multisensor data sets.This work was supported by the Airborne Research and Survey Facility of the U.K.’s Natural Environment Research Council (NERC) for collecting and preprocessing the data used in this research project [EU11/03/100], and by the grants supported from King Abdullah University of Science Technology and Wellcome Trust (BBSRC). D. Coomes was supported by a grant from NERC (NE/K016377/1) and funding from DEFRA and the BBSRC to develop methods for monitoring ash dieback from aircraft.This is the final version. It was first published by IEEE at http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7116541&sortType%3Dasc_p_Sequence%26filter%3DAND%28p_Publication_Number%3A36%29%26pageNumber%3D5

Mapping individual trees from airborne multi-sensor imagery

Airborne multi-sensor imaging is increasingly used to examine vegetation properties. The advantage of using multiple types of sensor is that each detects a different feature of the vegetation, so that collectively they provide a detailed understanding of the ecological pattern. Specifically, Light Detection And Ranging (LiDAR) devices produce detailed point clouds of where laser pulses have been backscattered from surfaces, giving information on vegetation structure; hyperspectral sensors measure reflectances within narrow wavebands, providing spectrally detailed information about the optical properties of targets; while aerial photographs provide high spatial-resolution imagery so that they can provide more feature details which cannot be identified from hyperspectral or LiDAR intensity images. Using a combination of these sensors, effective techniques can be developed for mapping species and inferring leaf physiological processes at ITC-level. Although multi-sensor approaches have revolutionised ecological research, their application in mapping individual tree crowns is limited by two major technical issues: (a) Multi-sensor imaging requires all images taken from different sensors to be co-aligned, but different sensor characteristics result in scale, rotation or translation mismatches between the images, making correction a pre-requisite of individual tree crown mapping; (b) reconstructing individual tree crowns from unstructured raw data space requires an accurate tree delineation algorithm. This thesis develops a schematic way to resolve these technical issues using the-state-of-the-art computer vision algorithms. A variational method, called NGF-Curv, was developed to co-align hyperspectral imagery, LiDAR and aerial photographs.NGF-Curv algorithm can deal with very complex topographic and lens distortions efficiently, thus improving the accuracy of co-alignment compared to established image registration methods for airborne data. A graph cut method, named MCNCP-RNC was developed to reconstruct individual tree crowns from fully integrated multi-sensor imagery. MCNCP-RNC is not influenced by interpolation artefacts because it detects trees in 3D, and it detects individual tree crowns using both hyperspectral imagery and LiDAR. Based on these algorithms, we developed a new workflow to detect species at pixel and ITC levels in a temperate deciduous forest in the UK. In addition, we modified the workflow to monitor physiological responses of two oak species with respect to environmental gradients in a Mediterranean woodland in Spain. The results show that our scheme can detect individual tree crowns, find species and monitor physiological responses of canopy leaves

Individual Tree Species Classification from Airborne Multisensor Imagery Using Robust PCA

Remote sensing of individual tree species has many applications in resource management, biodiversity assessment, and conservation. Airborne remote sensing using light detection and ranging (LiDAR) and hyperspectral sensors has been used extensively to extract biophysical traits of vegetation and to detect species. However, its application for individual tree mapping remains limited due to the technical challenges of precise coalignment of images acquired from different sensors and accurately delineating individual tree crowns (ITCs). In this study, we developed a generic workflow to map tree species at ITC level from hyperspectral imagery and LiDAR data using a combination of well established and recently developed techniques. The workflow uses a nonparametric image registration approach to coalign images, a multiclass normalized graph cut method for ITC delineation, robust principal component analysis for feature extraction, and support vector machine for species classification. This workflow allows us to automatically map tree species at both pixel- and ITC-level. Experimental tests of the technique were conducted using ground data collected from a fully mapped temperate woodland in the UK. The overall accuracy of pixel-level classification was 91%, while that of ITC-level classification was 61%. The test results demonstrate the effectiveness of the approach, and in particular the use of robust principal component analysis to prune the hyperspectral dataset and reveal subtle difference among species.Department for Environment, Food and Rural AffairsThis is the author accepted manuscript. The final version is available from IEEE via http://dx.doi.org/10.1109/JSTARS.2016.256940

The application of UASs in forest management and monitoring : challenges and opportunities for use in the Miombo woodland

DATA AVAILABILITY STATEMENT : The data are available on request from the corresponding authorThe Miombo woodland is the most extensive tropical woodland in south-central Africa. However, field sample plot data on forest cover changes, species distribution and carbon stocks in the Miombo ecoregion are inadequate for effective forest management. Owing to logistical challenges that come with field-based inventory methods, remote sensing plays an important role in supplementing field methods to fill in data gaps. Traditional satellite and manned aircraft remote sensing platforms have their own advantages and limitations. The advent of unmanned aerial systems (UASs) has made it possible to acquire forest data at unprecedented spatial and temporal scales. UASs are adaptable to various forest applications in terms of providing flexibility in data acquisition with different sensors (RGB, multispectral, hyperspectral, thermal and light detection and ranging (lidar)) at a convenient time. To highlight possible applications in the Miombo woodlands, we first provide an overview of the Miombo woodlands and recent progress in remote sensing with small UASs. An overview of some potential forest applications was undertaken to identify key prospects and challenges for UAS applications in the Miombo region, which will provide expertise and guidance upon which future applications in the Miombo woodlands should be based. While much of the potential of using UASs for forest data acquisition in the Miombo woodlands remains to be realized, it is likely that the next few years will see such systems being used to provide data for an ever-increasing range of forest applications.The United States Agency for International Development through Partnerships for Enhanced Engagement in Research (PEER) program, Oliver R Tambo African Research Chair Initiative (ORTARChI) project, an initiative of Canada’s International Development Research Centre (IDRC), South Africa’s National Research Foundation (NRF) and the Department of Science and Innovation (DSI), in partnership with the Oliver & Adelaide Tambo Foundation (OATF) and National Science and Technology Council, Zambia.https://www.mdpi.com/journal/forestsam2023Forestry and Agricultural Biotechnology Institute (FABI)Plant Production and Soil Scienc

Robust Fine Registration of Multisensor Remote Sensing Images Based on Enhanced Subpixel Phase Correlation

Automatic fine registration of multisensor images plays an essential role in many remote sensing applications. However, it is always a challenging task due to significant radiometric and textural differences. In this paper, an enhanced subpixel phase correlation method is proposed, which embeds phase congruency-based structural representation, L1-norm-based rank-one matrix approximation with adaptive masking, and stable robust model fitting into the conventional calculation framework in the frequency domain. The aim is to improve the accuracy and robustness of subpixel translation estimation in practical cases. In addition, template matching using the enhanced subpixel phase correlation is integrated to realize reliable fine registration, which is able to extract a sufficient number of well-distributed and high-accuracy tie points and reduce the local misalignment for coarsely coregistered multisensor remote sensing images. Experiments undertaken with images from different satellites and sensors were carried out in two parts: tie point matching and fine registration. The results of qualitative analysis and quantitative comparison with the state-of-the-art area-based and feature-based matching methods demonstrate the effectiveness and reliability of the proposed method for multisensor matching and registration.TU Berlin, Open-Access-Mittel – 202

Remote Sensing of Savannas and Woodlands

Savannas and woodlands are one of the most challenging targets for remote sensing. This book provides a current snapshot of the geographical focus and application of the latest sensors and sensor combinations in savannas and woodlands. It includes feature articles on terrestrial laser scanning and on the application of remote sensing to characterization of vegetation dynamics in the Mato Grosso, Cerrado and Caatinga of Brazil. It also contains studies focussed on savannas in Europe, North America, Africa and Australia. It should be important reading for environmental practitioners and scientists globally who are concerned with the sustainability of the global savanna and woodland biome

Multiple Instance Choquet Integral for multiresolution sensor fusion

Imagine you are traveling to Columbia, MO for the first time. On your flight to Columbia, the woman sitting next to you recommended a bakery by a large park with a big yellow umbrella outside. After you land, you need directions to the hotel from the airport. Suppose you are driving a rental car, you will need to park your car at a parking lot or a parking structure. After a good night's sleep in the hotel, you may decide to go for a run in the morning on the closest trail and stop by that recommended bakery under a big yellow umbrella. It would be helpful in the course of completing all these tasks to accurately distinguish the proper car route and walking trail, find a parking lot, and pinpoint the yellow umbrella. Satellite imagery and other geo-tagged data such as Open Street Maps provide effective information for this goal. Open Street Maps can provide road information and suggest bakery within a five-mile radius. The yellow umbrella is a distinctive color and, perhaps, is made of a distinctive material that can be identified from a hyperspectral camera. Open Street Maps polygons are tagged with information such as "parking lot" and "sidewalk." All these information can and should be fused to help identify and offer better guidance on the tasks you are completing. Supervised learning methods generally require precise labels for each training data point. It is hard (and probably at an extra cost) to manually go through and label each pixel in the training imagery. GPS coordinates cannot always be fully trusted as a GPS device may only be accurate to the level of several pixels. In many cases, it is practically infeasible to obtain accurate pixel-level training labels to perform fusion for all the imagery and maps available. Besides, the training data may come in a variety of data types, such as imagery or as a 3D point cloud. The imagery may have different resolutions, scales and, even, coordinate systems. Previous fusion methods are generally only limited to data mapped to the same pixel grid, with accurate labels. Furthermore, most fusion methods are restricted to only two sources, even if certain methods, such as pan-sharpening, can deal with different geo-spatial types or data of different resolution. It is, therefore, necessary and important, to come up with a way to perform fusion on multiple sources of imagery and map data, possibly with different resolutions and of different geo-spatial types with consideration of uncertain labels. I propose a Multiple Instance Choquet Integral framework for multi-resolution multisensor fusion with uncertain training labels. The Multiple Instance Choquet Integral (MICI) framework addresses uncertain training labels and performs both classification and regression. Three classifier fusion models, i.e. the noisy-or, min-max, and generalized-mean models, are derived under MICI. The Multi-Resolution Multiple Instance Choquet Integral (MR-MICI) framework is built upon the MICI framework and further addresses multiresolution in the fusion sources in addition to the uncertainty in training labels. For both MICI and MR-MICI, a monotonic normalized fuzzy measure is learned to be used with the Choquet integral to perform two-class classifier fusion given bag-level training labels. An optimization scheme based on the evolutionary algorithm is used to optimize the models proposed. For regression problems where the desired prediction is real-valued, the primary instance assumption is adopted. The algorithms are applied to target detection, regression and scene understanding applications. Experiments are conducted on the fusion of remote sensing data (hyperspectral and LiDAR) over the campus of University of Southern Mississippi - Gulfpark. Clothpanel sub-pixel and super-pixel targets were placed on campus with varying levels of occlusion and the proposed algorithms can successfully detect the targets in the scene. A semi-supervised approach is developed to automatically generate training labels based on data from Google Maps, Google Earth and Open Street Map. Based on such training labels with uncertainty, the proposed algorithms can also identify materials on campus for scene understanding, such as road, buildings, sidewalks, etc. In addition, the algorithms are used for weed detection and real-valued crop yield prediction experiments based on remote sensing data that can provide information for agricultural applications.Includes biblographical reference

Remote sensing technology applications in forestry and REDD+

Advances in close-range and remote sensing technologies are driving innovations in forest resource assessments and monitoring on varying scales. Data acquired with airborne and spaceborne platforms provide high(er) spatial resolution, more frequent coverage, and more spectral information. Recent developments in ground-based sensors have advanced 3D measurements, low-cost permanent systems, and community-based monitoring of forests. The UNFCCC REDD+ mechanism has advanced the remote sensing community and the development of forest geospatial products that can be used by countries for the international reporting and national forest monitoring. However, an urgent need remains to better understand the options and limitations of remote and close-range sensing techniques in the field of forest degradation and forest change. Therefore, we invite scientists working on remote sensing technologies, close-range sensing, and field data to contribute to this Special Issue. Topics of interest include: (1) novel remote sensing applications that can meet the needs of forest resource information and REDD+ MRV, (2) case studies of applying remote sensing data for REDD+ MRV, (3) timeseries algorithms and methodologies for forest resource assessment on different spatial scales varying from the tree to the national level, and (4) novel close-range sensing applications that can support sustainable forestry and REDD+ MRV. We particularly welcome submissions on data fusion

Utilising airborne scanning laser (LiDAR) to improve the assessment of Australian native forest structure

Enhanced understanding of forest stocks and dynamics can be gained through improved forest measurement, which is required to assist with sustainable forest management decisions, meet Australian and international reporting needs, and improve research efforts to better respond to a changing climate. Integrated sampling schemes that utilise a multi-scale approach, with a range of data sourced from both field and remote sensing, have been identified as a way to generate the required forest information. Given the multi-scale approach proposed by these schemes, it is important to understand how scale potentially affects the interpretation and reporting of forest from a range of data. ¶ To provide improved forest assessment at a range of scales, this research has developed a strategy for facilitating tree and stand level retrieval of structural attributes within an integrated multi-scale analysis framework. ..

Operationalization of Remote Sensing Solutions for Sustainable Forest Management

The great potential of remote sensing technologies for operational use in sustainable forest management is addressed in this book, which is the reprint of papers published in the Remote Sensing Special Issue “Operationalization of Remote Sensing Solutions for Sustainable Forest Management”. The studies come from three continents and cover multiple remote sensing systems (including terrestrial mobile laser scanning, unmanned aerial vehicles, airborne laser scanning, and satellite data acquisition) and a diversity of data processing algorithms, with a focus on machine learning approaches. The focus of the studies ranges from identification and characterization of individual trees to deriving national- or even continental-level forest attributes and maps. There are studies carefully describing exercises on the case study level, and there are also studies introducing new methodologies for transdisciplinary remote sensing applications. Even though most of the authors look forward to continuing their research, nearly all studies introduced are ready for operational use or have already been implemented in practical forestry