드론을 활용한 위성 지표반사도 산출물 공간 패턴 분석

학위논문(석사) -- 서울대학교대학원 : 농업생명과학대학 생태조경·지역시스템공학부(생태조경학), 2021.8. 조대솔.High-resolution satellites are assigned to monitor land surface in detail. The reliable surface reflectance (SR) is the fundamental in terrestrial ecosystem modeling so the temporal and spatial validation is essential. Usually based on multiple ground control points (GCPs), field spectroscopy guarantees the temporal continuity. Due to limited sampling, however, it hardly illustrates the spatial pattern. As a map, the pixelwise spatial variability of SR products is not well-documented. In this study, we introduced drone-based hyperspectral image (HSI) as a reference and compared the map with Sentinel 2 and Landsat 8 SR products on a heterogeneous rice paddy landscape. First, HSI was validated by field spectroscopy and swath overlapping, which assured qualitative radiometric accuracy within the viewing geometry. Second, HSI was matched to the satellite SRs. It involves spectral and spatial aggregation, co-registration and nadir bidirectional reflectance distribution function (BRDF)-adjusted reflectance (NBAR) conversion. Then, we 1) quantified the spatial variability of the satellite SRs and the vegetation indices (VIs) including NDVI and NIRv by APU matrix, 2) qualified them pixelwise by theoretical error budget and 3) examined the improvement by BRDF normalization. Sentinel 2 SR exhibits overall good agreement with drone HSI while the two NIRs are biased up to 10%. Despite the bias in NIR, the NDVI shows a good match on vegetated areas and the NIRv only displays the discrepancy on built-in areas. Landsat 8 SR was biased over the VIS bands (-9 ~ -7.6%). BRDF normalization just contributed to a minor improvement. Our results demonstrate the potential of drone HSI to replace in-situ observation and evaluate SR or atmospheric correction algorithms over the flat terrain. Future researches should replicate the results over the complex terrain and canopy structure (i.e. forest).원격탐사에서 지표 반사도(SR)는 지표정보를 비파괴적이고 즉각적인 방법으로 전달해주는 매개체 역할을 한다. 신뢰할 수 있는 SR은 육상 생태계 모델링의 기본이고, 이에 따라 SR의 시공간적 검증이 요구된다. 일반적으로 SR은 여러 지상 기준점(GCP)을 기반으로 하는 현장 분광법을 통해서 시간적 연속성이 보장된다. 그러나 현장 분광법은 제한적인 샘플링으로 공간 패턴을 거의 보여주지 않아, 위성 SR의 픽셀 별 공간 변동성은 잘 분석되지 않았다. 본 연구에서는 드론 기반의 초분광 영상(HSI)을 참고자료로 도입하여, 이를 이질적인 논 경관에서 Sentinel 2 및 Landsat 8 SR과 비교하였다. 우선, 드론 HSI는 현장 분광법 및 경로 중첩을 통해서 관측각도 범위 내에서 정성적인 방사 측정을 보장한다고 검증되었다. 이후, 드론 HSI는 위성 SR의 분광반응특성, 공간해상도 및 좌표계를 기준으로 맞춰졌고, 관측 기하를 통일하기 위해서 드론 HIS와 위성 SR은 각각 양방향반사율분포함수 (BRDF) 정규화 반사도 (NBAR)로 변환되었다. 마지막으로, 1) APU 행렬으로 위성 SR과 NDVI, NIRv를 포함하는 식생지수(VI)의 공간변동성을 정량화 했고, 2) 대기보정의 이론적 오차를 기준으로 SR과 VI를 픽셀별로 평가했고, 3) BRDF 정규화를 통한 개선 사항을 검토했다. Sentinel 2 SR은 드론 HSI와 전반적으로 좋은 일치를 보이나, 두 NIR 채널은 최대 10% 편향되었다. NIR의 편향은 식생지수에서 토지 피복에 따라 다른 영향을 미쳤다. NDVI는 식생에서는 낮은 편향을 보여줬고, NIRv는 도시시설물 영역에서만 높은 편향을 보였다. Landsat 8 SR은 VIS 채널에 대해 편향되었다 (-9 ~ -7.6%). BRDF 정규화는 위성 SR의 품질을 개선했지만, 그 영향은 부수적이었다. 본 연구에서는 평탄한 지형에서 드론 HSI가 현장 관측을 대체할 수 있고, 따라서 위성 SR이나 대기보정 알고리즘을 평가하는데 활용될 수 있다는 것을 보였다. 향후 연구에서는 산림으로 대상지를 확대하여, 지형과 캐노피 구조가 드론 HSI 및 위성 SR에 미치는 영향을 분석할 필요가 있다.Chapter 1. Introduction 1 1.1 Background 1 Chapter 2. Method 3 2.1 Study Site 3 2.2 Drone campaign 4 2.3 Data processing 4 2.3.1 Sensor calibration 5 2.3.2 Bidirectional reflectance factor (BRF) calculation 7 2.3.3 BRDF correction 7 2.3.4 Orthorectification 8 2.3.5 Spatial Aggregation 9 2.3.6 Co-registration 10 2.4 Satellite dataset 10 2.4.2 Landsat 8 12 Chapter 3. Result and Discussion 12 3.1 Drone BRF map quality assessment 12 3.1.1 Radiometric accuracy 12 3.1.2 BRDF effect 15 3.2 Spatial variability in satellite surface reflectance product 16 3.2.1 Sentinel 2B (10m) 17 3.2.2 Sentinel 2B (20m) 22 3.2.3 Landsat 8 26 Chapter 4. Conclusion 28 Supplemental Materials 30 Bibliography 34 Abstract in Korean 43석

Fusing Multiple Multiband Images

We consider the problem of fusing an arbitrary number of multiband, i.e., panchromatic, multispectral, or hyperspectral, images belonging to the same scene. We use the well-known forward observation and linear mixture models with Gaussian perturbations to formulate the maximum-likelihood estimator of the endmember abundance matrix of the fused image. We calculate the Fisher information matrix for this estimator and examine the conditions for the uniqueness of the estimator. We use a vector total-variation penalty term together with nonnegativity and sum-to-one constraints on the endmember abundances to regularize the derived maximum-likelihood estimation problem. The regularization facilitates exploiting the prior knowledge that natural images are mostly composed of piecewise smooth regions with limited abrupt changes, i.e., edges, as well as coping with potential ill-posedness of the fusion problem. We solve the resultant convex optimization problem using the alternating direction method of multipliers. We utilize the circular convolution theorem in conjunction with the fast Fourier transform to alleviate the computational complexity of the proposed algorithm. Experiments with multiband images constructed from real hyperspectral datasets reveal the superior performance of the proposed algorithm in comparison with the state-of-the-art algorithms, which need to be used in tandem to fuse more than two multiband images

Landsat 15-m Panchromatic-Assisted Downscaling (LPAD) of the 30-m Reflective Wavelength Bands to Sentinel-2 20-m Resolution

The Landsat 15-m Panchromatic-Assisted Downscaling (LPAD) method to downscale Landsat-8 Operational Land Imager (OLI) 30-m data to Sentinel-2 multi-spectral instrument (MSI) 20-m resolution is presented. The method first downscales the Landsat-8 30-m OLI bands to 15-m using the spatial detail provided by the Landsat-8 15-m panchromatic band and then reprojects and resamples the downscaled 15-m data into registration with Sentinel-2A 20-m data. The LPAD method is demonstrated using pairs of contemporaneous Landsat-8 OLI and Sentinel-2A MSI images sensed less than 19 min apart over diverse geographic environments. The LPAD method is shown to introduce less spectral and spatial distortion and to provide visually more coherent data than conventional bilinear and cubic convolution resampled 20-m Landsat OLI data. In addition, results for a pair of Landsat-8 and Sentinel-2A images sensed one day apart suggest that image fusion should be undertaken with caution when the images are acquired under different atmospheric conditions. The LPAD source code is available at GitHub for public use

Object-Based Area-to-Point Regression Kriging for Pansharpening

Optical earth observation satellite sensors often provide a coarse spatial resolution (CR) multispectral (MS) image together with a fine spatial resolution (FR) panchromatic (PAN) image. Pansharpening is a technique applied to such satellite sensor images to generate an FR MS image by injecting spatial detail taken from the FR PAN image while simultaneously preserving the spectral information of MS image. Pansharpening methods are mostly applied on a per-pixel basis and use the PAN image to extract spatial detail. However, many land cover objects in FR satellite sensor images are not illustrated as independent pixels, but as many spatially aggregated pixels that contain important semantic information. In this article, an object-based pansharpening approach, termed object-based area-to-point regression kriging (OATPRK), is proposed. OATPRK aims to fuse the MS and PAN images at the object-based scale and, thus, takes advantage of both the unified spectral information within the CR MS images and the spatial detail of the FR PAN image. OATPRK is composed of three stages: image segmentation, object-based regression, and residual downscaling. Three data sets acquired from IKONOS and Worldview-2 and 11 benchmark pansharpening algorithms were used to provide a comprehensive assessment of the proposed OATPRK approach. In both the synthetic and real experiments, OATPRK produced the most superior pan-sharpened results in terms of visual and quantitative assessment. OATPRK is a new conceptual method that advances the pixel-level geostatistical pansharpening approach to the object level and provides more accurate pan-sharpened MS images. IEE

Tracking small-scale tropical forest disturbances: Fusing the Landsat and Sentinel-2 data record

Information on forest disturbance is crucial for tropical forest management and global carbon cycle analysis. The long-term collection of data from the Landsat missions provides some of the most valuable information for understanding the processes of global tropical forest disturbance. However, there are substantial uncertainties in the estimation of non-mechanized, small-scale (i.e., small area) clearings in tropical forests with Landsat series images. Because the appearance of small-scale openings in a tropical tree canopy are often ephemeral due to fast-growing vegetation, and because clouds are frequent in tropical regions, it is challenging for Landsat images to capture the logging signal. Moreover, the spatial resolution of Landsat images is typically too coarse to represent spatial details about small-scale clearings. In this paper, by fusing all available Landsat and Sentinel-2 images, we proposed a method to improve the tracking of small-scale tropical forest disturbance history with both fine spatial and temporal resolutions. First, yearly composited Landsat and Sentinel-2 self-referenced normalized burn ratio (rNBR) vegetation index images were calculated from all available Landsat-7/8 and Sentinel-2 scenes during 2016–2019. Second, a deep-learning based downscaling method was used to predict fine resolution (10 m) rNBR images from the annual coarse resolution (30 m) Landsat rNBR images. Third, given the baseline Landsat forest map in 2015, the generated fine-resolution Landsat rNBR images and original Sentinel-2 rNBR images were fused to produce the 10 m forest disturbance map for the period 2016–2019. From data comparison and evaluation, it was demonstrated that the deep-learning based downscaling method can produce fine-resolution Landsat rNBR images and forest disturbance maps that contain substantial spatial detail. In addition, by fusing downscaled fine-resolution Landsat rNBR images and original Sentinel-2 rNBR images, it was possible to produce state-of-the-art forest disturbance maps with OA values more than 87% and 96% for the small and large study areas, and detected 11% to 21% more disturbed areas than either the Sentinel-2 or Landsat-7/8 time-series alone. We found that 1.42% of the disturbed areas indentified during 2016–2019 experienced multiple forest disturbances. The method has great potential to enhance work undertaken in relation to major policies such as the reducing emissions from deforestation and forest degradation (REDD+) programmes

Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references

Hypercomplex Quality Assessment of Multi/Hyperspectral Images

This letter presents a novel image quality index which extends the Universal Image Quality Index for monochrome images to multispectral and hyperspectral images through hypercomplex numbers. The proposed index is based on the computation of the hypercomplex correlation coefficient between the reference and tested images, which jointly measures spectral and spatial distortions. Experimental results, both from true and simulated images, are presented on spaceborne and airborne visible/infrared images. The results prove accurate measurements of inter- and intraband distortions even when anomalous pixel values are concentrated on few bands