Fusion of Landsat and Worldview Images

Pansharpened Landsat images have 15 m spatial resolution with 16-day revisit periods. On the other hand, Worldview images have 0.5 m resolution after pansharpening but the revisit times are uncertain. We present some preliminary results for a challenging image fusion problem that fuses Landsat and Worldview (WV) images to yield a high temporal resolution image sequence at the same spatial resolution of WV images. Since the spatial resolution between Landsat and Worldview is 30 to 1, our preliminary results are mixed in that the objective performance metrics such as peak signal-to-noise ratio (PSNR), correlation coefficient (CC), etc. sometimes showed good fusion performance, but at other times showed poor results. This indicates that more fusion research is still needed in this niche application

Mapping regional land cover and land use change using MODIS time series

Coarse resolution satellite observations of the Earth provide critical data in support of land cover and land use monitoring at regional to global scales. This dissertation focuses on methodology and dataset development that exploit multi-temporal data from the Moderate Resolution Imaging Spectroradiometer (MODIS) to improve current information related to regional forest cover change and urban extent. In the first element of this dissertation, I develop a novel distance metric-based change detection method to map annual forest cover change at 500m spatial resolution. Evaluations based on a global network of test sites and two regional case studies in Brazil and the United States demonstrate the efficiency and effectiveness of this methodology, where estimated changes in forest cover are comparable to reference data derived from higher spatial resolution data sources. In the second element of this dissertation, I develop methods to estimate fractional urban cover for temperate and tropical regions of China at 250m spatial resolution by fusing MODIS data with nighttime lights using the Random Forest regression algorithm. Assessment of results for 9 cities in Eastern, Central, and Southern China show good agreement between the estimated urban percentages from MODIS and reference urban percentages derived from higher resolution Landsat data. In the final element of this dissertation, I assess the capability of a new nighttime lights dataset from the Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) for urban mapping applications. This dataset provides higher spatial resolution and improved radiometric quality in nighttime lights observations relative to previous datasets. Analyses for a study area in the Yangtze River Delta in China show that this new source of data significantly improves representation of urban areas, and that fractional urban estimation based on DNB can be further improved by fusion with MODIS data. Overall, the research in this dissertation contributes new methods and understanding for remote sensing-based change detection methodologies. The results suggest that land cover change products from coarse spatial resolution sensors such as MODIS and VIIRS can benefit from regional optimization, and that urban extent mapping from nighttime lights should exploit complementary information from conventional visible and near infrared observations

Recent Advances in Image Restoration with Applications to Real World Problems

In the past few decades, imaging hardware has improved tremendously in terms of resolution, making widespread usage of images in many diverse applications on Earth and planetary missions. However, practical issues associated with image acquisition are still affecting image quality. Some of these issues such as blurring, measurement noise, mosaicing artifacts, low spatial or spectral resolution, etc. can seriously affect the accuracy of the aforementioned applications. This book intends to provide the reader with a glimpse of the latest developments and recent advances in image restoration, which includes image super-resolution, image fusion to enhance spatial, spectral resolution, and temporal resolutions, and the generation of synthetic images using deep learning techniques. Some practical applications are also included

A New Pansharpening Approach for Hyperspectral Images

We first briefly review recent papers for pansharpening of hyperspectral (HS) images. We then present a recent pansharpening approach called hybrid color mapping (HCM). A few variants of HCM are then summarized. Using two hyperspectral images, we illustrate the advantages of HCM by comparing HCM with 10 state-of-the-art algorithms

Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references

CubeSat constellations provide enhanced crop phenology and digital agricultural insights using daily leaf area index retrievals

Satellite remote sensing has great potential to deliver on the promise of a data-driven agricultural revolution, with emerging space-based platforms providing spatiotemporal insights into precisionlevel attributes such as crop water use, vegetation health and condition and crop response to management practices. Using a harmonized collection of high-resolution Planet CubeSat, Sentinel-2, Landsat-8 and additional coarser resolution imagery from MODIS and VIIRS, we exploit a multisatellite data fusion and machine learning approach to deliver a radiometrically calibrated and gap-filled time-series of daily leaf area index (LAI) at an unprecedented spatial resolution of 3 m. The insights available from such high-resolution CubeSat-based LAI data are demonstrated through tracking the growth cycle of a maize crop and identifying observable within-field spatial and temporal variations across key phenological stages. Daily LAI retrievals peaked at the tasseling stage, demonstrating their value for fertilizer and irrigation scheduling. An evaluation of satellite-based retrievals against field-measured LAI data collected from both rain-fed and irrigated fields shows high correlation and captures the spatiotemporal development of intra- and inter-field variations. Novel agricultural insights related to individual vegetative and reproductive growth stages were obtained, showcasing the capacity for new high-resolution CubeSat platforms to deliver actionable intelligence for precision agricultural and related applications

Spatiotemporal Fusion in Remote Sensing

Remote sensing images and techniques are powerful tools to investigate earth’s surface. Data quality is the key to enhance remote sensing applications and obtaining clear and noise-free set of data is very difficult in most situations due to the varying acquisition (e.g., atmosphere and season), sensor and platform (e.g., satellite angles and sensor characteristics) conditions. With the increasing development of satellites, nowadays Terabytes of remote sensing images can be acquired every day. Therefore, information and data fusion can be particularly important in the remote sensing community. The fusion integrates data from various sources acquired asynchronously for information extraction, analysis, and quality improvement. In this chapter, we aim to discuss the theory of spatiotemporal fusion by investigating previous works, in addition to describing the basic concepts and some of its applications by summarizing our prior and ongoing works

Remote Sensing of Environment: Current status of Landsat program, science, and applications

Formal planning and development of what became the first Landsat satellite commenced over 50 years ago in 1967. Now, having collected earth observation data for well over four decades since the 1972 launch of Landsat- 1, the Landsat program is increasingly complex and vibrant. Critical programmatic elements are ensuring the continuity of high quality measurements for scientific and operational investigations, including ground systems, acquisition planning, data archiving and management, and provision of analysis ready data products. Free and open access to archival and new imagery has resulted in a myriad of innovative applications and novel scientific insights. The planning of future compatible satellites in the Landsat series, which maintain continuity while incorporating technological advancements, has resulted in an increased operational use of Landsat data. Governments and international agencies, among others, can now build an expectation of Landsat data into a given operational data stream. International programs and conventions (e.g., deforestation monitoring, climate change mitigation) are empowered by access to systematically collected and calibrated data with expected future continuity further contributing to the existing multi-decadal record. The increased breadth and depth of Landsat science and applications have accelerated following the launch of Landsat-8, with significant improvements in data quality. Herein, we describe the programmatic developments and institutional context for the Landsat program and the unique ability of Landsat to meet the needs of national and international programs. We then present the key trends in Landsat science that underpin many of the recent scientific and application developments and followup with more detailed thematically organized summaries. The historical context offered by archival imagery combined with new imagery allows for the development of time series algorithms that can produce information on trends and dynamics. Landsat-8 has figured prominently in these recent developments, as has the improved understanding and calibration of historical data. Following the communication of the state of Landsat science, an outlook for future launches and envisioned programmatic developments are presented. Increased linkages between satellite programs are also made possible through an expectation of future mission continuity, such as developing a virtual constellation with Sentinel-2. Successful science and applications developments create a positive feedback loop—justifying and encouraging current and future programmatic support for Landsat