Computation of Earth Science Products on Spaceborne Platforms

Spaceborne sensors like NASA's Hyperion hyperspectral imager generate huge data volumes, and several near-term trends indicate that data volumes will only increase. Next-generation hyperspectral missions, such as NASA's Hyperspectral Infrared Imager (HyspIRI), will operate at higher duty cycles and higher data rates, and their users will expect products to be generated from the data in near real time [1]. Barring a sudden advance in satellite downlink capacity, these trends point to a need to process data and generate products onboard the spacecraft. Rather than downlink an entire hyperspectral image cube, onboard processing enables satellites to downlink partial or completed scientific data products, which are often one to two orders of magnitude smaller than the original image. In addition, a satellite with onboard data processing resources and direct broadcast transmission equipment could send data products directly to first responders, research scientists or other users on the ground. Next-generation space-capable data processors will have a combination of reconfigurable gate arrays, digital signal processors and general-purpose CPUs. Correctly programmed and configured, these resources are sufficient to run sophisticated data analysis programs, including hyperspectral image processing algorithms that commonly run on desktop computers [2]. This paper describes how we implemented one such program, the HSEG hierarchical image segmentation algorithm, software commonly used on desktop and parallel processors, on a hardware platform designed to mimic a next-generation space-capable data processor [3]. We also describe our approach to porting the algorithm to and optimizing it for the new platform, and determine the expected performance gains enabled by our design. This extended abstract will describe the HSEG algorithm and hardware platform in greater detail, provide an analysis of the key function within the algorithm that required hardware acceleration, and describe our implementation of that function in hardware

Machine Learning and Pattern Recognition Methods for Remote Sensing Image Registration and Fusion

In the last decade, the remote sensing world has dramatically evolved. New types of sensor, each one collecting data with possibly different modalities, have been designed, developed, and deployed. Moreover, new missions have been planned and launched, aimed not only at collecting data of the Earth's surface, but also at acquiring planetary data in support of the study of the whole Solar system. Indeed, such a variety of technologies highlights the need for automatic methods able to effectively exploit all the available information. In the last years, lot of effort has been put in the design and development of advanced data fusion methods able to extract and make use of all the information available from as many complementary information sources as possible. Indeed, the goal of this thesis is to present novel machine learning and pattern recognition methodologies designed to support the exploitation of diverse sources of information, such as multisensor, multimodal, or multiresolution imagery. In this context, image registration plays a major role as is allows bringing two or more digital images into precise alignment for analysis and comparison. Here, image registration is tackled using both feature-based and area-based strategies. In the former case, the features of interest are extracted using a stochastic geometry model based on marked point processes, while, in the latter case, information theoretic functionals and the domain adaptation capabilities of generative adversarial networks are exploited. In addition, multisensor image registration is also applied in a large scale scenario by introducing a tiling-based strategy aimed at minimizing the computational burden, which is usually heavy in the multisensor case due to the need for information theoretic similarity measures. Moreover, automatic change detection with multiresolution and multimodality imagery is addressed via a novel Markovian framework based on a linear mixture model and on an ad-hoc multimodal energy function minimized using graph cuts or belied propagation methods. The statistics of the data at the various spatial scales is modelled through appropriate generalized Gaussian distributions and by iteratively estimating a set of virtual images, at the finest resolution, representing the data that would have been collected in case all the sensors worked at that resolution. All such methodologies have been experimentally evaluated with respect to different datasets, and with particular focus on the trade-off between the achievable performances and the demands in terms of computational resources. Moreover, such methods are also compared with state-of-the-art solutions, and are analyzed in terms of future developments, giving insights to possible future lines of research in this field

NeQuick-G Performance Assessment for Space Applications

Other than traditional single-layer ionosphere models for global navigation satellite system (GNSS) receivers, the NeQuick-G model of Galileo provides a fully three-dimensional description of the electron density and obtains the ionospheric path delay by integration along the line of sight. While optimized for users on or near the surface of the earth, NeQuick-G can thus as well be used for ionospheric correction of single-frequency observations from spaceborne platforms. Based on slant and total electron content measurements obtained in the Swarm mission, the performance of NeQuick-G for users in low earth orbit is assessed for periods of high and low solar activity as well as different orientations of the orbital plane with respect to the sun and the region of high total electron content. A slant range correction performance of better than 70% is achieved in more than 85% of the examined epochs in good accord with the performance reported for terrestrial users. Likewise, the positioning errors can be notably reduced when applying the NeQuick-G corrections in single-frequency navigation solutions. For users at orbital altitudes, it is furthermore shown that vertical total electron predictions from NeQuick-G may be favorably combined with an elevation-dependent thick-layer mapping function to reduce the high computational effort associated with the integration of the electron density along the ray path for each tracked GNSS satellite

Adaptive guidance and control for future remote sensing systems

A unique approach to onboard processing was developed that is capable of acquiring high quality image data for users in near real time. The approach is divided into two steps: the development of an onboard cloud detection system; and the development of a landmark tracker. The results of these two developments are outlined and the requirements of an operational guidance and control system capable of providing continuous estimation of the sensor boresight position are summarized

Effects of Tunable Data Compression on Geophysical Products Retrieved from Surface Radar Observations with Applications to Spaceborne Meteorological Radars

This paper presents results and analyses of applying an international space data compression standard to weather radar measurements that can easily span 8 orders of magnitude and typically require a large storage capacity as well as significant bandwidth for transmission. By varying the degree of the data compression, we analyzed the non-linear response of models that relate measured radar reflectivity and/or Doppler spectra to the moments and properties of the particle size distribution characterizing clouds and precipitation. Preliminary results for the meteorologically important phenomena of clouds and light rain indicate that for a 0.5 dB calibration uncertainty, typical for the ground-based pulsed-Doppler 94 GHz (or 3.2 mm, W-band) weather radar used as a proxy for spaceborne radar in this study, a lossless compression ratio of only 1.2 is achievable. However, further analyses of the non-linear response of various models of rainfall rate, liquid water content and median volume diameter show that a lossy data compression ratio exceeding 15 is realizable. The exploratory analyses presented are relevant to future satellite missions, where the transmission bandwidth is premium and storage requirements of vast volumes of data, potentially problematic

SAR data compression: Application, requirements, and designs

The feasibility of reducing data volume and data rate is evaluated for the Earth Observing System (EOS) Synthetic Aperture Radar (SAR). All elements of data stream from the sensor downlink data stream to electronic delivery of browse data products are explored. The factors influencing design of a data compression system are analyzed, including the signal data characteristics, the image quality requirements, and the throughput requirements. The conclusion is that little or no reduction can be achieved in the raw signal data using traditional data compression techniques (e.g., vector quantization, adaptive discrete cosine transform) due to the induced phase errors in the output image. However, after image formation, a number of techniques are effective for data compression

Impact of day/night time land surface temperature in soil moisture disaggregation algorithms

Since its launch in 2009, the ESA’s SMOS mission is providing global soil moisture (SM) maps at ~40 km, using the first L-band microwave radiometer on space. Its spatial resolution meets the needs of global applications, but prevents the use of the data in regional or local applications, which require higher spatial resolutions (~1-10 km). SM disaggregation algorithms based generally on the land surface temperature (LST) and vegetation indices have been developed to bridge this gap. This study analyzes the SM-LST relationship at a variety of LST acquisition times and its influence on SM disaggregation algorithms. Two years of in situ and satellite data over the central part of the river Duero basin and the Iberian Peninsula are used. In situ results show a strong anticorrelation of SM to daily maximum LST (R˜-0.5 to -0.8). This is confirmed with SMOS SM and MODIS LST Terra/Aqua at day time-overpasses (R˜-0.4 to -0.7). Better statistics are obtained when using MODIS LST day (R˜0.55 to 0.85; ubRMSD˜0.04 to 0.06 m3 /m3 ) than LST night (R˜0.45 to 0.80; ubRMSD˜0.04 to 0.07 m3 /m3 ) in the SM disaggregation. An averaged ensemble of day and night MODIS LST Terra/Aqua disaggregated SM estimates also leads to robust statistics (R˜0.55 to 0.85; ubRMSD˜0.04 to 0.07 m3 /m3 ) with a coverage improvement of ~10-20 %.Peer ReviewedPostprint (published version

Altimetric system: Earth observing system. Volume 2h: Panel report

A rationale and recommendations for planning, implementing, and operating an altimetric system aboard the Earth observing system (Eos) spacecraft is provided. In keeping with the recommendations of the Eos Science and Mission Requirements Working Group, a complete altimetric system is defined that is capable of perpetuating the data set to be derived from TOPEX/Poseidon, enabling key scientific questions to be addressed. Since the scientific utility and technical maturity of spaceborne radar altimeters is well documented, the discussion is limited to highlighting those Eos-specific considerations that materially impact upon radar altimetric measurements

Review on Active and Passive Remote Sensing Techniques for Road Extraction

Digital maps of road networks are a vital part of digital cities and intelligent transportation. In this paper, we provide a comprehensive review on road extraction based on various remote sensing data sources, including high-resolution images, hyperspectral images, synthetic aperture radar images, and light detection and ranging. This review is divided into three parts. Part 1 provides an overview of the existing data acquisition techniques for road extraction, including data acquisition methods, typical sensors, application status, and prospects. Part 2 underlines the main road extraction methods based on four data sources. In this section, road extraction methods based on different data sources are described and analysed in detail. Part 3 presents the combined application of multisource data for road extraction. Evidently, different data acquisition techniques have unique advantages, and the combination of multiple sources can improve the accuracy of road extraction. The main aim of this review is to provide a comprehensive reference for research on existing road extraction technologies.Peer reviewe

Information sciences experiment system

The rapid expansion of remote sensing capability over the last two decades will take another major leap forward with the advent of the Earth Observing System (Eos). An approach is presented that will permit experiments and demonstrations in onboard information extraction. The approach is a non-intrusive, eavesdropping mode in which a small amount of spacecraft real estate is allocated to an onboard computation resource. How such an approach allows the evaluation of advanced technology in the space environment, advanced techniques in information extraction for both Earth science and information science studies, direct to user data products, and real-time response to events, all without affecting other on-board instrumentation is discussed