Adaptive multispectral GPU accelerated architecture for Earth Observation satellites

In recent years the growth in quantity, diversity and capability of Earth Observation (EO) satellites, has enabled increase’s in the achievable payload data dimensionality and volume. However, the lack of equivalent advancement in downlink technology has resulted in the development of an onboard data bottleneck. This bottleneck must be alleviated in order for EO satellites to continue to efficiently provide high quality and increasing quantities of payload data. This research explores the selection and implementation of state-of-the-art multidimensional image compression algorithms and proposes a new onboard data processing architecture, to help alleviate the bottleneck and increase the data throughput of the platform. The proposed new system is based upon a backplane architecture to provide scalability with different satellite platform sizes and varying mission’s objectives. The heterogeneous nature of the architecture allows benefits of both Field Programmable Gate Array (FPGA) and Graphical Processing Unit (GPU) hardware to be leveraged for maximised data processing throughput

Low-Complexity Hyperspectral Image Compression on a Multi-tiled Architecture

The increasing amount of data produced in satellites poses a downlink communication problem due to the limited data rate of the downlink. This bottleneck is solved by introducing more and more processing power on-board to compress data to a satisfiable rate. Currently, this processing power is often provided by custom off the shelf hardware which is needed to run the complex image compression standards. The increase in required processing power often increases the energy required to power the hardware. This in turn pushes algorithm developers to develop lower complexity algorithms which are able to compress the data for the least amount of processing per data element. On the other hand hardware developers are pushed to develop flexible hardware which can be used on multiple missions to cut development cost and can be re-used for different missions. This paper introduces an algorithm which has been developed\ud to compress hyperspectral images at low complexity and describes its mapping to a new hardware platform which has been developed to offer flexibility as well as high performance processing power called the Xentium tile processor

An Hardware Implementation of a Novel Algorithm For Onboard Compression of Multispectral and Hyperspectral Images

New multispectral and hyperspectral instruments are going to generate very high data rates due to the increased spatial and spectral resolution. In this context, the compression is a very important part of any onboard data processing system for Earth observation and astronomical missions. More recently, lossless compression has started to be routinely used for spaceborne Earth observation satellites. The CCSDS has established a working group (WG) on Multispectral and Hyperspectral Data Compression (MHDC), which has the purpose of standardizing compression techniques to be used onboard. The WG has already standardized a lossless compression algorithm for multispectral and hyperspectral images, and has started working on a lossy compression algorithm. Under an ESA contract, aimed to investigate new techniques for Lossy multi/hyperspectral compression for very high data rate instruments (HYDRA), TSD in collaboration with Politecnico of Torino, designed an IP core for FPGA and/or ASIC implementation of a lossy compression algorithm. In addition to the IP core, TSD developed a HW platform based on the Xilinx Virtex-5 XQR5VFX130, the industry's first high performance rad-hard reconfigurable FPGA for processing-intensive for space systems. Advanced results along with details of electronic platform design will be presented in this paper

Lossy Multi/Hyperspectral Compression HW Implementation at high data rate

Image compression is becoming more and more important, as new multispectral and hyperspectral instruments are going to generate very high data rates due to the increased spatial and spectral resolutions. Transmitting all the acquired data to the ground segment is a serious bottleneck, and compression techniques are a feasible solution to this problem. The CCSDS has established a working group (WG) on multispectral and Hyperspectral Data Compression (MHDC), which has the purpose of standardizing compression techniques to be used onboard. The WG has already standardized a lossless compression algorithm for multispectral and hyperspectral images, and has started working on a lossy compression algorithm. The complexity of lossless compression algorithms is typically larger than that of lossy ones, leading to potentially lower throughputs. Therefore, a careful assessment is required in order to identify techniques that are able to sustain very high data rates. The increased complexity can also lead to increased resource occupancy on a hardware device such as an FPGA. Lossy compression introduces information losses in the images, and these losses must be accurately characterized, and their effect on the applications investigated. For these reasons, developing a lossy algorithm requires a more elaborate process. Under an ESA contract primed by Politecnico of Torino, TSD is currently designing an IP core for FPGA and/or ASIC implementation of a lossy compression algorithm that is being proposed for CCSDS standardization. In addition to the IP core, TSD is developing a HW platform based on the Xilinx Virtex-5 XQR5VFX130, the industry's first high performance rad-hard reconfigurable FPGA for processing-intensive for space systems. Advanced results along with details of electronic platform design will be presented in this paper

Recent Advances in Embedded Computing, Intelligence and Applications

The latest proliferation of Internet of Things deployments and edge computing combined with artificial intelligence has led to new exciting application scenarios, where embedded digital devices are essential enablers. Moreover, new powerful and efficient devices are appearing to cope with workloads formerly reserved for the cloud, such as deep learning. These devices allow processing close to where data are generated, avoiding bottlenecks due to communication limitations. The efficient integration of hardware, software and artificial intelligence capabilities deployed in real sensing contexts empowers the edge intelligence paradigm, which will ultimately contribute to the fostering of the offloading processing functionalities to the edge. In this Special Issue, researchers have contributed nine peer-reviewed papers covering a wide range of topics in the area of edge intelligence. Among them are hardware-accelerated implementations of deep neural networks, IoT platforms for extreme edge computing, neuro-evolvable and neuromorphic machine learning, and embedded recommender systems

Metasurface-based Spectral Convolutional Neural Network for Matter Meta-imaging

Convolutional neural networks (CNNs) are representative models of artificial neural networks (ANNs), that form the backbone of modern computer vision. However, the considerable power consumption and limited computing speed of electrical computing platforms restrict further development of CNNs. Optical neural networks are considered the next-generation physical implementations of ANNs to break the bottleneck. This study proposes a spectral convolutional neural network (SCNN) with the function of matter meta-imaging, namely identifying the composition of matter and mapping its distribution in space. This SCNN includes an optical convolutional layer (OCL) and a reconfigurable electrical backend. The OCL is implemented by integrating very large-scale, pixel-aligned metasurfaces on a CMOS image sensor, which accepts 3D raw datacubes of natural images, containing two-spatial and one-spectral dimensions, at megapixels directly as input to realize the matter meta-imaging. This unique optoelectronic framework empowers in-sensor optical analog computing at extremely high energy efficiency eliminating the need for coherent light sources and greatly reducing the computing load of the electrical backend. We employed the SCNN framework on several real-world complex tasks. It achieved accuracies of 96.4% and 100% for pathological diagnosis and real-time face anti-spoofing at video rate, respectively. The SCNN framework, with an unprecedented new function of substance identification, provides a feasible optoelectronic and integrated optical CNN implementation for edge devices or cellphones with limited computing capabilities, facilitating diverse applications, such as intelligent robotics, industrial automation, medical diagnosis, and astronomy

EO-ALERT: A Novel Architecture for the Next Generation of Earth Observation Satellites Supporting Rapid Civil Alerts

Satellite Earth Observation (EO) data is ubiquitously used in many applications, providing basic services to society, such as environment monitoring, emergency management and civilian security. Due to the increasing request of EO products by the market, the classical EO data chain generates a severe bottleneck problem, further exacerbated in constellations. A huge amount of EO raw data generated on-board the satellite must be transferred to ground, slowing down the EO product availability, increasing latency, and hampering the growth of applications in accordance with the increased user demand. This paper provides an overview of the results achieved by the EO-ALERT project (http://eo-alert-h2020.eu/), an H2020 European Union research activity led by DEIMOS Space. EO-ALERT proposes the definition and development of the next-generation EO data processing chain, based on a novel flight segment architecture that moves optimised key EO data processing elements from the ground segment to on-board the satellite, with the aim of delivering the EO products to the end user with very low latency (quasi-real-time). EO-ALERT achieves, globally, latencies below five minutes for EO products delivery, reaching latencies below 1 minute in some scenarios. The proposed architecture solves the above challenges through a combination of innovations in the on-board elements of the data chain and the communications. Namely, the architecture introduces innovative technological solutions, including on-board reconfigurable data handling, on-board image generation and processing for the generation of alerts (EO products) using Artificial Intelligence (AI), on-board data compression and encryption using AI, high-speed on-board avionics, and reconfigurable high data rate communication links to ground, including a separate chain for alerts with minimum latency and global coverage. The paper presents the proposed architecture, its performance and hardware, considering two different user scenarios; ship detection and extreme weather observation/nowcasting. The results show that, when implemented using COTS components and available communication links, the proposed architecture can deliver alerts to ground with latency lower than five minutes, for both SAR and Optical missions, demonstrating the viability of the EOALERT concept and architecture. The paper also discusses the implementation on an avionics test bench for testing the architecture with real EO data, with the aim of demonstrating that it can meet the requirements of the considered scenarios in terms of detection performance and provides technologies at a high TRL (4-5). When proven, this will open unprecedented opportunities for the exploitation of civil EO products, especially in latency sensitive scenarios, such as disaster management

Low power compressive sensing for hyperspectral imagery

Hyperspectral imaging instruments allow remote Earth exploration by measuring hundreds of spectral bands at very narrow channels of a given spatial area. The resulting hyperspectral data cube typically comprises several gigabytes. Such extremely large volumes of data introduces problems in its transmission to Earth due to limited communication bandwidth. As a result, the applicability of data compression techniques to hyperspectral images have received increasing attention. This paper, presents a study of the power and time consumption of a parallel implementation for a spectral compressive acquisition method on a Jetson TX2 platform. The conducted experiments have been performed to demonstrate the applicability of these methods for onboard processing. The results show that by using this low energy consumption GPU and integer data type is it possible to obtain real-time performance with a very limited power requirement while maintaining the methods accuracy.info:eu-repo/semantics/publishedVersio