The ESA ΦSat-2 Mission: An A.I Enhanced Multispectral CubeSat for Earth Observation

As part of an initiative to promote the development and implementation of innovative technologies on-board Earth Observation (EO) missions, the European Space Agency (ESA) kicked off the first Φsat related activities in 2018 with the aim of enhancing the already ongoing FSSCAT project with Artificial Intelligence (AI). The selected Φsat-2 concept will provide a combination of on-board processing capabilities (including AI) and a medium to high resolution multispectral instrument from Visible to Near Infra-Red (VIS/NIR) able to acquire 8 bands (7 + Panchromatic) provided by SIMERA SENSE Europe (BE). These resources will be made available to a series of dedicated applications that will run on-board the spacecraft. The mission prime is Open Cosmos (UK), supported by CGI (IT) to coordinate the payload operations for at least 12 months after LEOP and commissioning phase. During the nominal phase the various AI applications will be fine-tuned after the on-ground training and then routinely run. A series of AI applications that could be potentially embarked are under development. The first one is called SAT2MAP and is expected to autonomously detect streets from acquired images. It is developed by CGI (IT). The second AI application is an enhancement of the Φsat-1 cloud detection experiment, able to prioritize data to be downloaded to ground, based on standard cloud coverage and new concentration measurements. It is developed by KP Labs (PL) and it is based on a U-Ne. This application will mainly act as an on-board service for the other applications, relieving them of the task of assessing the presence of the clouds. The Autonomous Vessel Awareness application aims to detect and classify various vessel types in the maritime domain. This would enable a reduced amount of data to be downloaded (only image patches including the vessel) improving the response time for final users (e.g maritime authorities). In this case the AI technique used is a combination of Single Image Super resolution (SRCNN) and Yolo-based Convoluted Neural Network (CNN). The Deep Compression application generically reduces the amount of data to be downloaded to ground with limited information loss. The image is compressed on-board and then reconstructed on ground by means of a decoder. It can achieve a compression rate of about 7 per band. It is based on the use of a Convolutional Auto Encoder (CAE). Two more AI applications will be selected by ESA through a dedicated challenge open to institutions, Agencies and industries that will be run in the first half of 2023. The Φsat-2 mission successfully passed the CDR phase at the end of 2022 aiming for a launch in 2024

Artificial Intelligence Based On-Board Image Compression for the Φ-Sat-2 Mission

The growing amount of data collected by Earth Observation (EO) satellites requires new processing procedures able to manage huge quantity of information. Artificial intelligence (AI) and deep learning (DL) can provide advanced information also because of their ability to extract valuable information from complex data. Thanks to specific hardware platforms, these algorithms can be used also in space, opening the possibility for new procedures for intelligent data processing. The European Space Agency Φ-Sat-2 mission was designed with the purpose of demonstrating the benefits of using AI in space by running AI-based applications on-board a CubeSat. We present here the convolutional autoencoder-based algorithm developed for on-board lossy image compression of the Φ-Sat-2 mission and provide a first benchmark addressing a real space mission and a new image compression end-to-end architecture based on AI. Image compression is a crucial application that allows to save transmission bandwidth and storage. In fact, images acquired by the sensor can be compressed on-board and sent to the ground where they are reconstructed. DL algorithms have already been successfully applied for image compression however performance degradation may occur in the context of a representative on-board environment. Therefore, besides analyzing the results for the local hardware environment, this article investigates the performance variation for the on-board setting. An additional piece of innovation is the introduction of an applicative metric for the evaluation of the compression to assess the applicability of the reconstructed images for other tasks. Such metric completes those more traditional based on the original-reconstructed image similarity

Satellite Data Potentialities in Solid Waste Landfill Monitoring: Review and Case Studies

Remote sensing can represent an important instrument for monitoring landfills and their evolution over time. In general, remote sensing can offer a global and rapid view of the Earth’s surface. Thanks to a wide variety of heterogeneous sensors, it can provide high-level information, making it a useful technology for many applications. The main purpose of this paper is to provide a review of relevant methods based on remote sensing for landfill identification and monitoring. The methods found in the literature make use of measurements acquired from both multi-spectral and radar sensors and exploit vegetation indexes, land surface temperature, and backscatter information, either separately or in combination. Moreover, additional information can be provided by atmospheric sounders able to detect gas emissions (e.g., methane) and hyperspectral sensors. In order to provide a comprehensive overview of the full potential of Earth observation data for landfill monitoring, this article also provides applications of the main procedures presented to selected test sites. These applications highlight the potentialities of satellite-borne sensors for improving the detection and delimitation of landfills and enhancing the evaluation of waste disposal effects on environmental health. The results revealed that a single-sensor-based analysis can provide significant information on the landfill evolution. However, a data fusion approach that incorporates data acquired from heterogeneous sensors, including visible/near infrared, thermal infrared, and synthetic aperture radar (SAR), can result in a more effective instrument to fully support the monitoring of landfills and their effect on the surrounding area. In particular, the results show that a synergistic use of multispectral indexes, land surface temperature, and the backscatter coefficient retrieved from SAR sensors can improve the sensitivity to changes in the spatial geometry of the considered site