Cloud Masking for Remotely Sensed Data Using Spectral and Principal Components Analysis

Two methods of cloud masking tuned to tropical conditions have been developed, based on spectral analysis and Principal Components Analysis (PCA) of Moderate Resolution Imaging Spectroradiometer (MODIS) data. In the spectral approach, thresholds were applied to four reflective bands (1, 2, 3, and 4), three thermal bands (29, 31 and 32), the band 2/band 1 ratio, and the difference between band 29 and 31 in order to detect clouds. The PCA approach applied a threshold to the first principal component derived from the seven quantities used for spectral analysis. Cloud detections were compared with the standard MODIS cloud mask, and their accuracy was assessed using reference images and geographical information on the study area

A Localised Cloud Detection and Masking Method Using Spectral Analysis

In satellite remote sensing, cloud blocks surface or near surface information. The aim of this study is to investigate the spectral properties of cloud and to carry out cloud detection and masking over Malaysia based on spectral analysis. A cloud detection and masking method tuned to tropical conditions have been developed based on spectral of MODIS (Moderate Resolution Imaging Spectroradiometer) data. Thresholds were applied to three sets of spectral measurements, i.e. reflective bands, thermal bands and brightness temperature difference of thermal bands. The results show that the method was able to detect clouds over Malaysia effectively

Development of cloud removal and land cover Change extraction algorithms for remotely-sensed Landsat imagery

Land cover change monitoring requires the analysis of remotely-sensed data. In the tropics this is difficult because of persistent cloud cover, and data availability. This research focuses on the elimination of cloud cover as an important step towards addressing the issue of change detection. The result produced clearer images, whereas some persistent cloud remains. This persistent cloud and the cloud adjacency effects diminish the quality of image product and affect the change detection quality

Transfer Learning of Deep Learning Models for Cloud Masking in Optical Satellite Images

Los satélites de observación de la Tierra proporcionan una oportunidad sin precedentes para monitorizar nuestro planeta a alta resolución tanto espacial como temporal. Sin embargo, para procesar toda esta cantidad creciente de datos, necesitamos desarrollar modelos rápidos y precisos adaptados a las características específicas de los datos de cada sensor. Para los sensores ópticos, detectar las nubes en la imagen es un primer paso inevitable en la mayoría de aplicaciones tanto terrestres como oceánicas. Aunque detectar nubes brillantes y opacas es relativamente fácil, identificar automáticamente nubes delgadas semitransparentes o diferenciar nubes de nieve o superficies brillantes es mucho más difícil. Además, en el escenario actual, donde el número de sensores en el espacio crece constantemente, desarrollar metodologías para transferir modelos que funcionen con datos de nuevos satélites es una necesidad urgente. Por tanto, los objetivos de esta tesis son desarrollar modelos precisos de detección de nubes que exploten las diferentes propiedades de las imágenes de satélite y desarrollar metodologías para transferir esos modelos a otros sensores. La tesis está basada en cuatro trabajos los cuales proponen soluciones a estos problemas. En la primera contribución, "Multitemporal cloud masking in the Google Earth Engine", implementamos un modelo de detección de nubes multitemporal que se ejecuta en la plataforma Google Earth Engine y que supera los modelos operativos de Landsat-8. La segunda contribución, "Transferring deep learning models for Cloud Detection between Landsat-8 and Proba-V", es un caso de estudio de transferencia de un algoritmo de detección de nubes basado en aprendizaje profundo de Landsat-8 (resolución 30m, 12 bandas espectrales y muy buena calidad radiométrica) a Proba-V, que tiene una resolución de 333m, solo cuatro bandas y una calidad radiométrica peor. El tercer artículo, "Cross sensor adversarial domain adaptation of Landsat-8 and Proba-V images for cloud detection", propone aprender una transformación de adaptación de dominios que haga que las imágenes de Proba-V se parezcan a las tomadas por Landsat-8 con el objetivo de transferir productos diseñados con datos de Landsat-8 a Proba-V. Finalmente, la cuarta contribución, "Towards global flood mapping onboard low cost satellites with machine learning", aborda simultáneamente la detección de inundaciones y nubes con un único modelo de aprendizaje profundo, implementado para que pueda ejecutarse a bordo de un CubeSat (ϕSat-I) con un chip acelerador de aplicaciones de inteligencia artificial. El modelo está entrenado en imágenes Sentinel-2 y demostramos cómo transferir este modelo a la cámara del ϕSat-I. Este modelo se lanzó en junio de 2021 a bordo de la misión WildRide de D-Orbit para probar su funcionamiento en el espacio.Remote sensing sensors onboard Earth observation satellites provide a great opportunity to monitor our planet at high spatial and temporal resolutions. Nevertheless, to process all this ever-growing amount of data, we need to develop fast and accurate models adapted to the specific characteristics of the data acquired by each sensor. For optical sensors, detecting the clouds present in the image is an unavoidable first step for most of the land and ocean applications. Although detecting bright and opaque clouds is relatively easy, automatically identifying thin semi-transparent clouds or distinguishing clouds from snow or bright surfaces is much more challenging. In addition, in the current scenario where the number of sensors in orbit is constantly growing, developing methodologies to transfer models across different satellite data is a pressing need. Henceforth, the overreaching goal of this Thesis is to develop accurate cloud detection models that exploit the different properties of the satellite images, and to develop methodologies to transfer those models across different sensors. The four contributions of this Thesis are stepping stones in that direction. In the first contribution,"Multitemporal cloud masking in the Google Earth Engine", we implemented a lightweight multitemporal cloud detection model that runs on the Google Earth Engine platform and which outperforms the operational models for Landsat-8. The second contribution, "Transferring deep learning models for Cloud Detection between Landsat-8 and Proba-V", is a case-study of transferring a deep learning based cloud detection algorithm from Landsat-8 (30m resolution, 12 spectral bands and very good radiometric quality) to Proba-V, which has a lower{333m resolution, only four bands and a less accurate radiometric quality. The third paper, "Cross sensor adversarial domain adaptation of Landsat-8 and Proba-V images for cloud detection", proposes a learning-based domain adaptation transformation of Proba-V images to resemble those taken by Landsat-8, with the objective of transferring products designed on Landsat-8 to Proba-V. Finally, the fourth contribution, "Towards global flood mapping onboard low cost satellites with machine learning", tackles simultaneously cloud and flood water detection with a single deep learning model, which was implemented to run onboard a CubeSat (ϕSat-I) with an AI accelerator chip. In this case, the model is trained on Sentinel-2 and transferred to theϕSat-I camera. This model was launched in June 2021 onboard the Wild Ride D-Orbit mission in order to test its performance in space

Atmospheric effects on land classification using satellites and their correction.

Haze occurs almost every year in Malaysia and is caused by smoke which originates from forest fire in Indonesia. It causes visibility to drop, therefore affecting the data acquired for this area using optical sensor such as that on board Landsat - the remote sensing satellite that have provided the longest continuous record of Earth's surface. The work presented in this thesis is meant to develop a better understanding of atmospheric effects on land classification using satellite data and method of removing them. To do so, the two main atmospheric effects dealt with here are cloud and haze. Detection of cloud and its shadow are carried out using MODIS algorithms due to allowing optimal use of its rich bands. The analysis is applied to Landsat data, in which shows a high agreement with other methods. The thesis then concerns on determining the most suitable classification scheme to be used. Maximum Likelihood (ML) is found to be a preferable classification scheme due to its simplicity, objectivity and ability to classify land covers with acceptable accuracy. The effects of haze are subsequently modelled and simulated as a summation of a weighted signal component and a weighted pure haze component. By doing so, the spectral and statistical properties of the land classes can be systematically investigated, in which showing that haze modifies the class spectral signatures, consequently causing the classification accuracy to decline. Based on the haze model, a method of removing haze from satellite data was developed and tested using both simulated and real datasets. The results show that the removal method is able clean up haze and improve classification accuracy, yet a highly non-uniform haze may hamper its performance