Semi-supervised Convolutional Neural Networks for Flood Mapping using Multi-modal Remote Sensing Data

When floods hit populated areas, quick detection of flooded areas is crucial for initial response by local government, residents, and volunteers. Space-borne polarimetric synthetic aperture radar (PolSAR) is an authoritative data sources for flood mapping since it can be acquired immediately after a disaster even at night time or cloudy weather. Conventionally, a lot of domain-specific heuristic knowledge has been applied for PolSAR flood mapping, but their performance still suffers from confusing pixels caused by irregular reflections of radar waves. Optical images are another data source that can be used to detect flooded areas due to their high spectral correlation with the open water surface. However, they are often affected by day, night, or severe weather conditions (i.e., cloud). This paper presents a convolution neural network (CNN) based multimodal approach utilizing the advantages of both PolSAR and optical images for flood mapping. First, reference training data is retrieved from optical images by manual annotation. Since clouds may appear in the optical image, only areas with a clear view of flooded or non-flooded are annotated. Then, a semisupervised polarimetric-features-aided CNN is utilized for flood mapping using PolSAR data. The proposed model not only can handle the issue of learning with incomplete ground truth but also can leverage a large portion of unlabelled pixels for learning. Moreover, our model takes the advantages of expert knowledge on scattering interpretation to incorporate polarimetric-features as the input. Experiments results are given for the flood event that occurred in Sendai, Japan, on 12th March 2011. The experiments show that our framework can map flooded area with high accuracy (F1 = 96:12) and outperform conventional flood mapping methods

Method for landslides detection with semi-automatic procedures: The case in the zone center-east of Cauca department, Colombia

Landslides are a common natural hazard that causes human casualties, but also infrastructure damage and land-use degradation. Therefore, a quantitative assessment of their presence is required by means of detecting and recognizing the potentially unstable areas. This research aims to develop a method supported on semiautomatic methods to detect potential mass movements at a regional scale. Five techniques were studied: Morphometry, SAR interferometry (InSAR), Persistent Scatterer InSAR (PS-InSAR), SAR polarimetry (PolSAR) and NDVI composites of Landsat 5, Landsat 7, and Landsat 8. The case study was chosen within the mid-eastern area of the Cauca state, which is characterised by its mountainous terrain and the presence of slope instabilities, officially registered in the CGS-SIMMA landslide inventory. This inventory revealed that the type `slide' occurred with 77.4% from the entire registries, `fall' with 16.5%, followed by `creeps' with 3%, flows with 2.6%, and `lateral spread' with 0.43%. As a result, we obtained the morphometric variables: slope, CONVI, TWI, landform, which were highly associated with landslides. The effect of a DEM in the processing flow of the InSAR method was similar for the InSAR coherence variable using the DEMs ASTER, PALSAR RTC, Topo-map, and SRTM. Then, a multiInSAR analysis gave displacement velocities in the LOS direction between -10 and 10 mm/year. With the dual-PolSAR analysis (Sentinel-1), VH and VV C-band polarised radar energy emitted median values of backscatters, for landslides, about of -14.5 dB for VH polarisation and -8.5 dB for VV polarisation. Also, L-band fully polarimetric NASA-UAVSAR data allowed to nd the mechanism of dispersion of CGS landslide inventory: 39% for surface scattering, 46.4% for volume dispersion, and 14.6% for double-bounce scattering. The optical remote sensing provided NDVI composites derived from Landsat series between 2012 and 2016, showing that NDVI values between 0.40 and 0.70 had a high correlation to landslides. In summary, we found the highest categories related to landslides by Weight of Evidence method (WofE) for each spaceborne technique applied. Finally, these results were merged to generate the landslide detection model by using the supervised machine learning method of Random Forest. By taking training and test samples, the precision of the detection model was of about 70% for the rotational and translational types.Los deslizamientos son una amenaza natural que causa pérdidas humanas, daños a la infraestructura y degradación del suelo. Una evaluación cuantitativa de su presencia se requiere mediante la detección y el reconocimiento de potenciales áreas inestables. Esta investigación tuvo como alcance desarrollar un método soportado en métodos semi-automáticos para detectar potenciales movimientos en masa a escala regional. Cinco técnicas fueron estudiadas: Morfometría, Interferometría radar, Interferometría con Persistent Scatterers, Polarimetría radar y composiciones del NDVI con los satélites Landsat 5, Landsat 7 y Landsat 8. El caso de estudio se seleccionó dentro de la región intermedia al este del departamento del Cauca, la cual se caracteriza por terreno montañoso y la presencia de inestabilidades de la pendiente oficialmente registrados en el servicio SIMMA del Servicio Geológico Colombiano. Este inventario reveló que el tipo de movimiento deslizamiento ocurrió con una frecuencia relativa de 77.4%, caidos con el 16.5% de los casos y reptaciones con 3%, flujos con 2.6% y propagación lateral con 0.43%. Como resultado, se obtuvo las variables morfométricas: pendiente, convergencia, índice topográfico de humedad y forma del terreno altamente asociados con los deslizamientos. El efecto de un DEM en el procesamiento del método InSAR fue similar para la variable coherencia usando los DEMs: ASTER, PAlSAR RTC, Topo-map y SRTM. Un análisis Multi-InSAR estimó velocidades de desplazamiento en dirección de vista del radar entre -10 y 10 mm/año. El análisis de polarimetría dual del Sentinel-1 arrojó valores de retrodispersión promedio de -14.5 dB en la banda VH y -8.5dB en la banda VV. Las cuatro polarimetrías del sensor aéreo UAVSAR permitió caracterizar el mecanismo de dispersión del Inventario de Deslizamiento así: 39% en el mecanismo de superficie, 46.4% en el mecanismo de volumen y 14.6% en el mecanismo de doble rebote. La información generada en el rango óptico permitió obtener composiciones de NDVI derivados de la plataforma Landsat entre los años 2012 y 2016, mostrando que el rango entre 0.4 y 0.7 tuvieron una alta asociación con los deslizamientos. En esta investigación se determinaron las categorías de las variables de Teledetección más altamente relacionadas con los movimientos en masa mediante el método de Pesos de Evidencias (WofE). Finalmente, estos resultados se fusionaron para generar el modelo de detección de deslizamientos usando el método supervisado de aprendizaje de máquina Random Forest. Tomando muestras aleatorias para entrenar y validar el modelo en una proporción 70:30, el modelo de detección, especialmente los movimientos de tipo rotacional y traslacional fueron clasificados con una tasa general de éxito del 70%.Ministerio de CienciasConvocatoria 647 de 2014Research line: Geotechnics and Geoenvironmental HazardDoctorad

Synthetic Aperture Radar (SAR) Meets Deep Learning

This reprint focuses on the application of the combination of synthetic aperture radars and depth learning technology. It aims to further promote the development of SAR image intelligent interpretation technology. A synthetic aperture radar (SAR) is an important active microwave imaging sensor, whose all-day and all-weather working capacity give it an important place in the remote sensing community. Since the United States launched the first SAR satellite, SAR has received much attention in the remote sensing community, e.g., in geological exploration, topographic mapping, disaster forecast, and traffic monitoring. It is valuable and meaningful, therefore, to study SAR-based remote sensing applications. In recent years, deep learning represented by convolution neural networks has promoted significant progress in the computer vision community, e.g., in face recognition, the driverless field and Internet of things (IoT). Deep learning can enable computational models with multiple processing layers to learn data representations with multiple-level abstractions. This can greatly improve the performance of various applications. This reprint provides a platform for researchers to handle the above significant challenges and present their innovative and cutting-edge research results when applying deep learning to SAR in various manuscript types, e.g., articles, letters, reviews and technical reports

Multi-source Remote Sensing for Forest Characterization and Monitoring

As a dominant terrestrial ecosystem of the Earth, forest environments play profound roles in ecology, biodiversity, resource utilization, and management, which highlights the significance of forest characterization and monitoring. Some forest parameters can help track climate change and quantify the global carbon cycle and therefore attract growing attention from various research communities. Compared with traditional in-situ methods with expensive and time-consuming field works involved, airborne and spaceborne remote sensors collect cost-efficient and consistent observations at global or regional scales and have been proven to be an effective way for forest monitoring. With the looming paradigm shift toward data-intensive science and the development of remote sensors, remote sensing data with higher resolution and diversity have been the mainstream in data analysis and processing. However, significant heterogeneities in the multi-source remote sensing data largely restrain its forest applications urging the research community to come up with effective synergistic strategies. The work presented in this thesis contributes to the field by exploring the potential of the Synthetic Aperture Radar (SAR), SAR Polarimetry (PolSAR), SAR Interferometry (InSAR), Polarimetric SAR Interferometry (PolInSAR), Light Detection and Ranging (LiDAR), and multispectral remote sensing in forest characterization and monitoring from three main aspects including forest height estimation, active fire detection, and burned area mapping. First, the forest height inversion is demonstrated using airborne L-band dual-baseline repeat-pass PolInSAR data based on modified versions of the Random Motion over Ground (RMoG) model, where the scattering attenuation and wind-derived random motion are described in conditions of homogeneous and heterogeneous volume layer, respectively. A boreal and a tropical forest test site are involved in the experiment to explore the flexibility of different models over different forest types and based on that, a leveraging strategy is proposed to boost the accuracy of forest height estimation. The accuracy of the model-based forest height inversion is limited by the discrepancy between the theoretical models and actual scenarios and exhibits a strong dependency on the system and scenario parameters. Hence, high vertical accuracy LiDAR samples are employed to assist the PolInSAR-based forest height estimation. This multi-source forest height estimation is reformulated as a pan-sharpening task aiming to generate forest heights with high spatial resolution and vertical accuracy based on the synergy of the sparse LiDAR-derived heights and the information embedded in the PolInSAR data. This process is realized by a specifically designed generative adversarial network (GAN) allowing high accuracy forest height estimation less limited by theoretical models and system parameters. Related experiments are carried out over a boreal and a tropical forest to validate the flexibility of the method. An automated active fire detection framework is proposed for the medium resolution multispectral remote sensing data. The basic part of this framework is a deep-learning-based semantic segmentation model specifically designed for active fire detection. A dataset is constructed with open-access Sentinel-2 imagery for the training and testing of the deep-learning model. The developed framework allows an automated Sentinel-2 data download, processing, and generation of the active fire detection results through time and location information provided by the user. Related performance is evaluated in terms of detection accuracy and processing efficiency. The last part of this thesis explored whether the coarse burned area products can be further improved through the synergy of multispectral, SAR, and InSAR features with higher spatial resolutions. A Siamese Self-Attention (SSA) classification is proposed for the multi-sensor burned area mapping and a multi-source dataset is constructed at the object level for the training and testing. Results are analyzed by different test sites, feature sources, and classification methods to assess the improvements achieved by the proposed method. All developed methods are validated with extensive processing of multi-source data acquired by Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR), Land, Vegetation, and Ice Sensor (LVIS), PolSARproSim+, Sentinel-1, and Sentinel-2. I hope these studies constitute a substantial contribution to the forest applications of multi-source remote sensing

A comprehensive review of fruit and vegetable classification techniques

Recent advancements in computer vision have enabled wide-ranging applications in every field of life. One such application area is fresh produce classification, but the classification of fruit and vegetable has proven to be a complex problem and needs to be further developed. Fruit and vegetable classification presents significant challenges due to interclass similarities and irregular intraclass characteristics. Selection of appropriate data acquisition sensors and feature representation approach is also crucial due to the huge diversity of the field. Fruit and vegetable classification methods have been developed for quality assessment and robotic harvesting but the current state-of-the-art has been developed for limited classes and small datasets. The problem is of a multi-dimensional nature and offers significantly hyperdimensional features, which is one of the major challenges with current machine learning approaches. Substantial research has been conducted for the design and analysis of classifiers for hyperdimensional features which require significant computational power to optimise with such features. In recent years numerous machine learning techniques for example, Support Vector Machine (SVM), K-Nearest Neighbour (KNN), Decision Trees, Artificial Neural Networks (ANN) and Convolutional Neural Networks (CNN) have been exploited with many different feature description methods for fruit and vegetable classification in many real-life applications. This paper presents a critical comparison of different state-of-the-art computer vision methods proposed by researchers for classifying fruit and vegetable

Remote sensing technology applications in forestry and REDD+

Advances in close-range and remote sensing technologies are driving innovations in forest resource assessments and monitoring on varying scales. Data acquired with airborne and spaceborne platforms provide high(er) spatial resolution, more frequent coverage, and more spectral information. Recent developments in ground-based sensors have advanced 3D measurements, low-cost permanent systems, and community-based monitoring of forests. The UNFCCC REDD+ mechanism has advanced the remote sensing community and the development of forest geospatial products that can be used by countries for the international reporting and national forest monitoring. However, an urgent need remains to better understand the options and limitations of remote and close-range sensing techniques in the field of forest degradation and forest change. Therefore, we invite scientists working on remote sensing technologies, close-range sensing, and field data to contribute to this Special Issue. Topics of interest include: (1) novel remote sensing applications that can meet the needs of forest resource information and REDD+ MRV, (2) case studies of applying remote sensing data for REDD+ MRV, (3) timeseries algorithms and methodologies for forest resource assessment on different spatial scales varying from the tree to the national level, and (4) novel close-range sensing applications that can support sustainable forestry and REDD+ MRV. We particularly welcome submissions on data fusion