Accuracy Evaluation of Convolutional Neural Network Classification Algorithms for Building Identification in Rural and Urban Areas from Very High-Resolution Satellite Imagery in Jambi, Indonesia

Accurate land cover data are essential to a reliable decision-making process; therefore, researchers have turned to novel land cover classification algorithms employing machine learning on high-resolution satellite imagery to improve classification accuracy. The experiment presented in this paper aims to assess the accuracy performance of three patch-based, convolutional neural network architectures (LeNet, VGGNet, and XCeption) in classifying building footprints in rural and urban areas from satellite imagery data, with conventional, pixel-based classification algorithms as a benchmark. The experiment concluded that the CNN classification algorithms consistently outperformed pixel-based algorithms in the accuracy of the resulting building-footprint classification raster. It was also demonstrated that larger image patch size does not always improve classification accuracy in all CNN architectures. This study also revealed that the XCeption architecture performed best among the three CNN architectures assessed, with a 72-pixel patch size having the best accuracy

Deep learning for studying urban water bodies´ spatio-temporal transformation: a study of Chittagong City, Bangladesh

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesWater has been playing a key role in human life since the dawn of civilization. It is an integral part of our lives. In recent years, water bodies specially, urban water bodies are in a poor state due to climate change and rapid urban expansion. Though some cities have become aware of this poor state of water bodies, many cities around the world are not contemplating this issue. Because less research has been conducted on water bodies than other land covers in urban areas like built-up. Besides, many advanced algorithms are currently being utilized in different fields, but in terms of water body study, these advancements are still missing. That is why this study aims at investigating the spatio-temporal changes in urban water bodies in Chittagong city using deep learning and freely available Landsat data. Looking at the significance of the study, firstly, as this study has adopted two different deep learning (DL) models and evaluated the performance, the findings can help to understand the suitability of applying deep learning algorithms to extract information from mid to low resolution imagery like Landsat. Secondly, this work will help us to understand why the conservation of the existing water bodies is so important. Finally, this study will encourage further research in the field of deep learning and water bodies by opening the door for monitoring other environmental resources

Mapping Paddy Rice Using a Convolutional Neural Network (CNN) with Landsat 8 Datasets in the Dongting Lake Area, China

Rice is one of the world’s major staple foods, especially in China. Highly accurate monitoring on rice-producing land is, therefore, crucial for assessing food supplies and productivity. Recently, the deep-learning convolutional neural network (CNN) has achieved considerable success in remote-sensing data analysis. A CNN-based paddy-rice mapping method using the multitemporal Landsat 8, phenology data, and land-surface temperature (LST) was developed during this study. First, the spatial⁻temporal adaptive reflectance fusion model (STARFM) was used to blend the moderate-resolution imaging spectroradiometer (MODIS) and Landsat data for obtaining multitemporal Landsat-like data. Subsequently, the threshold method is applied to derive the phenological variables from the Landsat-like (Normalized difference vegetation index) NDVI time series. Then, a generalized single-channel algorithm was employed to derive LST from the Landsat 8. Finally, multitemporal Landsat 8 spectral images, combined with phenology and LST data, were employed to extract paddy-rice information using a patch-based deep-learning CNN algorithm. The results show that the proposed method achieved an overall accuracy of 97.06% and a Kappa coefficient of 0.91, which are 6.43% and 0.07 higher than that of the support vector machine method, and 7.68% and 0.09 higher than that of the random forest method, respectively. Moreover, the Landsat-derived rice area is strongly correlated (R2 = 0.9945) with government statistical data, demonstrating that the proposed method has potential in large-scale paddy-rice mapping using moderate spatial resolution images

Influence de la phénologie foliaire automnale de forêts tempérées sur la segmentation d’espèces d’arbres à partir d’imagerie de drone et d’apprentissage profond

La télédétection des forêts est devenue de plus en plus accessible grâce à l'utilisation de véhicules aériens inoccupés (UAV) et à l'apprentissage profond, ce qui permet d'obtenir des images répétées à haute résolution et d’observer les changements phénologiques à des échelles spatiales et temporelles plus importantes. Dans les forêts tempérées, à l'automne, la sénescence des feuilles se produit lorsque les feuilles changent de couleur et tombent. Cependant, l'influence de la sénescence foliaire sur la segmentation des espèces d'arbres à l'aide d'un réseau neuronal convolutif (CNN) n'a pas encore été évaluée. Nous avons acquis de l’imagerie haute résolution par UAV au-dessus d’une forêt tempérée au Québec à sept reprises entre mai et octobre 2021. Nous avons segmenté et identifié 23 000 couronnes d'arbres de 14 classes différentes pour entraîner et valider un CNN pour chaque acquisition d'imagerie. La meilleure segmentation (F1-score le plus élevé) était au début de la coloration des feuilles (début septembre) et le F1-score le plus bas au pic de la coloration automnale (début octobre). La chronologie de la sénescence varie considérablement d’une espèce à l’autre et au sein d’une même espèce, ce qui entraîne une grande variabilité du signal télédétecté. Les espèces d'arbres à feuilles caduques et à feuilles persistantes qui présentaient des traits distinctifs et moins variables dans le temps entre les individus ont été mieux classées. Bien que la segmentation des arbres dans une forêt hétérogène demeure un défi, l'imagerie UAV et l'apprentissage profond démontrent un grand potentiel pour la cartographie des espèces d'arbres. Les résultats obtenus dans une forêt tempérée où la couleur des feuilles change fortement pendant la sénescence automnale montrent que la meilleure performance pour la segmentation des espèces d'arbres se produit au début de ce changement de couleur.Remote sensing of forests has become increasingly accessible with the use of unoccupied aerial vehicles (UAV), along with deep learning, allowing for repeated high-resolution imagery and the capturing of phenological changes at larger spatial and temporal scales. In temperate forests during autumn, leaf senescence occurs when leaves change colour and drop. However, the influence of leaf senescence in temperate forests on tree species segmentation using a Convolutional Neural Network (CNN) has not yet been evaluated. Here, we acquired high-resolution UAV imagery over a temperate forest in Quebec, Canada on seven occasions between May and October 2021. We segmented and labelled 23,000 tree crowns from 14 different classes to train and validate a CNN for each imagery acquisition. The CNN-based segmentation showed the highest F1-score (0.72) at the start of leaf colouring in early September and the lowest F1-score (0.61) at peak fall colouring in early October. The timing of the events occurring during senescence, such as leaf colouring and leaf fall, varied substantially between and within species and according to environmental conditions, leading to higher variability in the remotely sensed signal. Deciduous and evergreen tree species that presented distinctive and less temporally-variable traits between individuals were better classified. While tree segmentation in a heterogenous forest remains challenging, UAV imagery and deep learning show high potential in mapping tree species. Our results from a temperate forest with strong leaf colour changes during autumn senescence show that the best performance for tree species segmentation occurs at the onset of this colour change

Mapping of multitemporal rice (Oryza sativa L.) growth stages using remote sensing with multi-sensor and machine learning : a thesis dissertation presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Earth Science at Massey University, Manawatū, New Zealand

Figure 2.1 is adapted and re-used under a Creative Commons Attribution 4.0 International (CC BY 4.0) license.Rice (Oryza Sativa) plays a pivotal role in food security for Asian countries, especially in Indonesia. Due to the increasing pressure of environmental changes, such as land use and climate, rice cultivation areas need to be monitored regularly and spatially to ensure sustainable rice production. Moreover, timely information of rice growth stages (RGS) can lead to more efficient of inputs distribution from water, seed, fertilizer, and pesticide. One of the efficient solutions for regularly mapping the rice crop is using Earth observation satellites. Moreover, the increasing availability of open access satellite images such as Landsat-8, Sentinel-1, and Sentinel-2 provides ample opportunities to map continuous and high-resolution rice growth stages with greater accuracy. The majority of the literature has focused on mapping rice area, cropping patterns and relied mainly on the phenology of vegetation. However, the mapping process of RGS was difficult to assess the accuracy, time-consuming, and depended on only one sensor. In this work, we discuss the use of machine learning algorithms (MLA) for mapping paddy RGS with multiple remote sensing data in near-real-time. The study area was Java Island, which is the primary rice producer in Indonesia. This study has investigated: (1) the mapping of RGS using Landsat-8 imagery and different MLAs, and their rigorous performance was evaluated by conducting a multitemporal analysis; (2) the temporal consistency of predicting RGS using Sentinel-2, MOD13Q1, and Sentinel-1 data; (3) evaluating the correlation of local statistics data and paddy RGS using Sentinel-2, PROBA-V, and Sentinel-1 with MLAs. The ground truth datasets were collected from multi-year web camera data (2014-2016) and three months of the field campaign in different regions of Java (2018). The study considered the RGS in the analysis to be vegetative, reproductive, ripening, bare land, and flooding, and MLAs such as support vector machines (SVMs), random forest (RF), and artificial neural network (ANN) were used. The temporal consistency matrix was used to compare the classification maps within three sensor datasets (Landsat-8 OLI, Sentinel-2, and Sentinel-2, MOD13Q1, Sentinel-1) and in four periods (5, 10, 15, 16 days). Moreover, the result of the RGS map was also compared with monthly data from local statistics within each sub-district using cross-correlation analysis. The result from the analysis shows that SVM with a radial base function outperformed the RF and ANN and proved to be a robust method for small-size datasets (< 1,000 points). Compared to Sentinel-2, Landsat-8 OLI gives less accuracy due to the lack of a red-edge band and larger pixel size (30 x 30 m). Integration of Sentinel-2, MOD13Q1, and Sentinel-1 improved the classification performance and increased the temporal availability of cloud-free maps. The integration of PROBA-V and Sentinel-1 improved the classification accuracy from the Landsat-8 result, consistent with the monthly rice planting area statistics at the sub-district level. The western area of Java has the highest accuracy and consistency since the cropping pattern only relied on rice cultivation. In contrast, less accuracy was noticed in the eastern area because of upland rice cultivation due to limited irrigation facilities and mixed cropping. In addition, the cultivation of shallots to the north of Nganjuk Regency interferes with the model predictions because the cultivation of shallots resembles the vegetative phase due to the water banks. One future research idea is the auto-detection of the cropping index in the complex landscape to be able to use it for mapping RGS on a global scale. Detection of the rice area and RGS using Google Earth Engine (GEE) can be an action plan to disseminate the information quickly on a planetary scale. Our results show that the multitemporal Sentinel-1 combined with RF can detect rice areas with high accuracy (>91%). Similarly, accurate RGS maps can be detected by integrating multiple remote sensing (Sentinel-2, Landsat-8 OLI, and MOD13Q1) data with acceptable accuracy (76.4%), with high temporal frequency and lower cloud interference (every 16 days). Overall, this study shows that remote sensing combined with the machine learning methodology can deliver information on RGS in a timely fashion, which is easy to scale up and consistent both in time and space and matches the local statistics. This thesis is also in line with the existing rice monitoring projects such as Crop Monitor, Crop Watch, AMIS, and Sen4Agri to support disseminating information over a large area. To sum up, the proposed workflow and detailed map provide a more accurate method and information in near real-time for stakeholders, such as governmental agencies against the existing mapping method. This method can be introduced to provide accurate information to rice farmers promptly with sufficient inputs such as irrigation, seeds, and fertilisers for ensuring national food security from the shifting planting time due to climate change

Artificial Neural Networks in Agriculture

Modern agriculture needs to have high production efficiency combined with a high quality of obtained products. This applies to both crop and livestock production. To meet these requirements, advanced methods of data analysis are more and more frequently used, including those derived from artificial intelligence methods. Artificial neural networks (ANNs) are one of the most popular tools of this kind. They are widely used in solving various classification and prediction tasks, for some time also in the broadly defined field of agriculture. They can form part of precision farming and decision support systems. Artificial neural networks can replace the classical methods of modelling many issues, and are one of the main alternatives to classical mathematical models. The spectrum of applications of artificial neural networks is very wide. For a long time now, researchers from all over the world have been using these tools to support agricultural production, making it more efficient and providing the highest-quality products possible