Remote sensing image fusion on 3D scenarios: A review of applications for agriculture and forestry

Three-dimensional (3D) image mapping of real-world scenarios has a great potential to provide the user with a more accurate scene understanding. This will enable, among others, unsupervised automatic sampling of meaningful material classes from the target area for adaptive semi-supervised deep learning techniques. This path is already being taken by the recent and fast-developing research in computational fields, however, some issues related to computationally expensive processes in the integration of multi-source sensing data remain. Recent studies focused on Earth observation and characterization are enhanced by the proliferation of Unmanned Aerial Vehicles (UAV) and sensors able to capture massive datasets with a high spatial resolution. In this scope, many approaches have been presented for 3D modeling, remote sensing, image processing and mapping, and multi-source data fusion. This survey aims to present a summary of previous work according to the most relevant contributions for the reconstruction and analysis of 3D models of real scenarios using multispectral, thermal and hyperspectral imagery. Surveyed applications are focused on agriculture and forestry since these fields concentrate most applications and are widely studied. Many challenges are currently being overcome by recent methods based on the reconstruction of multi-sensorial 3D scenarios. In parallel, the processing of large image datasets has recently been accelerated by General-Purpose Graphics Processing Unit (GPGPU) approaches that are also summarized in this work. Finally, as a conclusion, some open issues and future research directions are presented.European Commission 1381202-GEU PYC20-RE-005-UJA IEG-2021Junta de Andalucia 1381202-GEU PYC20-RE-005-UJA IEG-2021Instituto de Estudios GiennesesEuropean CommissionSpanish Government UIDB/04033/2020DATI-Digital Agriculture TechnologiesPortuguese Foundation for Science and Technology 1381202-GEU FPU19/0010

Creating 3D city models from satellite imagery for integrated assessment and forecasting of solar energy

Buildings are the most prominent component in the urban environment. The geometric identification of urban buildings plays an important role in a range of urban applications, including 3D representations of buildings, energy consumption analysis, sustainable development, urban planning, risk assessment, and change detection. In particular, 3D building models can provide a comprehensive assessment of surfaces exposed to solar radiation. However, the identification of the available surfaces on urban structures and the actual locations which receive a sufficient amount of sunlight to increase installed power capacity (e.g. Photovoltaic systems) are crucial considerations for solar energy supply efficiency. Although considerable research has been devoted to detecting the rooftops of buildings, less attention has been paid to creating and completing 3D models of urban buildings. Therefore, there is a need to increase our understanding of the solar energy potential of the surfaces of building envelopes so we can formulate future adaptive energy policies for improving the sustainability of cities. The goal of this thesis was to develop a new approach to automatically model existing buildings for the exploitation of solar energy potential within an urban environment. By investigating building footprints and heights based on shadow information derived from satellite images, 3D city models were generated. Footprints were detected using a two level segmentation process: (1) the iterative graph cuts approach for determining building regions and (2) the active contour method and the adjusted-geometry parameters method for modifying the edges and shapes of the extracted building footprints. Building heights were estimated based on the simulation of artificial shadow regions using identified building footprints and solar information in the image metadata at pre-defined height increments. The difference between the actual and simulated shadow regions at every height increment was computed using the Jaccard similarity coefficient. The 3D models at the first level of detail were then obtained by extruding the building footprints based on their heights by creating image voxels and using the marching cube approach. In conclusion, 3D models of buildings can be generated solely from 2D data of the buildings’attributes in any selected urban area. The approach outperforms the past attempts, and mean error is reduced by at least 21%. Qualitative evaluations of the study illustrate that it is possible to achieve 3D building models based on satellite images with a mean error of less than 5 m. This comprehensive study allows for 3D city models to be generated in the absence of elevation attributes and additional data. Experiments revealed that this novel, automated method can be useful in a number of spatial analyses and urban sustainability applications

Lidar-based Obstacle Detection and Recognition for Autonomous Agricultural Vehicles

Today, agricultural vehicles are available that can drive autonomously and follow exact route plans more precisely than human operators. Combined with advancements in precision agriculture, autonomous agricultural robots can reduce manual labor, improve workflow, and optimize yield. However, as of today, human operators are still required for monitoring the environment and acting upon potential obstacles in front of the vehicle. To eliminate this need, safety must be ensured by accurate and reliable obstacle detection and avoidance systems.In this thesis, lidar-based obstacle detection and recognition in agricultural environments has been investigated. A rotating multi-beam lidar generating 3D point clouds was used for point-wise classification of agricultural scenes, while multi-modal fusion with cameras and radar was used to increase performance and robustness. Two research perception platforms were presented and used for data acquisition. The proposed methods were all evaluated on recorded datasets that represented a wide range of realistic agricultural environments and included both static and dynamic obstacles.For 3D point cloud classification, two methods were proposed for handling density variations during feature extraction. One method outperformed a frequently used generic 3D feature descriptor, whereas the other method showed promising preliminary results using deep learning on 2D range images. For multi-modal fusion, four methods were proposed for combining lidar with color camera, thermal camera, and radar. Gradual improvements in classification accuracy were seen, as spatial, temporal, and multi-modal relationships were introduced in the models. Finally, occupancy grid mapping was used to fuse and map detections globally, and runtime obstacle detection was applied on mapped detections along the vehicle path, thus simulating an actual traversal.The proposed methods serve as a first step towards full autonomy for agricultural vehicles. The study has thus shown that recent advancements in autonomous driving can be transferred to the agricultural domain, when accurate distinctions are made between obstacles and processable vegetation. Future research in the domain has further been facilitated with the release of the multi-modal obstacle dataset, FieldSAFE

Tree species identification in an urban environment using a data fusion approach

This thesis explores a data fusion approach combining hyperspectral, LiDAR, and multispectral data to classify tree species in an urban environment. The study area is the campus of the University of Northern Iowa. In order to use the data fusion approach, a wide variety of data was incorporated into the classification. These data include: a four-band Quickbird image from April 2003 with 0.6m spatial resolution, a 24-band AISA hyperspectral image from July 2004 with 2m spatial resolution, a 63-band AISA Eagle hyperspectral image from October 2006 with lm spatial resolution, a high resolution, multiple return LiDAR data set from April 2006 with sub-meter posting density, spectrometer data gathered in the field, and a database containing the location and type of every tree in the study area. The elevation data provided by the LiDAR was fused with the imagery in eCognition Professional. The LiDAR data was used to refine class rules by defining trees as objects with elevation greater than 3 meters. Classes included honey locust, white pine, crab apple, sugar maple, white spruce, American basswood, pin oak and ash. Results indicate fusing LiDAR data with these imageries showed an increase in overall classification accuracy for all datasets. Overall classification accuracy with the October 2006 hyperspectral data and LiDAR was 93%. Increases in overall accuracy ranged from 12 to 24% over classifications based on spectral imagery alone. Further, in this study, hyperspectral data with higher spatial resolution provided increased classification accuracy. The limitations of the study included a LiDAR data set that was acquired slightly before the leaves had matured. This affected the shape and extent of these trees based on their LiDAR returns. The July 2004 hyperspectral data set was difficult to georectify with its 2m resolution. This may have resulted in some minor issues of alignment between the LiDAR and the July 2004 hyperspectral data. Future directions of the study include developing a classification scheme using a Classification And Regression Tree, utilizing all of the LiDAR returns in a classification instead of just the first and fourth returns, and examining an additional LiDAR-derived data set with estimated tree locations

Analyzing the Adoption, Cropping Rotation, and Impact of Winter Cover Crops in the Mississippi Alluvial Plain (MAP) Region through Remote Sensing Technologies

This dissertation explores the application of remote sensing technologies in conservation agriculture, specifically focusing on identifying and mapping winter cover crops and assessing voluntary cover crop adoption and cropping patterns in the Arkansas portion of the Mississippi Alluvial Plain (MAP). In the first chapter, a systematic review using the PRISMA methodology examines the last 30 years of thematic research, development, and trends in remote sensing applied to conservation agriculture from a global perspective. The review uncovers a growing interest in remote sensing-based research in conservation agriculture and emphasizes the necessity for further studies dedicated to conservation practices. Among the 68 articles examined, 94% of studies utilized a pixel-based classification method, while only 6% employed an object-based approach. The analysis also revealed a thematic shift over time, with tillage practices being extensively studied before 2005, followed by a focus on crop residue from 2004 to 2012. From 2012 to 2020, there was a renewed emphasis on cover crops research. These findings highlight the evolving research landscape and provide insights into the trends within remote sensing-based conservation agriculture studies. The second chapter presents a methodological framework for identifying and mapping winter cover crops. The framework utilizes the Google Earth Engine (GEE) and a Random Forest (RF) classifier with time series data from Landsat 8 satellite. Results demonstrate a high classification accuracy (97.7%) and a significant increase (34%) in model-predicted cover crop adoption over the study period between 2013 and 2019. Additionally, the study showcases the use of multi-year datasets to efficiently map the growing season\u27s length and cover crops\u27 phenological characteristics. The third chapter assesses the voluntary adoption of winter cover crops and cropping patterns in the MAP region. Remote sensing technologies, USDA-NRCS government cover crop data sources, and the USDA Cropland Data Layer (CDL) are employed to identify cover crop locations, analyze county-wide voluntary adoption, and cropping rotations. The result showed a 5.33% increase in the overall voluntary adoption of cover crops in the study region between 2013 and 2019. The findings also indicate a growing trend in cover crop adoption, with soybean-cover crop rotations being prominent. This dissertation enhances our understanding of the role of remote sensing in conservation agriculture with a particular focus on winter cover crops. These insights are valuable for policymakers, stakeholders, and researchers seeking to promote sustainable agricultural practices and increased cover crop adoption. The study also underscores the significance of integrating remote sensing technologies into agricultural decision-making processes and highlights the importance of collaboration among policymakers, researchers, and producers. By leveraging the capabilities of remote sensing, it will enhance conservation agriculture contribution to long-term environmental sustainability and agricultural resilience. Keywords: Remote sensing technologies, Conservation agriculture, Winter cover crops, Voluntary adoption, Cropping patterns, Sustainable agricultural practice

Analyzing the Adoption, Cropping Rotation, and Impact of Winter Cover Crops in the Mississippi Alluvial Plain (MAP) Region through Remote Sensing Technologies

This dissertation explores the application of remote sensing technologies in conservation agriculture, specifically focusing on identifying and mapping winter cover crops and assessing voluntary cover crop adoption and cropping patterns in the Arkansas portion of the Mississippi Alluvial Plain (MAP). In the first chapter, a systematic review using the PRISMA methodology examines the last 30 years of thematic research, development, and trends in remote sensing applied to conservation agriculture from a global perspective. The review uncovers a growing interest in remote sensing-based research in conservation agriculture and emphasizes the necessity for further studies dedicated to conservation practices. Among the 68 articles examined, 94% of studies utilized a pixel-based classification method, while only 6% employed an object-based approach. The analysis also revealed a thematic shift over time, with tillage practices being extensively studied before 2005, followed by a focus on crop residue from 2004 to 2012. From 2012 to 2020, there was a renewed emphasis on cover crops research. These findings highlight the evolving research landscape and provide insights into the trends within remote sensing-based conservation agriculture studies. The second chapter presents a methodological framework for identifying and mapping winter cover crops. The framework utilizes the Google Earth Engine (GEE) and a Random Forest (RF) classifier with time series data from Landsat 8 satellite. Results demonstrate a high classification accuracy (97.7%) and a significant increase (34%) in model-predicted cover crop adoption over the study period between 2013 and 2019. Additionally, the study showcases the use of multi-year datasets to efficiently map the growing season\u27s length and cover crops\u27 phenological characteristics. The third chapter assesses the voluntary adoption of winter cover crops and cropping patterns in the MAP region. Remote sensing technologies, USDA-NRCS government cover crop data sources, and the USDA Cropland Data Layer (CDL) are employed to identify cover crop locations, analyze county-wide voluntary adoption, and cropping rotations. The result showed a 5.33% increase in the overall voluntary adoption of cover crops in the study region between 2013 and 2019. The findings also indicate a growing trend in cover crop adoption, with soybean-cover crop rotations being prominent. This dissertation enhances our understanding of the role of remote sensing in conservation agriculture with a particular focus on winter cover crops. These insights are valuable for policymakers, stakeholders, and researchers seeking to promote sustainable agricultural practices and increased cover crop adoption. The study also underscores the significance of integrating remote sensing technologies into agricultural decision-making processes and highlights the importance of collaboration among policymakers, researchers, and producers. By leveraging the capabilities of remote sensing, it will enhance conservation agriculture contribution to long-term environmental sustainability and agricultural resilience. Keywords: Remote sensing technologies, Conservation agriculture, Winter cover crops, Voluntary adoption, Cropping patterns, Sustainable agricultural practice

A remote sensing approach to the quantification of local to global scale social-ecological impacts of anthropogenic landscape changes

A thesis submitted in partial fulfillment of the requirements for the degree of Doctor in Information Management, specialization in Geographic Information SystemsLanduse and Landcover (LULC) is the common aspect that influences several ecological issues, environmental degradations, changes in Land Surface Temperature (LST), hydrological changes and ecosystem function at regional to global level. Research on the drivers and progressions of LULC change has been key to developing models that can project and predict future LULC extent, level and patterns under different assumptions of socioeconomic, ecological and environmental situations. Rapid and extensive urbanization and Urban Sprawl (US), propelled by rapid population growth leads to the shrinkage of productive agricultural lands, boosting mining, decrease in surface permeability and the emergence of Urban Heat Islands (UHI), and in turn, adversely affects the provision of ecosystem services. Mining for resources extraction may lead to geological and associated environmental changes due to ground movements, collision with mining cavities, and deformation of aquifers. Geological changes may continue in a reclaimed mine area, and the deformed aquifers may entail a breakdown of substrates and an increase in ground water tables, which may cause surface area inundation. Consequently, a reclaimed mine area may experience surface area collapse, i.e., subsidence, and degradation of vegetation productivity. The greater changes in LULC, US, LST and vegetation dynamics due to increasing human population not only affects inland forest and wetland, it also directly influences coastal forest lands such as mangroves, peat swamps and riparian forest and threats to ecosystem services. Mangroves provide valuable provisioning (e.g. aquaculture, fisheries, fuel, medicine, textiles), regulation (e.g. shoreline protection, erosion control, climate regulation), supporting (nutrient cycling, nursery habitat), and cultural (recreation and tourism) ecosystem services with an important impact on human well-being. However, the mangrove forest is highly threatened due to climate changes, and human activities which ignore the ecological and economic value of these habitats, contributing to its degradation. There is an increasing number of studies about mangrove distribution, changes and re-establishment activities, denoting a growing attentiveness on the value of these coastal wetland ecosystems. Most of these studies address mangrove degradation drivers at regional or local levels. However, there has not been yet enough assessment on the drivers of mangrove degradation at global level. Thus, complexity of inland and coastal landscape degradation should be addressed using multidisciplinary methodology and conditions. Therefore, this dissertation aimed to assess the impact of LULC associated with vegetation, temperature and wetland changes. To understand the relation among three different types of landscape changes associated with anthropogenic activities: Urbanization, Geological changes and Forest degradation at local to global level, we have selected thirty-three global regions. In chapter 2, We employed the Random Forest (RF) classification on Landsat imageries from 1991, 2003, and 2016, and computed six landscape metrics to delineate the extent of urban areas within a 10km suburban buffer of Chennai city, Tamilnadu, India. The level of US was then quantified using Renyi’s entropy. A land change model was subsequently used to project land cover for 2027. A 70.35% expansion in urban areas was observed mainly towards the suburban periphery of Chennai between 1991 and 2016. The Renyi’s entropy value for year 2016 was 0.9, exhibiting a two-fold level of US when compared to 1991. The spatial metrics values indicate that the existing urban areas became denser and the suburban agricultural, forests and particularly barren lands were transformed into fragmented urban settlements. The forecasted land cover for 2027 indicates a conversion of 13,670.33 ha (16.57% of the total landscape) of existing forests and agricultural lands into urban areas with an associated increase in the entropy value to 1.7, indicating a tremendous level of US. Our study provides useful metrics for urban planning authorities to address the social-ecological consequences of US and to protect ecosystem services. In chapter 3, We studied landscape dynamics in Kirchheller Heide, Germany, which experienced extensive soil movement due to longwall mining without stowing, using Landsat imageries between 2013 and 2016. A Random Forest image classification technique was applied to analyse landuse and landcover dynamics, and the growth of wetland areas was assessed using a Spectral Mixture Analysis (SMA). We also analyzed the changes in vegetation productivity using a Normalized Difference Vegetation Index (NDVI). We observed a 19.9% growth of wetland area within four years, with 87.2% growth in the coverage of two major waterbodies in the reclaimed mine area. NDVI values indicate that the productivity of 66.5% of vegetation of the Kirchheller Heide was degraded due to changes in ground water tables and surface flooding. Our results inform environmental management and mining reclamation authorities about the subsidence spots and priority mitigation areas from land surface and vegetation degradation in Kirchheller Heide. In chapter 4, We demonstrated the advantage of fusing imageries from multiple sensors for LULC change assessments as well as for assessing surface permeability and temperature and UHI emergence in a fast-growing city, i.e. Tirunelveli, Tamilnadu, India. IRS-LISSIII and Landsat-7 ETM+ imageries were fused for 2007 and 2017, and classified using a Rotation Forest (RF) algorithm. Surface permeability and temperature were then quantified using Soil-Adjusted Vegetation Index (SAVI) and Land Surface Temperature (LST) index, respectively. Finally, we assessed the relationship between SAVI and LST for entire Tirunelveli as well as for each LULC zone, and also detected UHI emergence hot spots using a SAVI-LST combined metric. Our fused images exhibited higher classification accuracies, i.e. overall kappa coefficient values, than non-fused images. We observed an overall increase in the coverage of urban (dry, real estate plots and built-up) areas, while a decrease for vegetated (cropland and forest) areas in Tirunelveli between 2007 and 2017. The SAVI values indicated an extensive decrease in surface permeability for Tirunelveli overall and also for almost all LULC zones. The LST values showed an overall increase of surface temperature in Tirunelveli with the highest increase for urban built-up areas between 2007 and 2017. LST also exhibited a strong negative association with SAVI. South-eastern built-up areas in Tirunelveli were depicted as a potential UHI hotspot, with a caution for the Western riparian zone for UHI emergence in 2017. Our results provide important metrics for surface permeability, temperature and UHI monitoring, and inform urban and zonal planning authorities about the advantages of satellite image fusion. In chapter 5, We identified mangrove degradation drivers at regional and global levels resulted from decades of research data (from 1981 to present) of climate variations (seal-level rising, storms, precipitation, extremely high water events and temperature), and human activities (pollution, wood extraction, aquaculture, agriculture and urban expansion). This information can be useful for future research on mangroves, and to help delineating global planning strategies which consider the correct ecological and economic value of mangroves protecting them from further loss.O uso e a cobertura da Terra (UCT) são o aspeto comum que influencia várias questões ecológicas, degradações ambientais, mudanças na temperatura da superfície terrestre, mudanças hidrológicas, e de funções dos ecossistemas a nível regional e global. A investigação sobre os determinantes e progressão da mudança de UCT tem sido fundamental para o desenvolvimento de modelos que podem projetar e prever a extensão, o nível e os padrões futuros de UCT sob diferentes hipóteses de situações socioeconómicas, ecológicas e ambientais. A rápida e extensa urbanização e expansão urbana impulsionada pelo rápido crescimento populacional, levou ao encolhimento de terras agrícolas produtivas, impulsionando a mineração, a diminuição da permeabilidade da superfície e o surgimento de ilhas urbanas. Por outro lado, tem afetado negativamente a produção de serviços de ecossistemas. A mineração para extração de recursos pode levar a mudanças geológicas e ambientais devido a movimentos do solo, colisão com cavidades de mineração e deformação de aquíferos. As mudanças geológicas podem continuar numa área de mina recuperada, e os aquíferos deformados podem acarretar uma quebra de substratos e um aumento nos lençóis freáticos, causando a inundação na superfície. Consequentemente, uma área de mina recuperada pode sofrer um colapso à superfície, provocando o afundamento e a degradação da produtividade da vegetação. As mudanças na UCT, no crescimento urbano rápido, na temperatura da superfície terrestre e na dinâmica da vegetação devido ao aumento da população humana não afetam apenas a floresta interior e as zonas húmidas. Estas também influenciam diretamente as terras florestais costeiras, tais como mangais, pântanos e florestas ribeirinhas, ameaçando os serviços de ecossistemas. Os mangais proporcionam um aprovisionamento valioso (por exemplo, aquacultura, pesca, combustível, medicamentos, têxteis), a regulação (por exemplo, proteção da linha de costa, controlo da erosão, regulação do clima), os serviços de ecossistema de apoio (ciclo de nutrientes, habitats) e culturais (recreação e turismo) com um impacto importante no bem-estar humano. No entanto, a floresta de mangal é altamente ameaçada devido às mudanças climáticas e às atividades humanas que ignoram o valor ecológico e económico desses habitats, contribuindo para a sua degradação. Há um número crescente de estudos sobre distribuição, mudança e atividades de restabelecimento de mangais, denotando uma crescente atenção sobre o valor desses ecossistemas costeiros de zonas húmidas. A maioria desses estudos aborda os fatores de degradação dos mangais a nível regional ou local. No entanto, ainda não há avaliação suficiente sobre os determinantes da degradação dos mangais a nível global. Assim, a complexidade da degradação da paisagem interior e costeira deve ser abordada usando uma metodologia multidisciplinar. Portanto, esta dissertação teve, também, como objetivo avaliar o impacto do UCT associado à vegetação, temperatura e mudanças de zonas húmidas. Para compreender a relação entre a dinâmica da paisagem associada às atividades antrópicas a nível local e global, selecionámos quatro áreas de estudo, duas da Ásia, uma da Europa e outro estudo a nível global. No capítulo 2, empregamos a classificação Random Forest (RF) nas imagens Landsat de 1991, 2003 e 2016, e computamos seis métricas de paisagem para delinear a extensão das áreas urbanas numa área de influência suburbana de 10 km da cidade de Chennai, Tamil Nadu, Índia. O nível de crescimento urbano rápido foi quantificado usando a entropia de Renyi. Um modelo de UCT foi posteriormente usado para projetar a cobertura de terra para 2027. Uma expansão de 70,35% nas áreas urbanas foi observada principalmente para a periferia suburbana de Chennai entre 1991 e 2016. O valor de entropia do Renyi para 2016 foi de 0,9, exibindo uma duplicação do nível de crescimento urbano rápido quando comparado com 1991. Os valores das métricas espaciais indicam que as áreas urbanas existentes se tornaram mais densas e as terras agrícolas, florestas e terras particularmente áridas foram transformadas em assentamentos urbanos fragmentados. A previsão de cobertura da Terra para 2027 indica uma conversão de 13.670,33 ha (16,57% da paisagem total) de florestas e terras agrícolas existentes em áreas urbanas, com um aumento associado no valor de entropia para 1,7, indicando um tremendo nível de crescimento urbano rápido. O nosso estudo fornece métricas úteis para as autoridades de planeamento urbano para lidarem com as consequências socio-ecológicas do crescimento urbano rápido e para proteger os serviços de ecossistemas. No capítulo 3, estudamos a dinâmica da paisagem em Kirchheller Heide, Alemanha, que experimentou um movimento extensivo do solo devido à mineração, usando imagens Landsat entre 2013 e 2016. Uma técnica de classificação de imagem Random Forest foi aplicada para analisar dinâmicas de UCT e o crescimento das áreas de zonas húmidas foi avaliado usando uma Análise de Mistura Espectral. Também analisámos as mudanças na produtividade da vegetação usando um Índice de Vegetação por Diferença Normalizada (NDVI). Observámos um crescimento de 19,9% da área húmida em quatro anos, com um crescimento de 87,2% de dois principais corpos de água na área de mina recuperada. Valores de NDVI indicam que a produtividade de 66,5% da vegetação de Kirchheller Heide foi degradada devido a mudanças nos lençóis freáticos e inundações superficiais. Os resultados informam as autoridades de gestão ambiental e recuperação de mineração sobre os pontos de subsidência e áreas de mitigação prioritárias da degradação da superfície e da vegetação da terra em Kirchheller Heide. No capítulo 4, demonstramos a vantagem de fusionar imagens de múltiplos sensores para avaliações de mudanças de UCT, bem como para avaliar a permeabilidade, temperatura da superfície e a emergência do ilhas de calor numa cidade em rápido crescimento, Tirunelveli, Tamilnadu, Índia. As imagens IRS-LISSIII e Landsat-7 ETM + foram fusionadas para 2007 e 2017, e classificadas usando um algoritmo de Random Forest (RF). A permeabilidade de superfície e a temperatura foram então quantificadas usando-se o Índice de Vegetação Ajustada pelo Solo (SAVI) e o Índice de Temperatura da Superfície Terrestre (LST), respectivamente. Finalmente, avaliamos a relação entre SAVI e LST para Tirunelveli, bem como para cada zona de UCT, e também detetamos a emergência de pontos quentes de emergência usando uma métrica combinada de SAVI-LST. As nossas imagens fusionadas exibiram precisões de classificação mais altas, ou seja, valores globais do coeficiente kappa, do que as imagens não fusionadas. Observámos um aumento geral na cobertura de áreas urbanas (áreas de terrenos secos e construídas), e uma diminuição de áreas com vegetação (plantações e florestas) em Tirunelveli entre 2007 e 2017. Os valores de SAVI indicaram uma extensa diminuição na superfície de permeabilidade para Tirunelveli e também para quase todas as classes de UCT. Os valores de LST mostraram um aumento global da temperatura da superfície em Tirunelveli, sendo o maior aumento para as áreas urbanas entre 2007 e 2017. O LST também apresentou uma forte associação negativa com o SAVI. As áreas urbanas do Sudeste de Tirunelveli foram representadas como um potencial ponto quente, com uma chamada de atenção para a zona ribeirinha ocidental onde foi verificada a emergência de uma ilha de calor em 2017. Os nossos resultados fornecem métricas importantes sobre a permeabilidade da superfície, temperatura e monitoramento de ilhas de calor e informam as autoridades de planeamento sobre as vantagens da fusão de imagens de satélite. No capítulo 5, identificamos os fatores de degradação dos mangais a nível regional e global resultantes de décadas de dados de investigação (de 1981 até o presente) de variações climáticas (aumento do nível das águas do mar, tempestades, precipitação, eventos extremos de água e temperatura) e atividades humanas (poluição, extração de madeira, aquacultura, agricultura e expansão urbana). Estas informações podem ser úteis para investigações futuras sobre mangais e para ajudar a delinear estratégias de planeamento global que considerem o valor ecológico e económico dos mangais, protegendo-os de novas perdas

TractorEYE: Vision-based Real-time Detection for Autonomous Vehicles in Agriculture

Agricultural vehicles such as tractors and harvesters have for decades been able to navigate automatically and more efficiently using commercially available products such as auto-steering and tractor-guidance systems. However, a human operator is still required inside the vehicle to ensure the safety of vehicle and especially surroundings such as humans and animals. To get fully autonomous vehicles certified for farming, computer vision algorithms and sensor technologies must detect obstacles with equivalent or better than human-level performance. Furthermore, detections must run in real-time to allow vehicles to actuate and avoid collision.This thesis proposes a detection system (TractorEYE), a dataset (FieldSAFE), and procedures to fuse information from multiple sensor technologies to improve detection of obstacles and to generate a map. TractorEYE is a multi-sensor detection system for autonomous vehicles in agriculture. The multi-sensor system consists of three hardware synchronized and registered sensors (stereo camera, thermal camera and multi-beam lidar) mounted on/in a ruggedized and water-resistant casing. Algorithms have been developed to run a total of six detection algorithms (four for rgb camera, one for thermal camera and one for a Multi-beam lidar) and fuse detection information in a common format using either 3D positions or Inverse Sensor Models. A GPU powered computational platform is able to run detection algorithms online. For the rgb camera, a deep learning algorithm is proposed DeepAnomaly to perform real-time anomaly detection of distant, heavy occluded and unknown obstacles in agriculture. DeepAnomaly is -- compared to a state-of-the-art object detector Faster R-CNN -- for an agricultural use-case able to detect humans better and at longer ranges (45-90m) using a smaller memory footprint and 7.3-times faster processing. Low memory footprint and fast processing makes DeepAnomaly suitable for real-time applications running on an embedded GPU. FieldSAFE is a multi-modal dataset for detection of static and moving obstacles in agriculture. The dataset includes synchronized recordings from a rgb camera, stereo camera, thermal camera, 360-degree camera, lidar and radar. Precise localization and pose is provided using IMU and GPS. Ground truth of static and moving obstacles (humans, mannequin dolls, barrels, buildings, vehicles, and vegetation) are available as an annotated orthophoto and GPS coordinates for moving obstacles. Detection information from multiple detection algorithms and sensors are fused into a map using Inverse Sensor Models and occupancy grid maps. This thesis presented many scientific contribution and state-of-the-art within perception for autonomous tractors; this includes a dataset, sensor platform, detection algorithms and procedures to perform multi-sensor fusion. Furthermore, important engineering contributions to autonomous farming vehicles are presented such as easily applicable, open-source software packages and algorithms that have been demonstrated in an end-to-end real-time detection system. The contributions of this thesis have demonstrated, addressed and solved critical issues to utilize camera-based perception systems that are essential to make autonomous vehicles in agriculture a reality

The use of remote sensing and GIS for land use and land cover mapping in Eswatini : a review

Remote sensing and GIS are often used to assess spatiotemporal variations for land use/land cover (LULC) monitoring and classification. While LULC monitoring and classification has been undertaken in Eswatini, little attention has been given to ascertaining covered thematic areas, methods of image classification, and approaches and techniques for improving classification accuracy. This paper summarises and synthesizes the progress made in the Kingdom of Eswatini regarding the application of remote sensing and GIS in LULC monitoring and classification. Eight thematic areas (water resources mapping; land degradation; forestry; wildfire detection; urban expansion; crop production; disease surveillance; general mapping) dominate evaluated LULC studies, employing three LULC classification methods (classic; manual; advanced). While some studies include strengths and weaknesses of LULC classification techniques applied, others do not. This review shows that only two advanced classifiers (random forest; object-based) were identified from the reviewed articles. In addition, reviewed studies applied only two approaches (use of multi temporal data; fine spatial resolution data) and three techniques (use of ancillary data; post-classification procedure; the use of multisource data) for improving classification accuracy. Furthermore, the review finds that limited LULC investigations have been covered in Eswatini with a specific focus on the Sustainable Development Goals (SDGs). As such, this review recommends 1) the inclusion of higher resolution imagery for mapping purposes, 2) the adaptation of strengths and weaknesses for any image classification technique employed in future publications, 3) the use of more varied approaches and techniques for improving classification accuracy and area estimates, 4) inclusion of standard errors or confidence intervals for error-adjusted area estimates as part of accuracy assessment reporting, 5) the application of advanced image classifiers, and 6) the application of Earth Observation (EO) Analysis Ready Data (ARD) in the production of information for the support of the SDGs.http://www.sajg.org.za/index.php/sajgam2022Geography, Geoinformatics and Meteorolog