Segmentation and classification of individual tree crowns

By segmentation and classification of individual tree crowns in high spatial resolution aerial images, information about the forest can be automatically extracted. Segmentation is about finding the individual tree crowns and giving each of them a unique label. Classification, on the other hand, is about recognising the species of the tree. The information of each individual tree in the forest increases the knowledge about the forest which can be useful for managements, biodiversity assessment, etc. Different algorithms for segmenting individual tree crowns are presented and also compared to each other in order to find their strengths and weaknesses. All segmentation algorithms developed in this thesis focus on preserving the shape of the tree crown. Regions, representing the segmented tree crowns, grow according to certain rules from seed points. One method starts from many regions for each tree crown and searches for the region that fits the tree crown best. The other methods start from a set of seed points, representing the locations of the tree crowns, to create the regions. The segmentation result varies from 73 to 95 % correctly segmented visual tree crowns depending on the type of forest and the method. The former value is for a naturally generated mixed forest and the latter for a non-mixed forest. The classification method presented uses shape information of the segments and colour information of the corresponding tree crown in order to decide the species. The classification method classifies 77 % of the visual trees correctly in a naturally generated mixed forest, but on a forest stand level the classification is over 90 %

Radio Galaxy Zoo: Knowledge Transfer Using Rotationally Invariant Self-Organising Maps

With the advent of large scale surveys the manual analysis and classification of individual radio source morphologies is rendered impossible as existing approaches do not scale. The analysis of complex morphological features in the spatial domain is a particularly important task. Here we discuss the challenges of transferring crowdsourced labels obtained from the Radio Galaxy Zoo project and introduce a proper transfer mechanism via quantile random forest regression. By using parallelized rotation and flipping invariant Kohonen-maps, image cubes of Radio Galaxy Zoo selected galaxies formed from the FIRST radio continuum and WISE infrared all sky surveys are first projected down to a two-dimensional embedding in an unsupervised way. This embedding can be seen as a discretised space of shapes with the coordinates reflecting morphological features as expressed by the automatically derived prototypes. We find that these prototypes have reconstructed physically meaningful processes across two channel images at radio and infrared wavelengths in an unsupervised manner. In the second step, images are compared with those prototypes to create a heat-map, which is the morphological fingerprint of each object and the basis for transferring the user generated labels. These heat-maps have reduced the feature space by a factor of 248 and are able to be used as the basis for subsequent ML methods. Using an ensemble of decision trees we achieve upwards of 85.7% and 80.7% accuracy when predicting the number of components and peaks in an image, respectively, using these heat-maps. We also question the currently used discrete classification schema and introduce a continuous scale that better reflects the uncertainty in transition between two classes, caused by sensitivity and resolution limits

Intelligent classification and data augmentation for high accuracy AI applications for quality assurance of mineral aggregates

In this work, a method for automatic analysis of natural aggregates using hyperspectral imaging and high-resolution RGB imaging combined with AI algorithms consisting of an intelligent deep-learning-based recognition routine in form of hybrid cascaded recognition routine, and a necessary demonstration setup are demonstrated. Mineral aggregates are an essential raw material for the production of concrete. Petrographic analysis represents an elementary quality assurance measure for the production of high-quality concrete. Petrography is still a manual examination by specially trained experts, and the difficulty of the task lies in a large intra-class variability combined with low inter-class variability. In order to be able to increase the recognition performance, innovative new classification approaches have to be developed. As a solution, this paper presents an innovative cascaded deep-learning-based classification and uses a deep-learning-based data augmentation method to synthetically generate images to optimize the results

Utilization of EREP data in geological evaluation, regional planning, forest management, and water management in North Carolina

The author has identified the following significant results. The S190A, S190B, and S192 photographs and imagery were studied, using standard air-photo interpretation techniques supplemented by color additive viewing and density slicing. The EREP data were found to have potential usefulness for natural resource inventory work, water quality monitoring, and land use mapping for specific problems at scales up to 1:30,000. Distinctions between forest types in North Carolina are limited to conifers, mixed conifer-hardwoods, and hardwoods. Geologic interpretation was limited to detection of lineaments; lithologic differentiation and soil group mapping have proved infeasible in North Carolina except for differentiation of wetland soils in the coastal plain. Imagery from the S192 multispectral scanner has proved to be capable of useful discriminations for vegetation and crop analysis

Automatic qualtiy control of cropland and grasland GIS objects using IKONOS satellite imagery

As a consequence of the wide-spread application of digital geo-data in Geoinformation Systems (GIS), quality control has become increasingly important. A high degree of automation is required in order to make quality control efficient enough for practical application. In order to achieve this goal we have designed and implemented a semi-automatic technique for the verification of cropland and grassland GIS objects using 1 m pan-sharpened multispectral IKONOS imagery. The approach compares the GIS objects and compares them with data derived from high resolution remote sensing imagery using image analysis techniques. Textural, structural, and spectral features are assessed in a classification based on Support Vector Machines (SVM) in order to check whether a cropland or grassland object in the GIS is correct or not. The approach is explained in detail, and an evaluation is presented using reference data. Both the potential and the limitations of the system are discussed.German Federal Agency for Cartography and Geodesy (BKG

Remote sensing image fusion on 3D scenarios: A review of applications for agriculture and forestry

Three-dimensional (3D) image mapping of real-world scenarios has a great potential to provide the user with a more accurate scene understanding. This will enable, among others, unsupervised automatic sampling of meaningful material classes from the target area for adaptive semi-supervised deep learning techniques. This path is already being taken by the recent and fast-developing research in computational fields, however, some issues related to computationally expensive processes in the integration of multi-source sensing data remain. Recent studies focused on Earth observation and characterization are enhanced by the proliferation of Unmanned Aerial Vehicles (UAV) and sensors able to capture massive datasets with a high spatial resolution. In this scope, many approaches have been presented for 3D modeling, remote sensing, image processing and mapping, and multi-source data fusion. This survey aims to present a summary of previous work according to the most relevant contributions for the reconstruction and analysis of 3D models of real scenarios using multispectral, thermal and hyperspectral imagery. Surveyed applications are focused on agriculture and forestry since these fields concentrate most applications and are widely studied. Many challenges are currently being overcome by recent methods based on the reconstruction of multi-sensorial 3D scenarios. In parallel, the processing of large image datasets has recently been accelerated by General-Purpose Graphics Processing Unit (GPGPU) approaches that are also summarized in this work. Finally, as a conclusion, some open issues and future research directions are presented.European Commission 1381202-GEU PYC20-RE-005-UJA IEG-2021Junta de Andalucia 1381202-GEU PYC20-RE-005-UJA IEG-2021Instituto de Estudios GiennesesEuropean CommissionSpanish Government UIDB/04033/2020DATI-Digital Agriculture TechnologiesPortuguese Foundation for Science and Technology 1381202-GEU FPU19/0010

A Systematic Literature Review on SOTA Machine learning-supported Computer Vision Approaches to Image Enhancement

Image enhancement as a problem-oriented process of optimizing visual appearances to provide easier-toprocess input to automated image processing techniques is an area that will consistently be a companion to computer vision despite advances in image acquisition and its relevance continues to grow. For our systematic literature review, we consider the major peer-reviewed journals and conference papers on the state of the art in machine learning-based computer vision approaches for image enhancement. We describe the image enhancement methods relevant to our work and introduce the machine learning models used. We then provide a comprehensive overview of the different application areas and formulate research gaps for future scientific work on machine learning based computer vision approaches for image enhancement based on our result