Improving parameters selection of a seeded region growing method for multiband image segmentation

In the last decade, Object Based Image Analysis (OBIA) has been accepted as an effective method for processing high spatial resolution multiband images. This image analysis method is an approach that starts with the segmentation of the image. Image segmentation in general is a procedure to partition an image into homogenous groups (segments). In practice, visual interpretation is often used to assess the quality of segmentation and the analysis relies on the experience of an analyst. In an effort to address the issue, in this study, we evaluate several seed selection strategies for an automatic image segmentation methodology based on a seeded region growing-merging approach. In order to evaluate the segmentation quality, segments were subjected to spatial autocorrelation analysis using Moran's I index and intra-segment variance analysis. We apply the algorithm to image segmentation using an aerial multiband image

Positioning in time and space: cost-effective exterior orientation for airborne archaeological photographs

Since manned, airborne aerial reconnaissance for archaeological purposes is often characterised by more-or-less random photographing of archaeological features on the Earth, the exact position and orientation of the camera during image acquisition becomes very important in an effective inventorying and interpretation workflow of these aerial photographs. Although the positioning is generally achieved by simultaneously logging the flight path or directly recording the camera's position with a GNSS receiver, this approach does not allow to record the necessary roll, pitch and yaw angles of the camera. The latter are essential elements for the complete exterior orientation of the camera, which allows – together with the inner orientation of the camera – to accurately define the portion of the Earth recorded in the photograph. This paper proposes a cost-effective, accurate and precise GNSS/IMU solution (image position: 2.5 m and orientation: 2°, both at 1σ) to record all essential exterior orientation parameters for the direct georeferencing of the images. After the introduction of the utilised hardware, this paper presents the developed software that allows recording and estimating these parameters. Furthermore, this direct georeferencing information can be embedded into the image's metadata. Subsequently, the first results of the estimation of the mounting calibration (i.e. the misalignment between the camera and GNSS/IMU coordinate frame) are provided. Furthermore, a comparison with a dedicated commercial photographic GNSS/IMU solution will prove the superiority of the introduced solution. Finally, an outlook on future tests and improvements finalises this article

Efficient Surface-Aware Semi-Global Matching with Multi-View Plane-Sweep Sampling

Online augmentation of an oblique aerial image sequence with structural information is an essential aspect in the process of 3D scene interpretation and analysis. One key aspect in this is the efficient dense image matching and depth estimation. Here, the Semi-Global Matching (SGM) approach has proven to be one of the most widely used algorithms for efficient depth estimation, providing a good trade-off between accuracy and computational complexity. However, SGM only models a first-order smoothness assumption, thus favoring fronto-parallel surfaces. In this work, we present a hierarchical algorithm that allows for efficient depth and normal map estimation together with confidence measures for each estimate. Our algorithm relies on a plane-sweep multi-image matching followed by an extended SGM optimization that allows to incorporate local surface orientations, thus achieving more consistent and accurate estimates in areasmade up of slanted surfaces, inherent to oblique aerial imagery. We evaluate numerous configurations of our algorithm on two different datasets using an absolute and relative accuracy measure. In our evaluation, we show that the results of our approach are comparable to the ones achieved by refined Structure-from-Motion (SfM) pipelines, such as COLMAP, which are designed for offline processing. In contrast, however, our approach only considers a confined image bundle of an input sequence, thus allowing to perform an online and incremental computation at 1Hz–2Hz

A New Approach to Analyzing High-Resolution Aerial Photographs of Urban Areas.

This dissertation proposes a new approach for analyzing high resolution aerial photographs of urban areas. Analyzing aerial photographs is the process of constructing an overall description of a scene. It involves knowledge of visual sensors, computing systems, artificial intelligence, software engineering, and perceptual psychology. Researchers have had only limited success in this area. This dissertation considers a high level analysis approach. Most aerial photograph interpretation systems concentrate on analyzing an airport, roadway, or urban scene. Those systems, however, do not explain how they know they were examining such a scene. This dissertation concentrates on how to reach that point. It begins with this is an aerial photograph and works its way down through a hierarchy of labels until it reaches the point of this is an urban area--find and label the objects. The new analysis approach introduces a unique use of three basic ideas. These ideas are (1) the use of context, expectations, selective attention, and the perceptual cycle, (2) analyzing the image through a hierarchy of increasingly specific labels, and (3) the interplay between the segmentation and interpretation processes. These are developed in a computer vision system for analyzing aerial photographs. The system comprises (1) a control mechanism, (2) a knowledge base, (3) a belief maintenance system, and (4) an image processing interface. In general, the system uses the knowledge stored in frames to investigate areas in the image. The control mechanism calls low level routines in the image processing interface. They report the results back to the control mechanism which invokes the belief maintenance system. The belief maintenance system reports which frame is the most probable label for the area under investigation. To demonstrate the system, this dissertation presents the results of analyzing a high resolution, multi-spectral, aerial image of an urban area. It also presents the results of analyzing three different housing areas taken from a single channel, gray scale image of a color aerial photograph. These show the validity of the new approach and the power and portability of the system

Surveying wildlife and livestock in Uganda with aerial cameras:Deep Learning reduces the workload of human interpretation by over 70%

As the need to accurately monitor key-species populations grows amid increasing pressures on global biodiversity, the counting of large mammals in savannas has traditionally relied on the Systematic-Reconnaissance-Flight (SRF) technique using light aircrafts and human observers. However, this method has limitations, including non-systematic human errors. In recent years, the Oblique-Camera-Count (OCC) approach developed in East Africa has utilized cameras to capture high-resolution imagery replicating aircraft observers’ oblique view. Whilst demonstrating that human observers have missed many animals, OCC relies on labor-intensive human interpretation of thousands of images. This study explores the potential of Deep Learning (DL) to reduce the interpretation workload associated with OCC surveys. Using oblique aerial imagery of 2.1 hectares footprint collected during an SRF-OCC survey of Queen Elizabeth Protected Area in Uganda, a DL model (HerdNet) was trained and evaluated to detect and count 12 wildlife and livestock mammal species. The model’s performance was assessed both at the animal instance-based and image-based levels, achieving accurate detection performance (F1 score of 85%) in positive images (i.e. containing animals) and reducing manual interpretation workload by 74% on a realistic dataset showing less than 10% of positive images. However, it struggled to differentiate visually related species and overestimated animal counts due to false positives generated by landscape items resembling animals. These challenges may be addressed through improved training and verification processes. The results highlight DL’s potential to semi-automate processing of aerial survey wildlife imagery, reducing manual interpretation burden. By incorporating DL models into existing counting standards, future surveys may increase sampling efforts, improve accuracy, and enhance aerial survey safety.</p

Trying to break new ground in aerial archaeology

Aerial reconnaissance continues to be a vital tool for landscape-oriented archaeological research. Although a variety of remote sensing platforms operate within the earth’s atmosphere, the majority of aerial archaeological information is still derived from oblique photographs collected during observer-directed reconnaissance flights, a prospection approach which has dominated archaeological aerial survey for the past century. The resulting highly biased imagery is generally catalogued in sub-optimal (spatial) databases, if at all, after which a small selection of images is orthorectified and interpreted. For decades, this has been the standard approach. Although many innovations, including digital cameras, inertial units, photogrammetry and computer vision algorithms, geographic(al) information systems and computing power have emerged, their potential has not yet been fully exploited in order to re-invent and highly optimise this crucial branch of landscape archaeology. The authors argue that a fundamental change is needed to transform the way aerial archaeologists approach data acquisition and image processing. By addressing the very core concepts of geographically biased aerial archaeological photographs and proposing new imaging technologies, data handling methods and processing procedures, this paper gives a personal opinion on how the methodological components of aerial archaeology, and specifically aerial archaeological photography, should evolve during the next decade if developing a more reliable record of our past is to be our central aim. In this paper, a possible practical solution is illustrated by outlining a turnkey aerial prospection system for total coverage survey together with a semi-automated back-end pipeline that takes care of photograph correction and image enhancement as well as the management and interpretative mapping of the resulting data products. In this way, the proposed system addresses one of many bias issues in archaeological research: the bias we impart to the visual record as a result of selective coverage. While the total coverage approach outlined here may not altogether eliminate survey bias, it can vastly increase the amount of useful information captured during a single reconnaissance flight while mitigating the discriminating effects of observer-based, on-the-fly target selection. Furthermore, the information contained in this paper should make it clear that with current technology it is feasible to do so. This can radically alter the basis for aerial prospection and move landscape archaeology forward, beyond the inherently biased patterns that are currently created by airborne archaeological prospection

A RATIONAL APPROACH TO DIGITAL ANCILLARY DATA ACCESS AND VISUALIZATION IN LAND COVER, LAND USE PROJECTS

During the last decade many national and regional Land Cover/Land Use projects are implemented based on computer aided satellite image interpretation. An essential procedure for the European CORINE Land Cover 2000 and EROSION projects is forward and backward change detection. The use of three generations of Landsat images (MSS, TM and ETM+) with different spatial and spectral resolution raises some specific geometric and thematic problems. Topographic maps and aerial photographs are indispensable sources of support information. Usually old archives are not in digital form. The use of hardcopy topographic maps and aerial photographs is a cumbersome and time-consuming operation. A rational approach to the conversion of these data and advanced methods for visualization are vital for the interpretation process optimization. In this paper the alternatives of using either geo-referenced or ortho-rectified aerial photographs are studied so that project specification requirements concerning planimetric and thematic accuracy could be achieved. In this case optimisation means minimal hardware, software and human resources used. A GIS data base management system is extended with a new structure in order to facilitate the fast and accurate choice of appropriate ancillary data. This approach for data organization is very useful in the verification phase, when data for large territories is processed. A fast and accurate choice of spatially overlapping data sets is achieved. The developed methodology is applied throughout the implementation of the projects mentioned above. Examples of making decisions in some cases of uncertainty during the interpretation are given. 1

Guidance for benthic habitat mapping: an aerial photographic approach

This document, Guidance for Benthic Habitat Mapping: An Aerial Photographic Approach, describes proven technology that can be applied in an operational manner by state-level scientists and resource managers. This information is based on the experience gained by NOAA Coastal Services Center staff and state-level cooperators in the production of a series of benthic habitat data sets in Delaware, Florida, Maine, Massachusetts, New York, Rhode Island, the Virgin Islands, and Washington, as well as during Center-sponsored workshops on coral remote sensing and seagrass and aquatic habitat assessment. (PDF contains 39 pages) The original benthic habitat document, NOAA Coastal Change Analysis Program (C-CAP): Guidance for Regional Implementation (Dobson et al.), was published by the Department of Commerce in 1995. That document summarized procedures that were to be used by scientists throughout the United States to develop consistent and reliable coastal land cover and benthic habitat information. Advances in technology and new methodologies for generating these data created the need for this updated report, which builds upon the foundation of its predecessor