Automation aspects for the georeferencing of photogrammetric aerial image archives in forested scenes

Photogrammetric aerial film image archives are scanned into digital form in many countries. These data sets offer an interesting source of information for scientists from different disciplines. The objective of this investigation was to contribute to the automation of a generation of 3D environmental model time series when using small-scale airborne image archives, especially in forested scenes. Furthermore, we investigated the usability of dense digital surface models (DSMs) generated using these data sets as well as the uncertainty propagation of the DSMs. A key element in the automation is georeferencing. It is obvious that for images captured years apart, it is essential to find ground reference locations that have changed as little as possible. We studied a 68-year-long aerial image time series in a Finnish Karelian forestland. The quality of candidate ground locations was evaluated by comparing digital DSMs created from the images to an airborne laser scanning (ALS)-originated reference DSM. The quality statistics of DSMs were consistent with the expectations; the estimated median root mean squared error for height varied between 0.3 and 2 m, indicating a photogrammetric modelling error of 0.1 parts per thousand with respect to flying height for data sets collected since the 1980s, and 0.2 parts per thousand for older data sets. The results show that of the studied land cover classes, "peatland without trees" changed the least over time and is one of the most promising candidates to serve as a location for automatic ground control measurement. Our results also highlight some potential challenges in the process as well as possible solutions. Our results indicate that using modern photogrammetric techniques, it is possible to reconstruct 3D environmental model time series using photogrammetric image archives in a highly automated way.Peer reviewe

Fotogrametría de rango cercano aplicada a la Ingeniería Agroforestal

Tesis por compendio de publicaciones[EN]Since the late twentieth century, Geotechnologies are being applied in different research lines in Agroforestry Engineering aimed at advancing in the modeling of biophysical parameters in order to improve the productivity. In this study, low-cost and close range photogrammetry has been used in different agroforestry scenarios to solve identified gaps in the results and improve procedures and technology hitherto practiced in this field. Photogrammetry offers the advantage of being a non-destructive and non-invasive technique, never changing physical properties of the studied element, providing rigor and completeness to the captured information. In this PhD dissertation, the following contributions are presented divided into three research papers: • A methodological proposal to acquire georeferenced multispectral data of high spatial resolution using a low-cost manned aerial platform, to monitor and sustainably manage extensive áreas of crops. The vicarious calibration is exposed as radiometric calibration method of the multispectral sensor embarked on a paraglider. Low-cost surfaces are performed as control coverages. • The development of a method able to determine crop productivity under field conditions, from the combination of close range photogrammetry and computer vision, providing a constant operational improvement and a proactive management in the crop monitoring. An innovate methodology in the sector is proposed, ensuring flexibility and simplicity in the data collection by non-invasive technologies, automation in processing and quality results with low associated cost. • A low cost, efficient and accurate methodology to obtain Digital Height Models of vegatal cover intended for forestry inventories by integrating public data from LiDAR into photogrammetric point clouds coming from low cost flights. This methodology includes the potentiality of LiDAR to register ground points in areas with high density of vegetation and the better spatial, radiometric and temporal resolution from photogrammetry for the top of vegetal covers.[ES]Desde finales del siglo XX se están aplicando Geotecnologías en diferentes líneas de investigación en Ingeniería Agroforestal orientadas a avanzar en la modelización de parámetros biofísicos con el propósito de mejorar la productividad. En este estudio se ha empleado fotogrametría de bajo coste y rango cercano en distintos escenarios agroforestales para solventar carencias detectadas en los resultados obtenidos y mejorar los procedimientos y la tecnología hasta ahora usados en este campo. La fotogrametría ofrece como ventaja el ser una técnica no invasiva y no destructiva, por lo que no altera en ningún momento las propiedades físicas del elemento estudiado, dotando de rigor y exhaustividad a la información capturada. En esta Tesis Doctoral se presentan las siguientes contribuciones, divididas en tres artículos de investigación: • Una propuesta metodológica de adquisición de datos multiespectrales georreferenciados de alta resolución espacial mediante una plataforma aérea tripulada de bajo coste, para monitorizar y gestionar sosteniblemente amplias extensiones de cultivos. Se expone la calibración vicaria como método de calibración radiométrico del sensor multiespectral embarcado en un paramotor empleando como coberturas de control superficies de bajo coste. • El desarrollo de un método capaz de determinar la productividad del cultivo en condiciones de campo, a partir de la combinación de fotogrametría de rango cercano y visión computacional, facilitando una mejora operativa constante así como una gestión proactiva en la monitorización del cultivo. Se propone una metodología totalmente novedosa en el sector, garantizando flexibilidad y sencillez en la toma de datos mediante tecnologías no invasivas, automatismo en el procesado, calidad en los resultados y un bajo coste asociado. • Una metodología de bajo coste, eficiente y precisa para la obtención de Modelos Digitales de Altura de Cubierta Vegetal destinados al inventario forestal mediante la integración de datos públicos procedentes del LiDAR en las nubes de puntos fotogramétricas obtenidas con un vuelo de bajo coste. Esta metodología engloba la potencialidad del LiDAR para registrar el terreno en zonas con alta densidad de vegetación y una mejor resolución espacial, radiométrica y temporal procedente de la fotogrametría para la parte superior de las cubiertas vegetales

A Pipeline of 3D Scene Reconstruction from Point Clouds

3D technologies are becoming increasingly popular as their applications in industrial, consumer, entertainment, healthcare, education, and governmental increase in number. According to market predictions, the total 3D modeling and mapping market is expected to grow from $1.1 billion in 2013 to$7.7 billion by 2018. Thus, 3D modeling techniques for different data sources are urgently needed. This thesis addresses techniques for automated point cloud classification and the reconstruction of 3D scenes (including terrain models, 3D buildings and 3D road networks). First, georeferenced binary image processing techniques were developed for various point cloud classifications. Second, robust methods for the pipeline from the original point cloud to 3D model construction were proposed. Third, the reconstruction for the levels of detail (LoDs) of 1-3 (CityGML website) of 3D models was demonstrated. Fourth, different data sources for 3D model reconstruction were studied. The strengths and weaknesses of using the different data sources were addressed. Mobile laser scanning (MLS), unmanned aerial vehicle (UAV) images, airborne laser scanning (ALS), and the Finnish National Land Survey’s open geospatial data sources e.g. a topographic database, were employed as test data. Among these data sources, MLS data from three different systems were explored, and three different densities of ALS point clouds (0.8, 8 and 50 points/m2) were studied. The results were compared with reference data such as an orthophoto with a ground sample distance of 20cm or measured reference points from existing software to evaluate their quality. The results showed that 74.6% of building roofs were reconstructed with the automated process. The resulting building models provided an average height deviation of 15 cm. A total of 6% of model points had a greater than one-pixel deviation from laser points. A total of 2.5% had a deviation of greater than two pixels. The pixel size was determined by the average distance of input laser points. The 3D roads were reconstructed with an average width deviation of 22 cm and an average height deviation of 14 cm. The results demonstrated that 93.4% of building roofs were correctly classified from sparse ALS and that 93.3% of power line points are detected from the six sets of dense ALS data located in forested areas. This study demonstrates the operability of 3D model construction for LoDs of 1-3 via the proposed methodologies and datasets. The study is beneficial to future applications, such as 3D-model-based navigation applications, the updating of 2D topographic databases into 3D maps and rapid, large-area 3D scene reconstruction. 3D-teknologiat ovat tulleet yhä suositummiksi niiden sovellusalojen lisääntyessä teollisuudessa, kuluttajatuotteissa, terveydenhuollossa, koulutuksessa ja hallinnossa. Ennusteiden mukaan 3D-mallinnus- ja -kartoitusmarkkinat kasvavat vuoden 2013 1,1 miljardista dollarista 7,7 miljardiin vuoteen 2018 mennessä. Erilaisia aineistoja käyttäviä 3D-mallinnustekniikoita tarvitaankin yhä enemmän. Tässä väitöskirjatutkimuksessa kehitettiin automaattisen pistepilviaineiston luokittelutekniikoita ja rekonstruoitiin 3D-ympäristöja (maanpintamalleja, rakennuksia ja tieverkkoja). Georeferoitujen binääristen kuvien prosessointitekniikoita kehitettiin useiden pilvipisteaineistojen luokitteluun. Työssä esitetään robusteja menetelmiä alkuperäisestä pistepilvestä 3D-malliin eri CityGML-standardin tarkkuustasoilla. Myös eri aineistolähteitä 3D-mallien rekonstruointiin tutkittiin. Eri aineistolähteiden käytön heikkoudet ja vahvuudet analysoitiin. Testiaineistona käytettiin liikkuvalla keilauksella (mobile laser scanning, MLS) ja ilmakeilauksella (airborne laser scanning, ALS) saatua laserkeilausaineistoja, miehittämättömillä lennokeilla (unmanned aerial vehicle, UAV) otettuja kuvia sekä Maanmittauslaitoksen avoimia aineistoja, kuten maastotietokantaa. Liikkuvalla laserkeilauksella kerätyn aineiston osalta tutkimuksessa käytettiin kolmella eri järjestelmällä saatua dataa, ja kolmen eri tarkkuustason (0,8, 8 ja 50 pistettä/m2) ilmalaserkeilausaineistoa. Tutkimuksessa saatuja tulosten laatua arvioitiin vertaamalla niitä referenssiaineistoon, jona käytettiin ortokuvia (GSD 20cm) ja nykyisissä ohjelmistoissa olevia mitattuja referenssipisteitä. 74,6 % rakennusten katoista saatiin rekonstruoitua automaattisella prosessilla. Rakennusmallien korkeuksien keskipoikkeama oli 15 cm. 6 %:lla mallin pisteistä oli yli yhden pikselin poikkeama laseraineiston pisteisiin verrattuna. 2,5 %:lla oli yli kahden pikselin poikkeama. Pikselikoko määriteltiin kahden laserpisteen välimatkan keskiarvona. Rekonstruoitujen teiden leveyden keskipoikkeama oli 22 cm ja korkeuden keskipoikkeama oli 14 cm. Tulokset osoittavat että 93,4 % rakennuksista saatiin luokiteltua oikein harvasta ilmalaserkeilausaineistosta ja 93,3 % sähköjohdoista saatiin havaittua kuudesta tiheästä metsäalueen ilmalaserkeilausaineistosta. Tutkimus demonstroi 3D-mallin konstruktion toimivuutta tarkkuustasoilla (LoD) 1-3 esitetyillä menetelmillä ja aineistoilla. Tulokset ovat hyödyllisiä kehitettäessä tulevaisuuden sovelluksia, kuten 3D-malleihin perustuvia navigointisovelluksia, topografisten 2D-karttojen ajantasaistamista 3D-kartoiksi, ja nopeaa suurten alueiden 3D-ympäristöjen rekonstruktiota

Extracting Physical and Environmental Information of Irish Roads Using Airborne and Mobile Sensors

Airborne sensors including LiDAR and digital cameras are now used extensively for capturing topographical information as these are often more economical and efficient as compared to the traditional photogrammetric and land surveying techniques. Data captured using airborne sensors can be used to extract 3D information important for, inter alia, city modelling, land use classification and urban planning. According to the EU noise directive (2002/49/EC), the National Road Authority (NRA) in Ireland is responsible for generating noise models for all roads which are used by more than 8,000 vehicles per day. Accordingly, the NRA has to cover approximately 4,000 km of road, 500m on each side. These noise models have to be updated every 5 years. Important inputs to noise model are digital terrain model (DTM), 3D building data, road width, road centre line, ground surface type and noise barriers. The objective of this research was to extract these objects and topographical information using nationally available datasets acquired from the Ordnance Survey of Ireland (OSI). The OSI uses ALS50-II LiDAR and ADS40 digital sensors for capturing ground information. Both sensors rely on direct georeferencing, minimizing the need for ground control points. Before exploiting the complementary nature of both datasets for information extraction, their planimetric and vertical accuracies were evaluated using independent ground control points. A new method was also developed for registration in case of any mismatch. DSMs from LiDAR and aerial images were used to find common points to determine the parameters of 2D conformal transformation. The developed method was also evaluated by the EuroSDR in a project which involved a number of partners. These measures were taken to ensure that the inputs to the noise model were of acceptable accuracy as recommended in the report (Assessment of Exposure to Noise, 2006) by the European Working Group. A combination of image classification techniques was used to extract information by the fusion of LiDAR and aerial images. The developed method has two phases, viz. object classification and object reconstruction. Buildings and vegetation were classified based on Normalized Difference Vegetation Index (NDVI) and a normalized digital surface model (nDSM). Holes in building segments were filled by object-oriented multiresolution segmentation. Vegetation that remained amongst buildings was classified using cues obtained from LiDAR. The short comings there in were overcome by developing an additional classification cue using multiple returns. The building extents were extracted and assigned a single height value generated from LiDAR nDSM. The extracted height was verified against the ground truth data acquired using terrestrial survey techniques. Vegetation was further classified into three categories, viz. trees, hedges and tree clusters based on shape parameter (for hedges) and distance from neighbouring trees (for clusters). The ground was classified into three surface types i.e. roads and parking area, exposed surface and grass. This was done using LiDAR intensity, NDVI and nDSM. Mobile Laser Scanning (MLS) data was used to extract walls and purpose built noise barriers, since these objects were not extractable from the available airborne sensor data. Principal Component Analysis (PCA) was used to filter points belonging to such objects. A line was then fitted to these points using robust least square fitting. The developed object extraction method was tested objectively in two independent areas namely the Test Area-1 and the Test Area-2. The results were thoroughly investigated by three different accuracy assessment methods using the OSI vector data. The acceptance of any developed method for commercial applications requires completeness and correctness values of 85% and 70% respectively. Accuracy measures obtained using the developed method of object extraction recommend its applicability for noise modellin

Determining the Effect of Mission Design and Point Cloud Filtering on the Quality and Accuracy of SfM Photogrammetric Products Derived from sUAS Imagery

This research investigates the influence that various flight plan and mission design strategies for collecting small unmanned aerial system (sUAS) imagery have on the accuracy of the resulting three-dimensional models to find an optimal method to achieve a result. This research also explores the effect that using gradual selection to reduce the sparse point cloud has on product accuracy and processing details. Imagery was collected in the spring of 2018 during leaf-off conditions at six field sites along the North Fork of the White River. The aerial imagery was collected using a DJI Phantom Pro 4 sUAS. Four different image acquisition missions were flown at each of the sites. Each of the base mission imagery sets were processed individually and in various combinations. The commercial Structure-from-Motion (SfM) photogrammetry software known as Agisoft PhotoScan was used to process the data and generate the Digital Elevation Models (DEMs) and orthophotos. Due to the high number of processing iterations required in this research, a script was developed to automate the point cloud filtering gradual selection process. Profile views were used to assess the differences between each mission design and to visualize systematic errors. In this investigation, the imagery set which consistently performed with high relative accuracy and low relative processing times was the NS Oblique imagery set utilizing automated gradual selection. Imagery sets created by combining two or more of the base mission photosets generally produced results with accuracy levels similar to or worse than the results of the NS Oblique imagery set and the other base mission imagery sets. Results produced with and without gradual selection were similar in most cases, however, gradual selection reduced dense cloud processing time by an average of 37%

Heritage Recording and 3D Modeling with Photogrammetry and 3D Scanning

The importance of landscape and heritage recording and documentation with optical remote sensing sensors is well recognized at international level. The continuous development of new sensors, data capture methodologies and multi-resolution 3D representations, contributes significantly to the digital 3D documentation, mapping, conservation and representation of landscapes and heritages and to the growth of research in this field. This article reviews the actual optical 3D measurement sensors and 3D modeling techniques, with their limitations and potentialities, requirements and specifications. Examples of 3D surveying and modeling of heritage sites and objects are also shown throughout the paper

UAVs for the Environmental Sciences

This book gives an overview of the usage of UAVs in environmental sciences covering technical basics, data acquisition with different sensors, data processing schemes and illustrating various examples of application