Grid models versus TIN : geometric accuracy of multibeam data processing

C

Spectral filtering as a method of visualising and removing striped artefacts in digital elevation data

Spectral filtering was compared with traditional mean spatial filters to assess their ability to identify and remove striped artefacts in digital elevation data. The techniques were applied to two datasets: a 100 m contour derived digital elevation model (DEM) of southern Norway and a 2 m LiDAR DSM of the Lake District, UK. Both datasets contained diagonal data artefacts that were found to propagate into subsequent terrain analysis. Spectral filtering used fast Fourier transformation (FFT) frequency data to identify these data artefacts in both datasets. These were removed from the data by applying a cut filter, prior to the inverse transform. Spectral filtering showed considerable advantages over mean spatial filters, when both the absolute and spatial distribution of elevation changes made were examined. Elevation changes from the spectral filtering were restricted to frequencies removed by the cut filter, were small in magnitude and consequently avoided any global smoothing. Spectral filtering was found to avoid the smoothing of kernel based data editing, and provided a more informative measure of data artefacts present in the FFT frequency domain. Artefacts were found to be heterogeneous through the surfaces, a result of their strong correlations with spatially autocorrelated variables: landcover and landsurface geometry. Spectral filtering performed better on the 100 m DEM, where signal and artefact were clearly distinguishable in the frequency data. Spectrally filtered digital elevation datasets were found to provide a superior and more precise representation of the landsurface and be a more appropriate dataset for any subsequent geomorphological applications

semi automatic derivation of channel network from a high resolution dtm the example of an italian alpine region

AbstractHigh-resolution digital terrain models (HR-DTMs) of regional coverage open interesting scenarios for the analysis of landscape, including derivation and analysis of channel network. In this study, we present the derivation of the channel network from a HR-DTM for the Autonomous Province of Trento. A preliminary automatic extraction of the raw channel network was conducted using a curvature-based algorithm applied to a 4 m resolution DTM derived from an airborne LiDAR survey carried out in 2006. The raw channel network automatically extracted from the HR-DTM underwent a supervised control to check the spatial pattern of the hydrographic network. The supervised control was carried out by means of different informative layers (i.e. geomorphometric indexes, orthophoto imagery and technical cartography) resulting in an accurate and fine-scale channel network

Airborne LiDAR for DEM generation: some critical issues

Airborne LiDAR is one of the most effective and reliable means of terrain data collection. Using LiDAR data for DEM generation is becoming a standard practice in spatial related areas. However, the effective processing of the raw LiDAR data and the generation of an efficient and high-quality DEM remain big challenges. This paper reviews the recent advances of airborne LiDAR systems and the use of LiDAR data for DEM generation, with special focus on LiDAR data filters, interpolation methods, DEM resolution, and LiDAR data reduction. Separating LiDAR points into ground and non-ground is the most critical and difficult step for DEM generation from LiDAR data. Commonly used and most recently developed LiDAR filtering methods are presented. Interpolation methods and choices of suitable interpolator and DEM resolution for LiDAR DEM generation are discussed in detail. In order to reduce the data redundancy and increase the efficiency in terms of storage and manipulation, LiDAR data reduction is required in the process of DEM generation. Feature specific elements such as breaklines contribute significantly to DEM quality. Therefore, data reduction should be conducted in such a way that critical elements are kept while less important elements are removed. Given the highdensity characteristic of LiDAR data, breaklines can be directly extracted from LiDAR data. Extraction of breaklines and integration of the breaklines into DEM generation are presented

The advantage of lidar digital terrain models in doline morphometry compared to topographic map based datasets – Aggtelek karst (Hungary) as an example

Doline morphometry has always been in the focus of karst geomorphological research. Recently, digital terrain model (DTM) based methods became widespread in the study of dolines. Today, LiDAR datasets provide high resolution DTMs, and automated doline recognition algorithms have been developed. In this paper, we test different datasets and a doline recognition algorithm using Aggtelek Karst (NE-Hungary) dolines as a case example. Three datasets are compared: “TOPO” dolines delineated by the classical outermost closed contour method using 1:10,000 scale topographic maps, “KRIG” dolines derived automatically from the DTM created by kriging interpolation from the digitized contours of the same topographic maps, and finally “LiDAR” dolines derived automatically from a DTM created from LiDAR data. First, we analyzed the sensitivity of the automatic method to the “depth limit” parameter, which is the threshold, below which closed depressions are considered as “errors” and are filled. In the actual case, given the typical doline size of the area and the resolution of the DTMs, we found that ca. 0.5 m is the optimal depth limit for the LiDAR dataset and 1 m for the KRIG dataset. The statistical distributions of the morphometrical properties were similar for all datasets (lognormal distribution for area and gamma distribution for depth), but the DTM-based methodology resulted larger dolines with respect to the classical method. The planform area (and related characteristics) showed very high correlations between the datasets. Depth values were less correlated and the lowest (moderately strong) correlations were observed between circularity values of the different datasets. Slope histograms calculated from the LiDAR data were used to cluster dolines, and these clusters differentiated dolines similarly to the classical depth-diameter ratio. Finally, we conclude that in the actual case, dolines can be morphometrically well characterized even by the classical topographic method, though finer results can be achieved for the depth and shape related parameters by using LiDAR data.Key words: doline morphometry, LiDAR, interpolation, slope histogram, sink point. Prednost lidarskega digitalnega modela reliefa za raziskavo morfometrije vrtač v primerjavi s podatkovno bazo topografskih kart − primer Agteleškega krasa (Madžarska)Morfometrija vrtač je bila vedno v središču kraških geomorfoloških raziskav. V zadnjem času so pri raziskavah vrtač postale zelo razširjene metode, ki temeljijo na digitalnem modelu reliefa (DMR). Lidarski podatki zagotavljajo visoko ločljivostne DMR-je, razviti so bili avtomatski algoritmi za prepoznavanje vrtač. V tem prispevku smo na primeru Agteleškega krasa v severovzhodni Madžarski preizkusili različne podatkovne baze in algoritme za prepoznavanje vrtač. Primerjali smo tri podatkovne baze: "TOPO" vrtače so razmejene na klasičen način z zunanjo zaprto plastnico na topografski karti v merilu 1: 10.000, "KRIG" vrtače so v istem merilu s pomočjo kriginga samodejno pridobljene iz digitaliziranih plastnic DMR, in "LiDAR" vrtače so samodejno pridobljene iz DMR, ki je ustvarjen iz lidarskih podatkov. Najprej smo analizirali občutljivost avtomatske metode parametra "mejne globine", ki predstavlja prag, pod katerim se depresijske oblike štejejo kot "napake" in so zapolnjene. V konkretnem primeru smo glede na običajno velikost vrtače in ločljivosti DMR ugotovili, da je optimalna globinska meja za LiDAR ca. 0,5 m in 1 m za KRIG. Pri vseh podatkovnih bazah so bile statistične porazdelitve morfometrijskih lastnosti (logaritemska normalna porazdelitev za prostor in gama porazdelitev za globino) podobne, vendar metodologija, ki temelji na DMR privede do rezultatov, ki kažejo na večje vrtače v primerjavi s klasično metodo. Rezultati območij vrtač (in njihovih značilnosti) so pokazali zelo visoke korelacije med podatkovnimi nizi. Pri globinah so bile korelacije manjše in najnižje zabeležene korelacije (srednje močne) so bile med podatki različnih podatkovnih bazah. Histogrami naklona, izračunani iz lidarskih podatkov, so bili uporabljeni za združevanje vrtač, in ti grozdi razlikujejo vrtače glede na klasično razmerje med globino in premerom. Na koncu smo ugotovili, da lahko v konkretnem primeru dobro določimo morfometrične lastnosti vrtač s klasičnimi topografskimi metodami. Podrobnejše rezultate o globinah in oblikah lahko dosežemo na podlagi lidarskih podatkov.Ključne besede: morfometrija vrtač, LiDAR, interpolacija, histogram naklona, ponor

Time-varying Learning and Content Analytics via Sparse Factor Analysis

We propose SPARFA-Trace, a new machine learning-based framework for time-varying learning and content analytics for education applications. We develop a novel message passing-based, blind, approximate Kalman filter for sparse factor analysis (SPARFA), that jointly (i) traces learner concept knowledge over time, (ii) analyzes learner concept knowledge state transitions (induced by interacting with learning resources, such as textbook sections, lecture videos, etc, or the forgetting effect), and (iii) estimates the content organization and intrinsic difficulty of the assessment questions. These quantities are estimated solely from binary-valued (correct/incorrect) graded learner response data and a summary of the specific actions each learner performs (e.g., answering a question or studying a learning resource) at each time instance. Experimental results on two online course datasets demonstrate that SPARFA-Trace is capable of tracing each learner's concept knowledge evolution over time, as well as analyzing the quality and content organization of learning resources, the question-concept associations, and the question intrinsic difficulties. Moreover, we show that SPARFA-Trace achieves comparable or better performance in predicting unobserved learner responses than existing collaborative filtering and knowledge tracing approaches for personalized education