24 research outputs found

    Spatial Regression With Multiplicative Errors, and Its Application With Lidar Measurements

    Full text link
    Multiplicative errors in addition to spatially referenced observations often arise in geodetic applications, particularly in surface estimation with light detection and ranging (LiDAR) measurements. However, spatial regression involving multiplicative errors remains relatively unexplored in such applications. In this regard, we present a penalized modified least squares estimator to handle the complexities of a multiplicative error structure while identifying significant variables in spatially dependent observations for surface estimation. The proposed estimator can be also applied to classical additive error spatial regression. By establishing asymptotic properties of the proposed estimator under increasing domain asymptotics with stochastic sampling design, we provide a rigorous foundation for its effectiveness. A comprehensive simulation study confirms the superior performance of our proposed estimator in accurately estimating and selecting parameters, outperforming existing approaches. To demonstrate its real-world applicability, we employ our proposed method, along with other alternative techniques, to estimate a rotational landslide surface using LiDAR measurements. The results highlight the efficacy and potential of our approach in tackling complex spatial regression problems involving multiplicative errors

    Prediction of Tropical Pacific Rain Rates with Over-parameterized Neural Networks

    Full text link
    The prediction of tropical rain rates from atmospheric profiles poses significant challenges, mainly due to the heavy-tailed distribution exhibited by tropical rainfall. This study introduces over-parameterized neural networks not only to forecast tropical rain rates, but also to explain their heavy-tailed distribution. The prediction is separately conducted for three rain types (stratiform, deep convective, and shallow convective) observed by the Global Precipitation Measurement satellite radar over the West and East Pacific regions. Atmospheric profiles of humidity, temperature, and zonal and meridional winds from the MERRA-2 reanalysis are considered as features. Although over-parameterized neural networks are well-known for their "double descent phenomenon," little has been explored about their applicability to climate data and capability of capturing the tail behavior of data. In our results, over-parameterized neural networks accurately predict the rain rate distributions and outperform other machine learning methods. Spatial maps show that over-parameterized neural networks also successfully describe spatial patterns of each rain type across the tropical Pacific. In addition, we assess the feature importance for each over-parameterized neural network to provide insight into the key factors driving the predictions, with low-level humidity and temperature variables being the overall most important. These findings highlight the capability of over-parameterized neural networks in predicting the distribution of the rain rate and explaining extreme values

    A Tool For Automatic Estimation Of The Stage Height For Ungauged River Sites

    Full text link
    Recently, River Information Systems that integrate a variety of riverine information have been widely developed, driven by information technologies. The present study attempts to develop a software called HydroConnector that dynamically integrates river-based numerical modeling or post-processing with in situ data, based upon a data searching technique that uses a hydro web service built on top of an ODM-based database, following a CUAHSI standard. It fundamentally differs from the conventional direct access to the database for acquiring a given period of a dataset. Such a hydro web service and ODM-based database were built by utilizing existing real-time stream gaging data, and they are dynamically connected with an HPG model that estimates the stage height for an ungaged site. As a result, the newly developed HydroConnector is very intuitive for the user, due to the user-friendly GUI; it facilitates modeling processes by automatically connecting remotely located data and a specific numerical model, without further laborious data pre- and post-processing. In fact, the HPG model consists of a pre-established diagram based on simulated outputs from one-dimensional river models, such as HEC-RAS, operated for the possible flow conditions, and it is able to estimate the stage height for an ungaged site, driven by the given downstream stage height and upstream flow discharge. The HydroConnector incorporates both the web service and the HPG model, which enables the making of dynamic data pre-processing adjusted for the numerical model, and automatically operates the HPG model, to finally provide the targeted ungaged stage height. Acknowledgement This research was supported by a grant (11-TI-C06) from the Advanced Water Management Research Program, funded by the Ministry of Land, Infrastructure and Transport of the Korean government

    Robust estimation of bacterial cell count from optical density

    Get PDF
    Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

    Architecture-based and target-oriented algorithm optimization of high-order methods via complete-search tensor contraction

    No full text
    Sophisticated solution algorithms, along with complex data structures, are known as the main barriers that hinder high-order methods from being actively embraced by industry and academia. Simultaneously, modern computing machines offer a wide variety of opportunities to enhance the performance of solution algorithms through highly tuned computational kernels. To address this issue, we present an architecture-based and target-oriented algorithm optimization for high-order methods, called completesearch tensor contraction (CsTC). The key idea of CsTC is to convert the tensor operations of a high-order method into an optimization problem, which leads to finding an optimized method to execute tensor contraction (TC). After introducing the general framework of CsTC, it was applied to the discontinuous Galerkin (DG) discretization. An approach based on general matrix multiplication (GEMM) is adopted because of its flexibility to handle the intermediate order of TC and the reusability of state-of-the-art GEMM primitives. By optimizing data structures as well as TC operations, CsTC provides an optimized solution algorithm that performs significantly better than the original non-optimized high-order method. The entire optimization process is automatically completed in a few minutes at a pre-processing step on a computer. The proposed CsTC optimization fully reflects the mesh and solution parameters adopted as well as the computing architecture used, thus, it is completely target-oriented and architecture-based. Various solution parameters and computing architectures are used and compared. All the results indicate that the optimization is essential to extract the best performance from a given computing architecture and that the performance enhancement becomes substantial as the DG approximation order increases and as a more recent processor is employed. Finally, a 3-D viscous flow problem governed by the compressible Navier-Stokes equations is solved. The optimized algorithm yields more than 10 x speedup compared to the algorithm with a nested-loop approach when DG-P3and DG-P5approximations are used. (C) 2021 Elsevier B.V. All rights reserved.N

    Development of an Image Registration Technique for Fluvial Hyperspectral Imagery Using an Optical Flow Algorithm

    No full text
    Fluvial remote sensing has been used to monitor diverse riverine properties through processes such as river bathymetry and visual detection of suspended sediment, algal blooms, and bed materials more efficiently than laborious and expensive in-situ measurements. Red–green–blue (RGB) optical sensors have been widely used in traditional fluvial remote sensing. However, owing to their three confined bands, they rely on visual inspection for qualitative assessments and are limited to performing quantitative and accurate monitoring. Recent advances in hyperspectral imaging in the fluvial domain have enabled hyperspectral images to be geared with more than 150 spectral bands. Thus, various riverine properties can be quantitatively characterized using sensors in low-altitude unmanned aerial vehicles (UAVs) with a high spatial resolution. Many efforts are ongoing to take full advantage of hyperspectral band information in fluvial research. Although geo-referenced hyperspectral images can be acquired for satellites and manned airplanes, few attempts have been made using UAVs. This is mainly because the synthesis of line-scanned images on top of image registration using UAVs is more difficult owing to the highly sensitive and heavy image driven by dense spatial resolution. Therefore, in this study, we propose a practical technique for achieving high spatial accuracy in UAV-based fluvial hyperspectral imaging through efficient image registration using an optical flow algorithm. Template matching algorithms are the most common image registration technique in RGB-based remote sensing; however, they require many calculations and can be error-prone depending on the user, as decisions regarding various parameters are required. Furthermore, the spatial accuracy of this technique needs to be verified, as it has not been widely applied to hyperspectral imagery. The proposed technique resulted in an average reduction of spatial errors by 91.9%, compared to the case where the image registration technique was not applied, and by 78.7% compared to template matching

    Direct reconstruction method for discontinuous Galerkin methods on higher-order mixed-curved meshes I. Volume integration

    No full text
    This work deals with the development of the direct reconstruction method (DRM) and its application to the volume integration of the discontinuous Galerkin (DG) method on multi-dimensional high-order mixed-curved meshes. The conventional quadrature-based DG methods require the humongous computational cost on high-order curved elements due to their non-linear shape functions. To overcome this issue, the flux function is directly reconstructed in the physical domain using nodal polynomials on a target space in a quadrature-free manner. Regarding the target space and distribution of the nodal points, DRM has two variations: the brute force points (BFP) and shape function points (SFP) methods. In both methods, one nodal point corresponds to one nodal basis function of the target space. The DRM-BFP method uses a set of points that empirically minimizes a condition number of the generalized Vandermonde matrix. In the DRM-SFP method, the conventional nodal points are used to span an enlarged target space of the flux function. It requires a larger number of reconstruction points than DRM-BFP but offers easy extendability to the higher-degree polynomial space and a better de-aliasing effect. A robust way to compute orthonormal polynomials is provided to achieve lower round-off errors. The proposed methods are validated by the 2-D/3-D Navier-Stokes equations on high-order mixed-curved meshes. The numerical results confirm that the DRM volume integration greatly reduces the computational cost and memory overhead of the conventional quadrature-based DG methods on high-order curved meshes while maintaining an optimal order-of-accuracy as well as resolving the flow physics accurately.N

    Analysis of the bubble size distribution in a breaking wave using a VOF method and an identification algorithm

    No full text
    A numerical simulation of a three-dimensional breaking wave is conducted using a VOF (volume-of-fluid) method to investigate the wave breaking dynamics and the bubble size distribution. The wave is initialized using the third-order Stokes wave solution. The initial wave slope and velocity fields generate turbulent wave breaking. Various interfacial phenomena are observed including a jet forming, a jet impacting to the free-surface, ejecting spray, entraining air pocket, and breakup. Bubbles with various sizes are formed from turbulent breakup of the air pocket during active breaking time. To obtain the bubble size distribution, an identification algorithm is proposed to accurately count independent bubbles. The proposed algorithm successfully identified independent bubble structures. A joining algorithm is also introduced to consider bubble structures spanning multiple blocks for parallel computations. The obtained bubble size distribution averaged during active breaking time is proportional to r^-10/3 for radii larger than the Hinze scale and shows good agreement with previous experiment and simulation results as well as the theoretical model.22Ykc

    Numerical simulation of bubble-particle interaction in an inclusion removal process

    No full text
    1

    Application of the parallel diagonal dominant algorithm for the incompressible Navier-Stokes equations

    No full text
    The accuracy and the applicability of the parallel diagonal dominant (PDD) algorithm are explored for highly scalable computation of the incompressible Navier-Stokes equations which are integrated using a fully-implicit fractional-step method in parallel computational environments. The PDD algorithm is known to be applicable only for an evenly diagonal dominant matrix. In the present study, however, it is shown mathematically that the PDD algorithm is utilizable even for non-diagonal dominant matrices derived from discretization of incompressible momentum equations. The order of accuracy and the error characteristics are investigated in detail in terms of the Courant-Friedrichs-Lewy (CFL) number and the grid spacing by conducting simulations of decaying vortices in both two and three dimensions, flow in a lid-driven cavity, and flow over a circular cylinder. In order to reduce communication cost, which is one of bottlenecks in parallel computation, an aggregative data communication method is combined with the PDD algorithm. Parallel performance of the present PDD-based method is investigated by measuring the speedup, efficiency, overhead, and serial fraction. (C) 2020 Elsevier Inc. All rights reserved.11Nsciescopu
    corecore