Addressing the challenges of implementation of high-order finite volume schemes for atmospheric dynamics of unstructured meshes

The solution of the non-hydrostatic compressible Euler equations using Weighted Essentially Non-Oscillatory (WENO) schemes in two and three-dimensional unstructured meshes, is presented. Their key characteristics are their simplicity; accuracy; robustness; non-oscillatory properties; versatility in handling any type of grid topology; computational and parallel efficiency. Their defining characteristic is a non-linear combination of a series of high-order reconstruction polynomials arising from a series of reconstruction stencils. In the present study an explicit TVD Runge-Kutta 3rd -order method is employed due to its lower computational resources requirement compared to implicit type time advancement methods. The WENO schemes (up to 5th -order) are applied to the two dimensional and three dimensional test cases: a 2D rising

A Review of Element-Based Galerkin Methods for Numerical Weather Prediction: Finite Elements, Spectral Elements, and Discontinuous Galerkin

Numerical weather prediction (NWP) is in a period of transition. As resolutions increase, global models are moving towards fully nonhydrostatic dynamical cores, with the local and global models using the same governing equations; therefore we have reached a point where it will be necessary to use a single model for both applications. The new dynamical cores at the heart of these unified models are designed to scale efficiently on clusters with hundreds of thousands or even millions of CPU cores and GPUs. Operational and research NWP codes currently use a wide range of numerical methods: finite differences, spectral transform, finite volumes and, increasingly, finite/spectral elements and discontinuous Galerkin, which constitute element-based Galerkin (EBG) methods.Due to their important role in this transition, will EBGs be the dominant power behind NWP in the next 10 years, or will they just be one of many methods to choose from? One decade after the review of numerical methods for atmospheric modeling by Steppeler et al. (Meteorol Atmos Phys 82:287–301, 2003), this review discusses EBG methods as a viable numerical approach for the next-generation NWP models. One well-known weakness of EBG methods is the generation of unphysical oscillations in advection-dominated flows; special attention is hence devoted to dissipation-based stabilization methods. Since EBGs are geometrically flexible and allow both conforming and non-conforming meshes, as well as grid adaptivity, this review is concluded with a short overview of how mesh generation and dynamic mesh refinement are becoming as important for atmospheric modeling as they have been for engineering applications for many years.The authors would like to thank Prof. Eugenio Oñate (U. Politècnica de Catalunya) for his invitation to submit this review article. They are also thankful to Prof. Dale Durran (U. Washington), Dr. Tommaso Benacchio (Met Office), and Dr. Matias Avila (BSC-CNS) for their comments and corrections, as well as insightful discussion with Sam Watson, Consulting Software Engineer (Exa Corp.) Most of the contribution to this article by the first author stems from his Ph.D. thesis carried out at the Barcelona Supercomputing Center (BSCCNS) and Universitat Politècnica de Catalunya, Spain, supported by a BSC-CNS student grant, by Iberdrola Energías Renovables, and by grant N62909-09-1-4083 of the Office of Naval Research Global. At NPS, SM, AM, MK, and FXG were supported by the Office of Naval Research through program element PE-0602435N, the Air Force Office of Scientific Research through the Computational Mathematics program, and the National Science Foundation (Division of Mathematical Sciences) through program element 121670. The scalability studies of the atmospheric model NUMA that are presented in this paper used resources of the Argonne Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC02-06CH11357. SM, MK, and AM are grateful to the National Research Council of the National Academies.Peer ReviewedPostprint (author's final draft

An adaptive discontinuous Galerkin method for the simulation of hurricane storm surge

Numerical simulations based on solving the 2D shallow water equations using a discontinuous Galerkin (DG) discretisation have evolved to be a viable tool for many geophysical applications. In the context of flood modelling, however, they have not yet been methodologically studied to a large extent. Systematic model testing is non-trivial as no comprehensive collection of numerical test cases exists to ensure the correctness of the implementation. Hence, the first part of this manuscript aims at collecting test cases from the literature that are generally useful for storm surge modellers and can be used to benchmark codes. On geographic scale, hurricane storm surge can be interpreted as a localised phenomenon making it ideally suited for adaptive mesh refinement (AMR). Past studies employing dynamic AMR have exclusively focused on nested meshes. For that reason, we have developed a DG storm surge model on a triangular and dynamically adaptive mesh. In order to increase computational efficiency, the refinement is driven by physics-based refinement indicators capturing major model sensitivities. Using idealised numerical test cases, we demonstrate the model’s ability to correctly represent all source terms and reproduce known variability of coastal flooding with respect to hurricane characteristics such as size and approach speed. Finally, the adaptive mesh significantly reduces computing time with no effect on storm waves measured at discrete wave gauges just off the coast which shows the model’s potential for use as a robust simulation tool for real-time predictions

An efficient Adaptive Mesh Refinement (AMR) algorithm for the Discontinuous Galerkin method: Applications for the computation of compressible two-phase flows

We present an Adaptive Mesh Refinement (AMR) method suitable for hybrid unstructured meshes that allows for local refinement and de-refinement of the computational grid during the evolution of the flow. The adaptive implementation of the Discontinuous Galerkin (DG) method introduced in this work (ForestDG) is based on a topological representation of the computational mesh by a hierarchical structure consisting of oct- quad- and binary trees. Adaptive mesh refinement (h-refinement) enables us to increase the spatial resolution of the computational mesh in the vicinity of the points of interest such as interfaces, geometrical features, or flow discontinuities. The local increase in the expansion order (p-refinement) at areas of high strain rates or vorticity magnitude results in an increase of the order of accuracy in the region of shear layers and vortices. A graph of unitarian-trees, representing hexahedral, prismatic and tetrahedral elements is used for the representation of the initial domain. The ancestral elements of the mesh can be split into self-similar elements allowing each tree to grow branches to an arbitrary level of refinement. The connectivity of the elements, their genealogy and their partitioning are described by linked lists of pointers. An explicit calculation of these relations, presented in this paper, facilitates the on-the-fly splitting, merging and repartitioning of the computational mesh by rearranging the links of each node of the tree with a minimal computational overhead. The modal basis used in the DG implementation facilitates the mapping of the fluxes across the non conformal faces. The AMR methodology is presented and assessed using a series of inviscid and viscous test cases. Also, the AMR methodology is used for the modelling of the interaction between droplets and the carrier phase in a two-phase flow. This approach is applied to the analysis of a spray injected into a chamber of quiescent air, using the Eulerian–Lagrangian approach. This enables us to refine the computational mesh in the vicinity of the droplet parcels and accurately resolve the coupling between the two phases

Variational multiscale stabilization of finite and spectral elements for dry and moist atmospheric problems

In this thesis the finite and spectral element methods (FEM and SEM, respectively) applied to problems in atmospheric simulations are explored through the common thread of Variational Multiscale Stabilization (VMS). This effort is justified by three main reasons. (i) the recognized need for new solvers that can efficiently execute on massively parallel architectures ¿a spreading framework in most fields of computational physics in which numerical weather prediction (NWP) occupies a prominent position. Element-based methods (e.g. FEM, SEM, discontinuous Galerkin) have important advantages in parallel code development; (ii) the inherent flexibility of these methods with respect to the geometry of the grid makes them a great candidate for dynamically adaptive atmospheric codes; and (iii) the localized diffusion provided by VMS represents an improvement in the accurate solution of multi-physics problems where artificial diffusion may fail. Its application to atmospheric simulations is a novel approach within a field of research that is still open. First, FEM and VMS are described and derived for the solution of stratified low Mach number flows in the context of dry atmospheric dynamics. The validity of the method to simulate stratified flows is assessed using standard two- and three-dimensional benchmarks accepted by NWP practitioners. The problems include thermal and gravity driven simulations. It will be shown that stability is retained in the regimes of interest and a numerical comparison against results from the the literature will be discussed. Second, the ability of VMS to stabilize the FEM solution of advection-dominated problems (i.e. Euler and transport equations) is taken further by the implementation of VMS as a stabilizing tool for high-order spectral elements with advection-diffusion problems. To the author¿s knowledge, this is an original contribution to the literature of high order spectral elements involved with transport in the atmosphere. The problem of monotonicity-preserving high order methods is addressed by combining VMS-stabilized SEM with a discontinuity capturing technique. This is an alternative to classical filters to treat the Gibbs oscillations that characterize high-order schemes. To conclude, a microphysics scheme is implemented within the finite element Euler solver, as a first step toward realistic atmospheric simulations. Kessler microphysics is used to simulate the formation of warm, precipitating clouds. This last part combines the solution of the Euler equations for stratified flows with the solution of a system of transport equations for three classes of water: water vapor, cloud water, and rain. The method is verified using idealized two- and three-dimensional storm simulations.En esta tesis los métodos de elementos finitos y espectrales (FEM - finite element method y SEM- spectral element method, respectivamente), aplicados a los problemas de simulaciones atmosféricas, se exploran a través del método de estabilización conocidocomo Variational Multiscale Stabilization (VMS). Tres razones fundamentales justifican este esfuerzo: (i) la necesidad de tener nuevos métodos de solución de las ecuaciones diferenciales a las derivadas parciales usando máquinas paralelas de gran escala –un entorno en expansión en muchos campos de la mecánica computacional, dentro de la cual la predicción numérica de la dinámica atmosférica (NWP-numerical weather prediction)representa una aplicación importante. Métodos del tipo basado en elementos(por ejemplo, FEM, SEM, Galerkin discontinuo) presentan grandes ventajas en el desarrollo de códigos paralelos; (ii) la flexibilidad intrínseca de tales métodos respecto a lageometría de la malla computacional hace que esos métodos sean los candidatos ideales para códigos atmosféricos con mallas adaptativas; y (iii) la difusión localizada que VMSintroduce representa una mejora en las soluciones de problemas con física compleja en los cuales la difusión artificial clásica no funcionaría. La aplicación de FEM o SEM con VMS a problemas de simulaciones atmosféricas es una estrategia innovadora en un campo de investigación abierto. En primera instancia, FEM y VMS vienen descritos y derivados para la solución de flujos estratificados a bajo número de Mach en el contexto de la dinámica atmosférica. La validez del método para simular flujos estratificados es verificada por medio de test estándar aceptado por la comunidad dentro del campo deNWP. Los test incluyen simulaciones de flujos térmicos con efectos de gravedad. Se demostrará que la estabilidad del método numérico se preserva dentro de los regímenesde interés y se discutirá una comparación numérica de los resultados frente a aquellos hallados en la literatura. En segunda instancia, la capacidad de VMS para estabilizarmétodos FEM en problemas de advección dominante (i.e. ecuaciones de Euler y ecuaciones de transporte) se implementa además en la solución a elementos espectrales de alto orden en problemas de advección-difusión. Hasta donde el autor sabe, esta es una contribución original a la literatura de métodos basados en elementos espectrales en problemas de transporte atmosférico. El problema de monotonicidad con métodos de alto orden es tratado mediante la combinación de SEM+VMS con una técnica de shockcapturing para un mejor tratamiento de las discontinuidades. Esta es una alternativa a los filtros que normalmente se aplican a SEM para eilminar las oscilaciones de Gibbsque caracterizan las soluciones de alto orden. Como último punto, se implementa un esquema de humedad acoplado con el núcleo en elementos finitos; este es un primer paso hacia simulaciones atmosféricas más realistas. La microfísica de Kessler se emplea para simular la formación de nubes y tormentas cálidas (warm clouds: no permite la formación de hielo). Esta última parte combina la solución de las ecuaciones de Eulerpara atmósferas estratificadas con la solución de un sistema de ecuaciones de transporte de tres estados de agua: vapor, nubes y lluvia. La calidad del método es verificadautilizando simulaciones de tormenta en dos y tres dimensiones

Das unstetige Galerkinverfahren für Strömungen mit freier Oberfläche und im Grundwasserbereich in geophysikalischen Anwendungen

Free surface flows and subsurface flows appear in a broad range of geophysical applications and in many environmental settings situations arise which even require the coupling of free surface and subsurface flows. Many of these application scenarios are characterized by large domain sizes and long simulation times. Hence, they need considerable amounts of computational work to achieve accurate solutions and the use of efficient algorithms and high performance computing resources to obtain results within a reasonable time frame is mandatory. Discontinuous Galerkin methods are a class of numerical methods for solving differential equations that share characteristics with methods from the finite volume and finite element frameworks. They feature high approximation orders, offer a large degree of flexibility, and are well-suited for parallel computing. This thesis consists of eight articles and an extended summary that describe the application of discontinuous Galerkin methods to mathematical models including free surface and subsurface flow scenarios with a strong focus on computational aspects. It covers discretization and implementation aspects, the parallelization of the method, and discrete stability analysis of the coupled model.Für viele geophysikalische Anwendungen spielen Strömungen mit freier Oberfläche und im Grundwasserbereich oder sogar die Kopplung dieser beiden eine zentrale Rolle. Oftmals charakteristisch für diese Anwendungsszenarien sind große Rechengebiete und lange Simulationszeiten. Folglich ist das Berechnen akkurater Lösungen mit beträchtlichem Rechenaufwand verbunden und der Einsatz effizienter Lösungsverfahren sowie von Techniken des Hochleistungsrechnens obligatorisch, um Ergebnisse innerhalb eines annehmbaren Zeitrahmens zu erhalten. Unstetige Galerkinverfahren stellen eine Gruppe numerischer Verfahren zum Lösen von Differentialgleichungen dar, und kombinieren Eigenschaften von Methoden der Finiten Volumen- und Finiten Elementeverfahren. Sie ermöglichen hohe Approximationsordnungen, bieten einen hohen Grad an Flexibilität und sind für paralleles Rechnen gut geeignet. Diese Dissertation besteht aus acht Artikeln und einer erweiterten Zusammenfassung, in diesen die Anwendung unstetiger Galerkinverfahren auf mathematische Modelle inklusive solcher für Strömungen mit freier Oberfläche und im Grundwasserbereich beschrieben wird. Die behandelten Themen umfassen Diskretisierungs- und Implementierungsaspekte, die Parallelisierung der Methode sowie eine diskrete Stabilitätsanalyse des gekoppelten Modells

Metrics for Performance Quantification of Adaptive Mesh Refinement

Non-uniform, dynamically adaptive meshes are a useful tool for reducing computational complexities for geophysical simulations that exhibit strongly localised features such as is the case for tsunami, hurricane or typhoon prediction. Using the example of a shallow water solver, this study explores a set of metrics as a tool to distinguish the performance of numerical methods using adaptively refined versus uniform meshes independent of computational architecture or implementation. These metrics allow us to quantify how a numerical simulation benefits from the use of adaptive mesh refinement. The type of meshes we are focusing on are adaptive triangular meshes that are non-uniform and structured. Refinement is controlled by physics-based indicators that capture relevant physical processes and determine the areas of mesh refinement and coarsening. The proposed performance metrics take into account a number of characteristics of numerical simulations such as numerical errors, spatial resolution, as well as computing time. Using a number of test cases we demonstrate that correlating different quantities offers insight into computational overhead, the distribution of numerical error across various mesh resolutions as well as the evolution of numerical error and run-time per degree of freedom

A comparison of interpolation techniques for non-conformal high-order discontinuous Galerkin methods

The capability to incorporate moving geometric features within models for complex simulations is a common requirement in many fields. Fluid mechanics within aeronautical applications, for example, routinely feature rotating (e.g. turbines, wheels and fan blades) or sliding components (e.g. in compressor or turbine cascade simulations). With an increasing trend towards the high-fidelity modelling of these cases, in particular combined with the use of high-order discontinuous Galerkin methods, there is therefore a requirement to understand how different numerical treatments of the interfaces between the static mesh and the sliding/rotating part impact on overall solution quality. In this article, we compare two different approaches to handle this non-conformal interface. The first is the so-called mortar approach, where flux integrals along edges are split according to the positioning of the non-conformal grid. The second is a less-documented point-to-point interpolation method, where the interior and exterior quantities for flux evaluations are interpolated from elements lying on the opposing side of the interface. Although the mortar approach has significant advantages in terms of its numerical properties, in that it preserves the local conservation properties of DG methods, in the context of complex 3D meshes it poses notable implementation difficulties which the point-to-point method handles more readily. In this paper we examine the numerical properties of each method, focusing not only on observing convergence orders for smooth solutions, but also how each method performs in under-resolved simulations of linear and nonlinear hyperbolic problems, to inform the use of these methods in implicit large-eddy simulations.Comment: 37 pages, 15 figures, 5 tables, submitted to Computer Methods in Applied Mechanics and Engineering, revision