Optimization and Portability of a Fusion OpenACC-based FORTRAN HPC Code from NVIDIA to AMD GPUs

NVIDIA has been the main provider of GPU hardware in HPC systems for over a decade. Most applications that benefit from GPUs have thus been developed and optimized for the NVIDIA software stack. Recent exascale HPC systems are, however, introducing GPUs from other vendors, e.g. with the AMD GPU-based OLCF Frontier system just becoming available. AMD GPUs cannot be directly accessed using the NVIDIA software stack, and require a porting effort by the application developers. This paper provides an overview of our experience porting and optimizing the CGYRO code, a widely-used fusion simulation tool based on FORTRAN with OpenACC-based GPU acceleration. While the porting from the NVIDIA compilers was relatively straightforward using the CRAY compilers on the AMD systems, the performance optimization required more fine-tuning. In the optimization effort, we uncovered code sections that had performed well on NVIDIA GPUs, but were unexpectedly slow on AMD GPUs. After AMD-targeted code optimizations, performance on AMD GPUs has increased to meet our expectations. Modest speed improvements were also seen on NVIDIA GPUs, which was an unexpected benefit of this exercise.Comment: 6 pages, 4 figures, 2 tables, To be published in Proceedings of PEARC2

Impurity transport in Alcator C-Mod in the presence of poloidal density variation induced by ion cyclotron resonance heating

Impurity particle transport in an ion cyclotron resonance heated Alcator C-Mod discharge is studied with local gyrokinetic simulations and a theoretical model including the effect of poloidal asymmetries and elongation. In spite of the strong minority temperature anisotropy in the deep core region, the poloidal asymmetries are found to have a negligible effect on the turbulent impurity transport due to low magnetic shear in this region, in agreement with the experimental observations. According to the theoretical model, in outer core regions poloidal asymmetries may contribute to the reduction of the impurity peaking, but uncertainties in atomic physics processes prevent quantitative comparison with experiments.Comment: 32 pages, 12 figure

The KMOS3D Survey: Rotating Compact Star-forming Galaxies and the Decomposition of Integrated Line Widths

Using integral field spectroscopy, we investigate the kinematic properties of 35 massive centrally dense and compact star-forming galaxies (SFGs; logM[Ṁ] = 11.1, log (σ 1kpc[Ṁ kpc-2]) > 9.5 log (M∗/re1.5 (Ṁ kpc1.5])> 10.3) at z ∼ 0.7-3.7within the KMOS3D survey. We spatially resolve 23 compact SFGs and find that the majority are dominated by rotational motions with velocities ranging from 95 to 500 km s-1. The range of rotation velocities is reflected in a similar range of integrated 1DUMMYα line widths, 75400 km s-1, consistent with the kinematic properties of mass-matched extended galaxies from the full KMOS3D sample. The fraction of compact SFGs that are classified as rotation-dominated" or "disklike" also mirrors the fractions of the full KMOS3D sample. We show that integrated lineof-sight gas velocity dispersions from KMOS3Dare best approximated by a linear combination of their rotation and turbulent velocities with a lesser but still significant contribution from galactic-scale winds. The 1DUMMYα exponential disk sizes of compact SFGs are, on average, 2.5 ± 0.2 kpc, 1-2 × the continuum sizes, in agreement with previous work. The compact SFGs have a 1.4 × higher active galactic nucleus (AGN) incidence than the full KMOS3D sample at fixed stellar mass with an average AGN fraction of 76%. Given their high and centrally concentrated stellar masses, as well as stellar-to-dynamical mass ratios close to unity, the compact SFGs are likely to have low molecular gas fractions and to quench on a short timescale unless replenished with inflowing gas. The rotation in these compact systems suggests that their direct descendants are rotating passive galaxies.DJW and MF acknowledge the support of the Deutsche Forschungsgemeinschaft via Project IDs 3871/1-1 and 3871/1-2. EW acknowledges the support of ASTRO 3D funding for the writing retreat used to bring this paper to completion. Parts of this research were conducted by the Australian Research Council Centre of Excellence for All Sky Astrophysics in 3 Dimensions (ASTRO 3D) through project number CE170100013

Expansion rate measurements at moderate pressure of non-neutral electron plasmas in the Electron Diffusion Gauge (EDG) experiment

Measurements of the expansion rate of pure-electron plasmas have been performed on the Electron Diffusion Gauge (EDG) device at background helium gas pressures in the 5 x 10(superscript -8) Torr to 1 x 10(superscript -5) Torr range, where plasma expansion due to electron-neutral collisions dominates over plasma expansion due to trap asymmetries. It is found that the expansion rate, defined as the time rate of change of the particles' mean-square radius, scales approximately linearly with pressure and inversely as the square of the magnetic field strength in this regime, in agreement with classical predictions

Microtearding mode study in NSTX using machine learning enhanced reduced model

This article presents a survey of NSTX cases to study the microtearing mode (MTM) stabilities using the newly developed global reduced model for Slab-Like Microtearing modes (SLiM). A trained neutral network version of SLiM enables rapid assessment (0.05s/mode) of MTM with $98\%$ accuracy providing an opportunity for systemic equilibrium reconstructions based on the matching of experimentally observed frequency bands and SLiM prediction across a wide range of parameters. Such a method finds some success in the NSTX discharges, the frequency observed in the experiment matches with what SLiM predicted. Based on the experience with SLiM analysis, a workflow to estimate the potential MTM frequency for a quick assessment based on experimental observation has been established

Structural Evolution in Massive Galaxies at z ~ 2

We present 0.2arcsec-resolution Atacama Large Millimeter/submillimeter Array observations at 870 $\mu$m in a stellar mass-selected sample of 85 massive ($M_\mathrm{star}>10^{11}~M_\odot$) star-forming galaxies (SFGs) at z=1.9-2.6 in the 3D-HST/CANDELS fields of UDS and GOODS-S. We measure the effective radius of the rest-frame far-infrared (FIR) emission for 62 massive SFGs. They are distributed over wide ranges of FIR size from $R_\mathrm{e,FIR}=$0.4 kpc to $R_\mathrm{e,FIR}=$6 kpc. The effective radius of the FIR emission is smaller by a factor of 2.3$^{+1.9}_{-1.0}$ than the effective radius of the optical emission and by a factor of 1.9$^{+1.9}_{-1.0}$ smaller than the half-mass radius. Even with taking into account potential extended components, the FIR size would change by ~10%. By combining the spatial distributions of the FIR and optical emission, we investigate how galaxies change the effective radius of the optical emission and the stellar mass within a radius of 1 kpc, $M_\mathrm{1kpc}$. The compact starburst puts most of massive SFGs on the mass--size relation for quiescent galaxies (QGs) at z~2 within 300 Myr if the current star formation activity and its spatial distribution are maintained. We also find that within 300 Myr, ~38% of massive SFGs can reach the central mass of $M_\mathrm{1kpc}=10^{10.5}~M_\odot$, which is around the boundary between massive SFGs and QGs. These results suggest an outside-in transformation scenario in which a dense core is formed at the center of a more extended disk, likely via dissipative in-disk inflows. Synchronized observations at ALMA 870 $\mu$m and JWST 3-4 $\mu$m will explicitly verify this scenario.Comment: 25 pages, 15 figures, 3 tables, accepted for publication in Ap

Structural Evolution in Massive Galaxies at z ~ 2

We present 0."2 resolution Atacama Large Millimeter/submillimeter Array (ALMA) observations at 870 μm in a stellar mass-selected sample of 85 massive (M* > 10^11 Mo) star-forming galaxies (SFGs) at z=1.9-2.6 in the CANDELS/3D-Hubble Space Telescope fields of UDS and GOODS-S. We measure the effective radius of the rest-frame far-infrared (FIR) emission for 62 massive SFGs. They are distributed over wide ranges of FIR size from Re,FIR = 0.4 kpc to Re,FIR = 6 kpc. The effective radius of the FIR emission is smaller by a factor of 2.3-1.0+1.9 than the effective radius of the optical emission and is smaller by a factor of 1.9-1.0+1.9 than the half-mass radius. Taking into account potential extended components, the FIR size would change only by ~10%. By combining the spatial distributions of the FIR and optical emission, we investigate how galaxies change the effective radius of the optical emission and the stellar mass within a radius of 1 kpc, M1kpc. The compact starburst puts most of the massive SFGs on the mass-size relation for quiescent galaxies (QGs) at z ~ 2 within 300 Myr if the current star formation activity and its spatial distribution are maintained. We also find that within 300 Myr, ~38% of massive SFGs can reach the central mass of M1kpc = 10^10.5 Mo, which is around the boundary between massive SFGs and QGs. These results suggest an outside-in transformation scenario in which a dense core is formed at the center of a more extended disk, likely via dissipative in-disk inflows. Synchronized observations at ALMA 870 μm and James Webb Space Telescope 3-4 μm will explicitly verify this scenario.K.T. acknowledges support by JSPS KAKENHI grant no. JP20K14526. The Nordic ARC node is funded through Swedish Research Council grant no. 2017-00648

Kiloparsec Scale Properties of Star Formation Driven Outflows at z~ 2.3 in the SINS/zC-SINF AO Survey

We investigate the relationship between star formation activity and outflow properties on kiloparsec scales in a sample of 28 star-forming galaxies at z ~ 2–2.6, using adaptive optics assisted integral field observations from SINFONI on the Very Large Telescope. The narrow and broad components of the Hα emission are used to simultaneously determine the local star formation rate surface density (${{\rm{\Sigma }}}_{\mathrm{SFR}}$), and the outflow velocity ${v}_{\mathrm{out}}$ and mass outflow rate ${\dot{M}}_{\mathrm{out}}$, respectively. We find clear evidence for faster outflows with larger mass loading factors at higher ${{\rm{\Sigma }}}_{\mathrm{SFR}}$. The outflow velocities scale as ${v}_{\mathrm{out}}$ ∝ ${{\rm{\Sigma }}}_{\mathrm{SFR}}$ 0.34±0.10, which suggests that the outflows may be driven by a combination of mechanical energy released by supernova explosions and stellar winds, as well as radiation pressure acting on dust grains. The majority of the outflowing material does not have sufficient velocity to escape from the galaxy halos, but will likely be re-accreted and contribute to the chemical enrichment of the galaxies. In the highest ${{\rm{\Sigma }}}_{\mathrm{SFR}}$ regions the outflow component contains an average of ~45% of the Hα flux, while in the lower ${{\rm{\Sigma }}}_{\mathrm{SFR}}$ regions only ~10% of the Hα flux is associated with outflows. The mass loading factor, η = ${\dot{M}}_{\mathrm{out}}$/SFR, is positively correlated with ${{\rm{\Sigma }}}_{\mathrm{SFR}}$ but is relatively low even at the highest ${{\rm{\Sigma }}}_{\mathrm{SFR}}$: η lesssim 0.5 × (380 cm−3/n e ). This may be in tension with the η gsim 1 required by cosmological simulations, unless a significant fraction of the outflowing mass is in other gas phases and has sufficient velocity to escape the galaxy halos.S.T. is supported by the Smithsonian Astrophysical Observatory through the CfA Fellowship