Evaluating generative models in high energy physics

There has been a recent explosion in research into machine-learning-based generative modeling to tackle computational challenges for simulations in high energy physics (HEP). In order to use such alternative simulators in practice, we need well-defined metrics to compare different generative models and evaluate their discrepancy from the true distributions. We present the first systematic review and investigation into evaluation metrics and their sensitivity to failure modes of generative models, using the framework of two-sample goodness-of-fit testing, and their relevance and viability for HEP. Inspired by previous work in both physics and computer vision, we propose two new metrics, the Fr\'echet and kernel physics distances (FPD and KPD, respectively), and perform a variety of experiments measuring their performance on simple Gaussian-distributed, and simulated high energy jet datasets. We find FPD, in particular, to be the most sensitive metric to all alternative jet distributions tested and recommend its adoption, along with the KPD and Wasserstein distances between individual feature distributions, for evaluating generative models in HEP. We finally demonstrate the efficacy of these proposed metrics in evaluating and comparing a novel attention-based generative adversarial particle transformer to the state-of-the-art message-passing generative adversarial network jet simulation model. The code for our proposed metrics is provided in the open source JetNet Python library.Comment: 11 pages, 5 figures, 3 tables, and a 5 page appendi

Particle-based Fast Jet Simulation at the LHC with Variational Autoencoders

We study how to use Deep Variational Autoencoders for a fast simulation of jets of particles at the LHC. We represent jets as a list of constituents, characterized by their momenta. Starting from a simulation of the jet before detector effects, we train a Deep Variational Autoencoder to return the corresponding list of constituents after detection. Doing so, we bypass both the time-consuming detector simulation and the collision reconstruction steps of a traditional processing chain, speeding up significantly the events generation workflow. Through model optimization and hyperparameter tuning, we achieve state-of-the-art precision on the jet four-momentum, while providing an accurate description of the constituents momenta, and an inference time comparable to that of a rule-based fast simulation.Comment: 11 pages, 8 figure

Graph Generative Adversarial Networks for Sparse Data Generation in High Energy Physics

We develop a graph generative adversarial network to generate sparse data sets like those produced at the CERN Large Hadron Collider (LHC). We demonstrate this approach by training on and generating sparse representations of MNIST handwritten digit images and jets of particles in proton-proton collisions like those at the LHC. We find the model successfully generates sparse MNIST digits and particle jet data. We quantify agreement between real and generated data with a graph-based Fr\'echet Inception distance, and the particle and jet feature-level 1-Wasserstein distance for the MNIST and jet datasets respectively

Sparse Data Generation for Particle-Based Simulation of Hadronic Jets in the LHC

We develop a generative neural network for the generation of sparse data in particle physics using a permutation-invariant and physics-informed loss function. The input dataset used in this study consists of the particle constituents of hadronic jets due to its sparsity and the possibility of evaluating the network's ability to accurately describe the particles and jets properties. A variational autoencoder composed of convolutional layers in the encoder and decoder is used as the generator. The loss function consists of a reconstruction error term and the Kullback-Leibler divergence between the output of the encoder and the latent vector variables. The permutation-invariant loss on the particles' properties is combined with two mean-squared error terms that measure the difference between input and output jets mass and transverse momentum, which improves the network's generation capability as it imposes physics constraints, allowing the model to learn the kinematics of the jets

LHC hadronic jet generation using convolutional variational autoencoders with normalizing flows

In high energy physics, one of the most important processes for collider data analysis is the comparison of collected and simulated data. Nowadays the state-of-the-art for data generation is in the form of Monte Carlo (MC) generators. However, because of the upcoming high-luminosity upgrade of the Large Hadron Collider (LHC), there will not be enough computational power or time to match the amount of needed simulated data using MC methods. An alternative approach under study is the usage of machine learning generative methods to fulfill that task. Since the most common final-state objects of high-energy proton collisions are hadronic jets, which are collections of particles collimated in a given region of space, this work aims to develop a convolutional variational autoencoder (ConVAE) for the generation of particle-based LHC hadronic jets. Given the ConVAE’s limitations, a normalizing flow (NF) network is coupled to it in a two-step training process, which shows improvements on the results for the generated jets. The ConVAE+NF network is capable of generating a jet in $18.30 \pm 0.04\,\,{\mu\text{s}}$ , making it one of the fastest methods for this task up to now

Measurement of the double-differential inclusive jet cross section in proton-proton collisions at s\sqrt{s} = 5.02 TeV

International audienceThe inclusive jet cross section is measured as a function of jet transverse momentum $p_\mathrm{T}$ and rapidity $y$. The measurement is performed using proton-proton collision data at $\sqrt{s}$ = 5.02 TeV, recorded by the CMS experiment at the LHC, corresponding to an integrated luminosity of 27.4 pb$^{-1}$. The jets are reconstructed with the anti-$k_\mathrm{T}$ algorithm using a distance parameter of $R$ = 0.4, within the rapidity interval $\lvert y\rvert$$\lt$ 2, and across the kinematic range 0.06 $\lt$$p_\mathrm{T}$$\lt$ 1 TeV. The jet cross section is unfolded from detector to particle level using the determined jet response and resolution. The results are compared to predictions of perturbative quantum chromodynamics, calculated at both next-to-leading order and next-to-next-to-leading order. The predictions are corrected for nonperturbative effects, and presented for a variety of parton distribution functions and choices of the renormalization/factorization scales and the strong coupling $\alpha_\mathrm{S}$

Measurement of the double-differential inclusive jet cross section in proton-proton collisions at s= \sqrt{s} = 5.02 TeV

The inclusive jet cross section is measured as a function of jet transverse momentum $p_{\mathrm{T}}$ and rapidity $y$. The measurement is performed using proton-proton collision data at $\sqrt{s} =$ 5.02 TeV, recorded by the CMS experiment at the LHC, corresponding to an integrated luminosity of 27.4$\,\text{pb}^{-1}$. The jets are reconstructed with the anti-$k_{\mathrm{T}}$ algorithm using a distance parameter of $R=$ 0.4, within the rapidity interval $|y| <$ 2, and across the kinematic range 0.06 $< p_{\mathrm{T}} <$ 1 TeV. The jet cross section is unfolded from detector to particle level using the determined jet response and resolution. The results are compared to predictions of perturbative quantum chromodynamics, calculated at both next-to-leading order and next-to-next-to-leading order. The predictions are corrected for nonperturbative effects, and presented for a variety of parton distribution functions and choices of the renormalization/factorization scales and the strong coupling $\alpha_\mathrm{S}$.The inclusive jet cross section is measured as a function of jet transverse momentum $p_\mathrm{T}$ and rapidity $y$. The measurement is performed using proton-proton collision data at $\sqrt{s}$ = 5.02 TeV, recorded by the CMS experiment at the LHC, corresponding to an integrated luminosity of 27.4 pb$^{-1}$. The jets are reconstructed with the anti-$k_\mathrm{T}$ algorithm using a distance parameter of $R$ = 0.4, within the rapidity interval $\lvert y\rvert$$\lt$ 2, and across the kinematic range 0.06 $\lt$$p_\mathrm{T}$$\lt$ 1 TeV. The jet cross section is unfolded from detector to particle level using the determined jet response and resolution. The results are compared to predictions of perturbative quantum chromodynamics, calculated at both next-to-leading order and next-to-next-to-leading order. The predictions are corrected for nonperturbative effects, and presented for a variety of parton distribution functions and choices of the renormalization/factorization scales and the strong coupling $\alpha_\mathrm{S}$

Measurement of the double-differential inclusive jet cross section in proton-proton collisions at s\sqrt{s} = 5.02 TeV

International audienceThe inclusive jet cross section is measured as a function of jet transverse momentum $p_\mathrm{T}$ and rapidity $y$. The measurement is performed using proton-proton collision data at $\sqrt{s}$ = 5.02 TeV, recorded by the CMS experiment at the LHC, corresponding to an integrated luminosity of 27.4 pb$^{-1}$. The jets are reconstructed with the anti-$k_\mathrm{T}$ algorithm using a distance parameter of $R$ = 0.4, within the rapidity interval $\lvert y\rvert$$\lt$ 2, and across the kinematic range 0.06 $\lt$$p_\mathrm{T}$$\lt$ 1 TeV. The jet cross section is unfolded from detector to particle level using the determined jet response and resolution. The results are compared to predictions of perturbative quantum chromodynamics, calculated at both next-to-leading order and next-to-next-to-leading order. The predictions are corrected for nonperturbative effects, and presented for a variety of parton distribution functions and choices of the renormalization/factorization scales and the strong coupling $\alpha_\mathrm{S}$