Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All

We present a new pre-trained language model (PLM) for modern Hebrew, termed AlephBERTGimmel, which employs a much larger vocabulary (128K items) than standard Hebrew PLMs before. We perform a contrastive analysis of this model against all previous Hebrew PLMs (mBERT, heBERT, AlephBERT) and assess the effects of larger vocabularies on task performance. Our experiments show that larger vocabularies lead to fewer splits, and that reducing splits is better for model performance, across different tasks. All in all this new model achieves new SOTA on all available Hebrew benchmarks, including Morphological Segmentation, POS Tagging, Full Morphological Analysis, NER, and Sentiment Analysis. Subsequently we advocate for PLMs that are larger not only in terms of number of layers or training data, but also in terms of their vocabulary. We release the new model publicly for unrestricted use

RF impedance measurements on the DARHT-II accelerator intercell assembly

We report upon recent experimental measurements made of RF properties of the intercell assembly of the second axis accelerator[1] of Dual Axis Radiographic Hydrodynamic Test (DARHT) facility at LANL. The intercells provide both pumping and diagnostic access to the main DARHT-II beamline. Their design includes a pumping plenum separated from the main beam pipe by return current rods together with RF shielding provided by a copper-coated stainless steel mesh. Measurements using the twin lead technique (see Ref. [2]) at low frequencies (f < 200 MHz) suggest a constant value for the ratio h of the radial and azimuthal magnetic field components to which the transverse impedance is linearly related. We find that these results compare favorably to predictions from a simple analytic, lumped circuit model which includes the effects of the mesh and return current rods. We also present RF loop-to-loop frequency scans above beam pipe cutoff ({approx}600 MHz) showing the existence of many RF modes with relatively high Q's

RF impedance measurements on the DARHT-II accelerator intercell assembly

We report upon recent experimental measurements made of RF properties of the intercell assembly of the second axis accelerator[1] of Dual Axis Radiographic Hydrodynamic Test (DARHT) facility at LANL. The intercells provide both pumping and diagnostic access to the main DARHT-II beamline. Their design includes a pumping plenum separated from the main beam pipe by return current rods together with RF shielding provided by a copper-coated stainless steel mesh. Measurements using the twin lead technique (see Ref. [2]) at low frequencies (f < 200 MHz) suggest a constant value for the ratio h of the radial and azimuthal magnetic field components to which the transverse impedance is linearly related. We find that these results compare favorably to predictions from a simple analytic, lumped circuit model which includes the effects of the mesh and return current rods. We also present RF loop-to-loop frequency scans above beam pipe cutoff (~;600 MHz) showing the existence of many RF modes with relatively high Q's

Final focus system for high intensity beams

The neutralized transport experiment (NTX) at the Heavy Ion Fusion Virtual National Laboratory is exploring the performance of neutralized final-focus systems for high perveance heavy ion beams. The final-focus scenario in a heavy ion fusion driver consists of several large aperture quadrupole magnets followed by a drift section in which the beam space charge is neutralized by a plasma. This beam is required to hit a millimeter-sized target spot at the end of the drift section. The objective of the NTX experiments and associated theory and simulations is to study the various physical mechanisms that determine the final spot size (radius r_{s}) at a given distance (f) from the end of the last quadrupole. In a fusion driver, f is the standoff distance required to keep the chamber wall and superconducting magnets properly protected. The NTX final quadrupole focusing system produces a converging beam at the entrance to the neutralized drift section where it focuses to a small spot. The final spot is determined by the conditions of the beam entering the quadrupole section, the beam dynamics in the magnetic lattice, and the plasma neutralization dynamics in the drift section. The main issues are the control of emittance growth due to high order fields from magnetic multipoles and image fields. In this paper, we will describe the theoretical and experimental aspects of the beam dynamics in the quadrupole lattice, and how these physical effects influence the final beam size. In particular, we present theoretical and experimental results on the dependence of final spot size on geometric aberrations and perveance

Study of a final focus system for high intensity beams

The NTX experiment at the Heavy Ion Fusion Virtual National Laboratory is exploring the performance of neutralized final focus systems for high perveance heavy ion beams. The final focus scenario in an HIF driver consists of several large aperture quadrupole magnets followed by a drift section in which the beam space charge is neutralized by a plasma. This beam is required to hit a millimeter-sized target spot at the end of the drift section. The objective of the NTX experiments and associated theory and simulations is to study the various physical mechanisms that determine the final spot size (radius r{sub s}) at a given distance (f) from the end of the last quadrupole. In a fusion driver, f is the standoff distance required to keep the chamber wall and superconducting magnets properly protected. The NTX final quadrupole focusing system produces a converging beam at the entrance to the neutralized drift section where it focuses to a small spot. The final spot is determined by the conditions of the beam entering the quadrupole section, the beam dynamics in the magnetic lattice, and the plasma neutralization dynamics in the drift section. The main issues are the control of emittance growth due to high order fields from magnetic multipoles and image fields. In this paper, we will describe the theoretical and experimental aspects of the beam dynamics in the quadrupole lattice, and how these physical effects influence the final beam size. In particular, we present theoretical and experimental results on the dependence of final spot size on geometric aberrations and perveance

Final focus system for high intensity beams

The neutralized transport experiment (NTX) at the Heavy Ion Fusion Virtual National Laboratory is exploring the performance of neutralized final-focus systems for high perveance heavy ion beams. The final-focus scenario in a heavy ion fusion driver consists of several large aperture quadrupole magnets followed by a drift section in which the beam space charge is neutralized by a plasma. This beam is required to hit a millimeter-sized target spot at the end of the drift section. The objective of the NTX experiments and associated theory and simulations is to study the various physical mechanisms that determine the final spot size (radius r_{s}) at a given distance (f) from the end of the last quadrupole. In a fusion driver, f is the standoff distance required to keep the chamber wall and superconducting magnets properly protected. The NTX final quadrupole focusing system produces a converging beam at the entrance to the neutralized drift section where it focuses to a small spot. The final spot is determined by the conditions of the beam entering the quadrupole section, the beam dynamics in the magnetic lattice, and the plasma neutralization dynamics in the drift section. The main issues are the control of emittance growth due to high order fields from magnetic multipoles and image fields. In this paper, we will describe the theoretical and experimental aspects of the beam dynamics in the quadrupole lattice, and how these physical effects influence the final beam size. In particular, we present theoretical and experimental results on the dependence of final spot size on geometric aberrations and perveance

Focusing and neutralization of intense beams

In heavy ion inertial confinement fusion systems, intense beams of ions must be transported from the exit of the final focus magnet system through the target chamber to hit millimeter spot sizes on the target. Effective plasma neutralization of intense ion beams through the target chamber is essential for the viability of an economically competitive heavy ion fusion power plant. The physics of neutralized drift has been studied extensively with PIC simulations. To provide quantitative comparisons of theoretical predictions with experiment, the Heavy Ion Fusion Virtual National Laboratory has completed the construction and has begun experimentation with the NTX (Neutralized Transport Experiment) as shown in Figure 1. The experiment consists of 3 phases, each with physics issues of its own. Phase 1 is designed to generate a very high brightness potassium beam with variable perveance, using a beam aperturing technique. Phase 2 consists of magnetic transport through four pulsed quadrupoles. Here, beam tuning as well as the effects of phase space dilution through higher order nonlinear fields must be understood. In Phase 3, a converging ion beam at the exit of the magnetic section is transported through a drift section with plasma sources for beam neutralization, and the final spot size is measured under various conditions of neutralization. In this paper, we present first results from all 3 phases of the experiment

Focusing and neutralization of intense beams

In heavy ion inertial confinement fusion systems, intense beams of ions must be transported from the exit of the final focus magnet system through the target chamber to hit millimeter spot sizes on the target. Effective plasma neutralization of intense ion beams through the target chamber is essential for the viability of an economically competitive heavy ion fusion power plant. The physics of neutralized drift has been studied extensively with PIC simulations. To provide quantitative comparisons of theoretical predictions with experiment, the Heavy Ion Fusion Virtual National Laboratory has completed the construction and has begun experimentation with the NTX (Neutralized Transport Experiment) as shown in Figure 1. The experiment consists of 3 phases, each with physics issues of its own. Phase 1 is designed to generate a very high brightness potassium beam with variable perveance, using a beam aperturing technique. Phase 2 consists of magnetic transport through four pulsed quadrupoles. Here, beam tuning as well as the effects of phase space dilution through higher order nonlinear fields must be understood. In Phase 3, a converging ion beam at the exit of the magnetic section is transported through a drift section with plasma sources for beam neutralization, and the final spot size is measured under various conditions of neutralization. In this paper, we present first results from all 3 phases of the experiment

Electron beam diagnostic for space charge measurement of an ion beam

A non-perturbing electron beam diagnostic system for measuring the charge distribution of an ion beam is developed for Heavy Ion Fusion (HIF) beam physics studies. Conventional diagnostics require temporary insertion of sensors into the beam, but such diagnostics stop the beam, or significantly alter its properties. In this diagnostic a low energy, low current electron beam is swept transversely across the ion beam; the measured electron beam deflection is used to infer the charge density profile of the ion beam. The initial application of this diagnostic is to the Neutralized Transport Experiment (NTX), which is exploring the physics of space-charge-dominated beam focusing onto a small spot using a neutralizing plasma. Design and development of this diagnostic and performance with the NTX ion beamline is presented