Analogy Training Multilingual Encoders

Language encoders encode words and phrases in ways that capture their local semantic relatedness, but are known to be globally inconsistent. Global inconsistency can seemingly be corrected for, in part, by leveraging signals from knowledge bases, but previous results are partial and limited to monolingual English encoders. We extract a large-scale multilingual, multi-word analogy dataset from Wikidata for diagnosing and correcting for global inconsistencies and implement a four-way Siamese BERT architecture for grounding multilingual BERT (mBERT) in Wikidata through analogy training. We show that analogy training not only improves the global consistency of mBERT, as well as the isomorphism of language-specific subspaces, but also leads to significant gains on downstream tasks such as bilingual dictionary induction and sentence retrieval

Large-scale distributions of tropospheric nitric, formic, and acetic acids over the western Pacific basin during wintertime

We report here measurements of the acidic gases nitric (HNO3), formic (HCOOH), and acetic (CH3COOH) over the western Pacific basin during the February-March 1994 Pacific Exploratory Mission-West (PEM-West B). These data were obtained aboard the NASA DC-8 research aircraft as it flew missions in the altitude range of 0.3–12.5 km over equatorial regions near Guam and then further westward encompassing the entire Pacific Rim arc. Aged marine air over the equatorial Pacific generally exhibited mixing ratios of acidic gases \u3c100 parts per trillion by volume (pptv). Near the Asian continent, discrete plumes encountered below 6 km altitude contained up to 8 parts per billion by volume (ppbv) HNO3 and 10 ppbv HCOOH and CH3COOH. Overall there was a general correlation between mixing ratios of acidic gases with those of CO, C2H2, and C2Cl4, indicative of emissions from combustion and industrial sources. The latitudinal distributions of HNO3 and CO showed that the largest mixing ratios were centered around 15°N, while HCOOH, CH3COOH, and C2Cl4 peaked at 25°N. The mixing ratios of HCOOH and CH3COOH were highly correlated (r2 = 0.87) below 6 km altitude, with a slope (0.89) characteristic of the nongrowing season at midlatitudes in the northern hemisphere. Above 6 km altitude, HCOOH and CH3COOH were marginally correlated (r2 = 0.50), and plumes well defined by CO, C2H2, and C2Cl4 were depleted in acidic gases, most likely due to scavenging during vertical transport of air masses through convective cloud systems over the Asian continent. In stratospheric air masses, HNO3 mixing ratios were several parts per billion by volume (ppbv), yielding relationships with O3 and N2O consistent with those previously reported for NOy

Influence of biomass combustion emissions on the distribution of acidic trace gases over the southern Pacific basin during austral springtime

This paper describes the large-scale distributions of HNO3, HCOOH, and CH3COOH over the central and South Pacific basins during the Pacific Exploratory Mission-Tropics (PEM-Tropics) in austral springtime. Because of the remoteness of this region from continental areas, low part per trillion by volume (pptv) mixing ratios of acidic gases were anticipated to be pervasive over the South Pacific basin. However, at altitudes of 2–12 km over the South Pacific, air parcels were encountered frequently with significantly enhanced mixing ratios (up to 1200 pptv) of acidic gases. Most of these air parcels were centered in the 3–7 km altitude range and occurred within the 15°−65°S latitudinal band. The acidic gases exhibited an overall general correlation with CH3Cl, PAN, and O3, suggestive of photochemical and biomass burning sources. There was no correlation or trend of acidic gases with common industrial tracer compounds (e.g., C2Cl4 or CH3CCl3). The combustion emissions sampled over the South Pacific basin were relatively aged exhibiting C2H2/CO ratios in the range of 0.2–2.2 pptv/ppbv. The relationships between acidic gases and this ratio were similar to what was observed in aged air parcels (i.e., \u3e3–5 days since they were over a continental area) over the western North Pacific during the Pacific Exploratory Mission-West Phases A and B (PEM-West A and B). In the South Pacific marine boundary layer a median C2H2/CO ratio of 0.6 suggested that this region was generally not influenced by direct inputs of biomass combustion emissions. Here we observed the lowest mixing ratios of acidic gases, with median values of 14 pptv for HNO3, 19 pptv for HCOOH, and 18 pptv for CH3COOH. These values were coincident with low mixing ratios of NOx(\u3c10 pptv), CO (≈50 parts per billion by volume (ppbv)), O3 (\u3c 20 ppbv), and long-lived hydrocarbons (e.g., C2H6 \u3c300 pptv). Overall, the PEM-Tropics data suggest an important influence of aged biomass combustion emissions on the distributions of acidic gases over the South Pacific basin in austral springtime

Reactive nitrogen in Asian continental outflow over the western Pacific: Results from the NASA Transport and Chemical Evolution over the Pacific (TRACE-P) airborne mission

We present here results for reactive nitrogen species measured aboard the NASA DC-8 aircraft during the Transport and Chemical Evolution over the Pacific (TRACE-P) mission. The large-scale distributions total reactive nitrogen (NOy,sum = NO + NO2 + HNO3 + PAN + C1–C5alkyl nitrates) and O3 and CO were better defined in the boundary layer with significant degradation of the relationships as altitude increased. Typically, NOy,sum was enhanced over background levels of ∼260 pptv by 20-to-30-fold. The ratio C2H2/CO had values of 1–4 at altitudes up to 10 km and as far eastward as 150°E, implying significant vertical mixing of air parcels followed by rapid advection across the Pacific. Analysis air parcels originating from five principal Asian source regions showed that HNO3 and PAN dominated NOy,sum. Correlations of NOy,sum with C2Cl4 (urban tracer) were not well defined in any of the source regions, and they were only slightly better with CH3Cl (biomass tracer). Air parcels over the western Pacific contained a complex mixture of emission sources that are not easily resolvable as shown by analysis of the Shanghai mega-city plume. It contained an intricate mixture of pollution emissions and exhibited the highest mixing ratios of NOy,sum species observed during TRACE-P. Comparison of tropospheric chemistry between the earlier PEM-West B mission and the recent TRACE-P data showed that in the boundary layer significant increases in the mixing ratios of NOy,sum species have occurred, but the middle and upper troposphere seems to have been affected minimally by increasing emissions on the Asian continent over the last 7 years

Le Chatelier principle in replicator dynamics

The Le Chatelier principle states that physical equilibria are not only stable, but they also resist external perturbations via short-time negative-feedback mechanisms: a perturbation induces processes tending to diminish its results. The principle has deep roots, e.g., in thermodynamics it is closely related to the second law and the positivity of the entropy production. Here we study the applicability of the Le Chatelier principle to evolutionary game theory, i.e., to perturbations of a Nash equilibrium within the replicator dynamics. We show that the principle can be reformulated as a majorization relation. This defines a stability notion that generalizes the concept of evolutionary stability. We determine criteria for a Nash equilibrium to satisfy the Le Chatelier principle and relate them to mutualistic interactions (game-theoretical anticoordination) showing in which sense mutualistic replicators can be more stable than (say) competing ones. There are globally stable Nash equilibria, where the Le Chatelier principle is violated even locally: in contrast to the thermodynamic equilibrium a Nash equilibrium can amplify small perturbations, though both this type of equilibria satisfy the detailed balance condition.Comment: 12 pages, 3 figure

Evaluating regional emission estimates using the TRACE-P observations

Measurements obtained during the NASA Transport and Chemical Evolution over the Pacific (TRACE-P) experiment are used in conjunction with regional modeling analysis to evaluate emission estimates for Asia. A comparison between the modeled values and the observations is one method to evaluate emissions. Based on such analysis it is concluded that the inventory performs well for the light alkanes, CO, ethyne, SO2, and NOₓ. Furthermore, based on model skill in predicting important photochemical species such as O₃, HCHO, OH, HO₂, and HNO₃, it is found that the emissions inventories are of sufficient quality to support preliminary studies of ozone production. These are important finding in light of the fact that emission estimates for many species (such as speciated NMHCs and BC) for this region have only recently been estimated and are highly uncertain. Using a classification of the measurements built upon trajectory analysis, we compare observed species distributions and ratios of species to those modeled and to ratios estimated from the emissions inventory. It is shown that this technique can reconstruct a spatial distribution of propane/benzene that looks remarkably similar to that calculated from the emissions inventory. A major discrepancy between modeled and observed behavior is found in the Yellow Sea, where modeled values are systematically underpredicted. The integrated analysis suggests that this may be related to an underestimation of emissions from the domestic sector. The emission is further tested by comparing observed and measured species ratios in identified megacity plumes. Many of the model derived ratios (e.g., BC/CO, SOₓ/C₂H₂) fall within ∼25% of those observed and all fall outside of a factor of 2.5. (See Article file for details of the abstract.)Department of Civil and Environmental EngineeringAuthor name used in this publication: Wang, T

Computing Optimal Equilibria and Mechanisms via Learning in Zero-Sum Extensive-Form Games

We introduce a new approach for computing optimal equilibria and mechanisms via learning in games. It applies to extensive-form settings with any number of players, including mechanism design, information design, and solution concepts such as correlated, communication, and certification equilibria. We observe that optimal equilibria are minimax equilibrium strategies of a player in an extensive-form zero-sum game. This reformulation allows us to apply techniques for learning in zero-sum games, yielding the first learning dynamics that converge to optimal equilibria, not only in empirical averages, but also in iterates. We demonstrate the practical scalability and flexibility of our approach by attaining state-of-the-art performance in benchmark tabular games, and by computing an optimal mechanism for a sequential auction design problem using deep reinforcement learning