Effective Approaches to Attention-based Neural Machine Translation

An attentional mechanism has lately been used to improve neural machine translation (NMT) by selectively focusing on parts of the source sentence during translation. However, there has been little work exploring useful architectures for attention-based NMT. This paper examines two simple and effective classes of attentional mechanism: a global approach which always attends to all source words and a local one that only looks at a subset of source words at a time. We demonstrate the effectiveness of both approaches over the WMT translation tasks between English and German in both directions. With local attention, we achieve a significant gain of 5.0 BLEU points over non-attentional systems which already incorporate known techniques such as dropout. Our ensemble model using different attention architectures has established a new state-of-the-art result in the WMT'15 English to German translation task with 25.9 BLEU points, an improvement of 1.0 BLEU points over the existing best system backed by NMT and an n-gram reranker.Comment: 11 pages, 7 figures, EMNLP 2015 camera-ready version, more training detail

Adjustment of Vietnamese labour market in time of economic fluctuations and structural changes

Dans cet article, nous examinons les ajustements du marché du travail aux fluctuations économiques, compte tenu des transformations structurelles en cours ainsi que des changements à court terme. Nous utilisons pour cela des données des recensements de la population ou publiées dans les annuaires statistiques de l’Office Général de la Statistique pour les séries à long terme, et les enquêtes emploi conduites entre 2007 à 2012 pour les données à court terme. Cet article souligne la profonde transformation du marché du travail au cours des dernières décennies. La population active a doublé en 25 ans et la part de l'agriculture est passée en dessous du seuil de 50 %. L’absorption de l'offre de travail a donc été l'un des principaux défis pour l'économie vietnamienne sur cette période. Le secteur des entreprises familiales agricoles et non-agricoles a été le principal pourvoyeur d'emplois au cours de ces années. Le marché du travail s'est adapté au récent ralentissement économique à travers différents canaux. Le chômage est resté stable mais le nombre de personnes inactives a augmenté. La quantité de travail a également été affectée par une réduction significative du nombre d'heures travaillées. Alors que le secteur non agricole a généré plus d'emplois pour les travailleurs qualifiés, un flux de travailleurs non-qualifiés vers l’agriculture a été observé. En raison de facteurs démographiques, l'absorption de l'offre de travail et la création de nouveaux emplois ne sont plus le principal problème. En revanche, l’évolution récente du marché du travail appelle à la mise en oeuvre de politiques structurelles en vue d’améliorer les conditions de travail, la période étant particulièrement favorable pour mener ces politiques puisque le Vietnam profite actuellement du dividende démographique

Network Sensitivity of Systemic Risk

A growing body of studies on systemic risk in financial markets has emphasized the key importance of taking into consideration the complex interconnections among financial institutions. Much effort has been put in modeling the contagion dynamics of financial shocks, and to assess the resilience of specific financial markets - either using real network data, reconstruction techniques or simple toy networks. Here we address the more general problem of how shock propagation dynamics depends on the topological details of the underlying network. To this end we consider different realistic network topologies, all consistent with balance sheets information obtained from real data on financial institutions. In particular, we consider networks of varying density and with different block structures, and diversify as well in the details of the shock propagation dynamics. We confirm that the systemic risk properties of a financial network are extremely sensitive to its network features. Our results can aid in the design of regulatory policies to improve the robustness of financial markets

Self-organizing Structured RDF in MonetDB

The semantic web uses RDF as its data model, providing ultimate flexibility for users to represent and evolve data without need of a schema. Yet, this flexibility poses challenges in implementing efficient RDF stores, leading from plans with very many self-joins to a triple table, difficulties to optimize these, and a lack of data locality since without a notion of multi-attribute data structure, clustered indexing opportunities are lost. Apart from performance issues, users of huge RDF graphs often have problems formulating queries as they lack any system-supported notion of the structure in the data. In this research, we exploit the observation that real RDF data, while not as regularly structured as relational data, still has the great majority of triples conforming to regular patterns. We conjecture that a system that would recognize this structure automatically would both allow RDF stores to become more efficient and also easier to use. Concretely, we propose to derive self-organizing RDF that stores data in PSO format in such a way that the regular parts of the data physically correspond to relational columnar storage; and propose RDFscan/RDFjoin algorithms that compute star-patterns over these without wasting effort in self-joins. These regular parts, i.e. tables, are identified on ingestion by a schema discovery algorithm -- as such users will gain an SQL view of the regular part of the RDF data. This research aims to produce a state-of-the-art SPARQL frontend for MonetDB as a by-product, and we already present some preliminary results on this platform

Exploiting emergent schemas to make RDF systems more efficient

We build on our earlier finding that more than 95 % of the triples in actual RDF triple graphs have a remarkably tabular structure, whose schema does not necessarily follow from explicit metadata such as ontologies, but for which an RDF store can automatically derive by looking at the data using so-called “emergent schema” detection techniques. In this paper we investigate how computers and in particular RDF stores can take advantage from this emergent schema to more compactly store RDF data and more efficiently optimize and execute SPARQL queries. To this end, we contribute techniques for efficient emergent schema aware RDF storage and new query operator algorithms for emergent schema aware scans and joins. In all, these techniques allow RDF schema processors fully catch up with relational database techniques in terms of rich physical database design options and efficiency, without requiring a rigid upfront schema structure definition

Isabelle/PIDE as Platform for Educational Tools

The Isabelle/PIDE platform addresses the question whether proof assistants of the LCF family are suitable as technological basis for educational tools. The traditionally strong logical foundations of systems like HOL, Coq, or Isabelle have so far been counter-balanced by somewhat inaccessible interaction via the TTY (or minor variations like the well-known Proof General / Emacs interface). Thus the fundamental question of math education tools with fully-formal background theories has often been answered negatively due to accidental weaknesses of existing proof engines. The idea of "PIDE" (which means "Prover IDE") is to integrate existing provers like Isabelle into a larger environment, that facilitates access by end-users and other tools. We use Scala to expose the proof engine in ML to the JVM world, where many user-interfaces, editor frameworks, and educational tools already exist. This shall ultimately lead to combined mathematical assistants, where the logical engine is in the background, without obstructing the view on applications of formal methods, formalized mathematics, and math education in particular.Comment: In Proceedings THedu'11, arXiv:1202.453

Inactivation of the particulate methane monooxygenase (pMMO) in Methylococcus capsulatus (Bath) by acetylene

Acetylene (HCCH) has a long history as a mechanism-based enzyme inhibitor and is considered an active-site probe of the particulate methane monooxygenase (pMMO). Here, we report how HCCH inactivates pMMO in Methylococcus capsulatus (Bath) by using high-resolution mass spectrometry and computational simulation. High-resolution MALDI-TOF MS of intact pMMO complexes has allowed us to confirm that the enzyme oxidizes HCCH to the ketene (C_2H_2O) intermediate, which then forms an acetylation adduct with the transmembrane PmoC subunit. LC-MS/MS analysis of the peptides derived from in-gel proteolytic digestion of the protein subunit identifies K196 of PmoC as the site of acetylation. No evidence is obtained for chemical modification of the PmoA or PmoB subunit. The inactivation of pMMO by a single adduct in the transmembrane PmoC domain is intriguing given the complexity of the structural fold of this large membrane-protein complex as well as the complicated roles played by the various metal cofactors in the enzyme catalysis. Computational studies suggest that the entry of hydrophobic substrates to, and migration of products from, the catalytic site of pMMO is controlled tightly within the transmembrane domain. Support of these conclusions is provided by parallel experiments with two related alkynes: propyne (CH3CCH) and trifluoropropyne (CF_3CCH). Finally, we discuss the implication of these findings to the location of the catalytic site in pMMO

Cesium, iodine and tritium in NW Pacific waters - a comparison of the Fukushima impact with global fallout

Radionuclide impact of the Fukushima Dai-ichi nuclear power plant accident on the distribution of radionuclides in seawater of the NW Pacific Ocean is compared with global fallout from atmospheric tests of nuclear weapons. Surface and water column samples collected during the <i>Ka'imikai-o-Kanaloa</i> (<i>KOK</i>) international expedition carried out in June 2011 were analyzed for ¹³⁴Cs, ¹³⁷Cs, ¹²⁹I and ³H. The ¹³⁷Cs, ¹²⁹I and ³H levels in surface seawater offshore Fukushima varied between 0.002–3.5 Bq L⁻¹, 0.01–0.8 μBq L⁻¹, and 0.05–0.15 Bq L⁻¹, respectively. At the sampling site about 40 km from the coast, where all three radionuclides were analyzed, the Fukushima impact on the levels of these three radionuclides represents an increase above the global fallout background by factors of about 1000, 50 and 3, respectively. The water column data indicate that the transport of Fukushima-derived radionuclides downward to the depth of 300 m has already occurred. The observed ¹³⁷Cs levels in surface waters and in the water column are compared with predictions obtained from the ocean general circulation model, which indicates that the Kuroshio Current acts as a southern boundary for the transport of the radionuclides, which have been transported from the Fukushima coast eastward in the NW Pacific Ocean. The ¹³⁷Cs inventory in the water column is estimated to be about 2.2 PBq, what can be regarded as a lower limit of the direct liquid discharges into the sea as the seawater sampling was carried out only in the area from 34 to 37° N, and from 142 to 147° E. About 4.6 GBq of ¹²⁹I was deposited in the NW Pacific Ocean, and 2.4–7 GBq of ¹²⁹I was directly discharged as liquid wastes into the sea offshore Fukushima. The total amount of ³H released and deposited over the NW Pacific Ocean was estimated to be 0.1–0.5 PBq. These estimations depend, however, on the evaluation of the total ¹³⁷Cs activities released as liquid wastes directly into the sea, which should improve when more data are available. Due to a suitable residence time in the ocean, Fukushima-derived radionuclides will provide useful tracers for isotope oceanography studies on the transport of water masses during the next decades in the NW Pacific Ocean