Learning Mazes with Aliasing States: An LCS Algorithm with Associative Perception

Learning classifier systems (LCSs) belong to a class of algorithms based on the principle of self-organization and have frequently been applied to the task of solving mazes, an important type of reinforcement learning (RL) problem. Maze problems represent a simplified virtual model of real environments that can be used for developing core algorithms of many real-world applications related to the problem of navigation. However, the best achievements of LCSs in maze problems are still mostly bounded to non-aliasing environments, while LCS complexity seems to obstruct a proper analysis of the reasons of failure. We construct a new LCS agent that has a simpler and more transparent performance mechanism, but that can still solve mazes better than existing algorithms. We use the structure of a predictive LCS model, strip out the evolutionary mechanism, simplify the reinforcement learning procedure and equip the agent with the ability of associative perception, adopted from psychology. To improve our understanding of the nature and structure of maze environments, we analyze mazes used in research for the last two decades, introduce a set of maze complexity characteristics, and develop a set of new maze environments. We then run our new LCS with associative perception through the old and new aliasing mazes, which represent partially observable Markov decision problems (POMDP) and demonstrate that it performs at least as well as, and in some cases better than, other published systems

A framework for variable content document generation with multiple actors

“NOTICE: this is the author’s version of a work that was accepted for publication in Information and Software Technology. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Information and Software Technology, Volume 56, Issue 9, September 2014, Pages 1101–1121 DOI10.1016/j.infsof.2013.12.006Context - Advances in customization have highlighted the need for tools supporting variable content document management and generation in many domains. Current tools allow the generation of highly customized documents that are variable in both content and layout. However, most frameworks are technology-oriented, and their use requires advanced skills in implementation-related tools, which means their use by end users (i.e. document designers) is severely limited. Objective - Starting from past and current trends for customized document authoring, our goal is to provide a document generation alternative in which variants are specified at a high level of abstraction and content reuse can be maximized in high variability scenarios. Method Based on our experience in Document Engineering, we identified areas in the variable content document management and generation field open to further improvement. We first classified the primary sources of variability in document composition processes and then developed a methodology, which we called DPL based on Software Product Lines principles to support document generation in high variability scenarios. Results - In order to validate the applicability of our methodology we implemented a tool DPLfw to carry out DPL processes. After using this in different scenarios, we compared our proposal with other state-of-the-art tools for variable content document management and generation. Conclusion - The DPLfw showed a good capacity for the automatic generation of variable content documents equal to or in some cases surpassing other currently available approaches. To the best of our knowledge, DPLfw is the only framework that combines variable content and document workflow facilities, easing the generation of variable content documents in which multiple actors play different roles.This work has been partially funded by the Spanish Ministerio de Economia y Competitividad under Grant TIPEx (TIN2010-19859-C03-03).Gómez Llana, A.; Penadés Gramage, MC.; Canos Cerda, JH.; Borges, MR.; Llavador Campos, M. (2014). A framework for variable content document generation with multiple actors. Information and Software Technology. 56(9):1101-1121. https://doi.org/10.1016/j.infsof.2013.12.006S1101112156

Markov Properties of Electrical Discharge Current Fluctuations in Plasma

Using the Markovian method, we study the stochastic nature of electrical discharge current fluctuations in the Helium plasma. Sinusoidal trends are extracted from the data set by the Fourier-Detrended Fluctuation analysis and consequently cleaned data is retrieved. We determine the Markov time scale of the detrended data set by using likelihood analysis. We also estimate the Kramers-Moyal's coefficients of the discharge current fluctuations and derive the corresponding Fokker-Planck equation. In addition, the obtained Langevin equation enables us to reconstruct discharge time series with similar statistical properties compared with the observed in the experiment. We also provide an exact decomposition of temporal correlation function by using Kramers-Moyal's coefficients. We show that for the stationary time series, the two point temporal correlation function has an exponential decaying behavior with a characteristic correlation time scale. Our results confirm that, there is no definite relation between correlation and Markov time scales. However both of them behave as monotonic increasing function of discharge current intensity. Finally to complete our analysis, the multifractal behavior of reconstructed time series using its Keramers-Moyal's coefficients and original data set are investigated. Extended self similarity analysis demonstrates that fluctuations in our experimental setup deviates from Kolmogorov (K41) theory for fully developed turbulence regime.Comment: 25 pages, 9 figures and 4 tables. V3: Added comments, references, figures and major correction

Multilaboratory evaluation of methods for detecting enteric viruses in soils.

Two candidate methods for the recovery and detection of viruses in soil were subjected to round robin comparative testing by members of the American Society for Testing and Materials D19:24:04:04 Subcommittee Task Group. Selection of the methods, designated "Berg" and "Goyal," was based on results of an initial screening which indicated that both met basic criteria considered essential by the task group. Both methods utilized beef extract solutions to achieve desorption and recovery of viruses from representative soils: a fine sand soil, an organic muck soil, a sandy loam soil, and a clay loam soil. One of the two methods, Goyal, also used a secondary concentration of resulting soil eluants via low-pH organic flocculation to achieve a smaller final assay volume. Evaluation of the two methods was simultaneously performed in replicate by nine different laboratories. Each of the produced samples was divided into portions, and these were respectively subjected to quantitative viral plaque assay by both the individual, termed independent, laboratory which had done the soil processing and a single common reference laboratory, using a single cell line and passage level. The Berg method seemed to produce slightly higher virus recovery values; however, the differences in virus assay titers for samples produced by the two methods were not statistically significant (P less than or equal to 0.05) for any one of the four soils. Despite this lack of a method effect, th

Measurement of the polarisation of W bosons produced with large transverse momentum in pp collisions at sqrt(s) = 7 TeV with the ATLAS experiment

This paper describes an analysis of the angular distribution of W->enu and W->munu decays, using data from pp collisions at sqrt(s) = 7 TeV recorded with the ATLAS detector at the LHC in 2010, corresponding to an integrated luminosity of about 35 pb^-1. Using the decay lepton transverse momentum and the missing transverse energy, the W decay angular distribution projected onto the transverse plane is obtained and analysed in terms of helicity fractions f0, fL and fR over two ranges of W transverse momentum (ptw): 35 < ptw < 50 GeV and ptw > 50 GeV. Good agreement is found with theoretical predictions. For ptw > 50 GeV, the values of f0 and fL-fR, averaged over charge and lepton flavour, are measured to be : f0 = 0.127 +/- 0.030 +/- 0.108 and fL-fR = 0.252 +/- 0.017 +/- 0.030, where the first uncertainties are statistical, and the second include all systematic effects.Comment: 19 pages plus author list (34 pages total), 9 figures, 11 tables, revised author list, matches European Journal of Physics C versio

Observation of a new chi_b state in radiative transitions to Upsilon(1S) and Upsilon(2S) at ATLAS

The chi_b(nP) quarkonium states are produced in proton-proton collisions at the Large Hadron Collider (LHC) at sqrt(s) = 7 TeV and recorded by the ATLAS detector. Using a data sample corresponding to an integrated luminosity of 4.4 fb^-1, these states are reconstructed through their radiative decays to Upsilon(1S,2S) with Upsilon->mu+mu-. In addition to the mass peaks corresponding to the decay modes chi_b(1P,2P)->Upsilon(1S)gamma, a new structure centered at a mass of 10.530+/-0.005 (stat.)+/-0.009 (syst.) GeV is also observed, in both the Upsilon(1S)gamma and Upsilon(2S)gamma decay modes. This is interpreted as the chi_b(3P) system.Comment: 5 pages plus author list (18 pages total), 2 figures, 1 table, corrected author list, matches final version in Physical Review Letter

Search for displaced vertices arising from decays of new heavy particles in 7 TeV pp collisions at ATLAS

We present the results of a search for new, heavy particles that decay at a significant distance from their production point into a final state containing charged hadrons in association with a high-momentum muon. The search is conducted in a pp-collision data sample with a center-of-mass energy of 7 TeV and an integrated luminosity of 33 pb^-1 collected in 2010 by the ATLAS detector operating at the Large Hadron Collider. Production of such particles is expected in various scenarios of physics beyond the standard model. We observe no signal and place limits on the production cross-section of supersymmetric particles in an R-parity-violating scenario as a function of the neutralino lifetime. Limits are presented for different squark and neutralino masses, enabling extension of the limits to a variety of other models.Comment: 8 pages plus author list (20 pages total), 8 figures, 1 table, final version to appear in Physics Letters

Measurement of the inclusive isolated prompt photon cross-section in pp collisions at sqrt(s)= 7 TeV using 35 pb-1 of ATLAS data

A measurement of the differential cross-section for the inclusive production of isolated prompt photons in pp collisions at a center-of-mass energy sqrt(s) = 7 TeV is presented. The measurement covers the pseudorapidity ranges |eta|<1.37 and 1.52<=|eta|<2.37 in the transverse energy range 45<=E_T<400GeV. The results are based on an integrated luminosity of 35 pb-1, collected with the ATLAS detector at the LHC. The yields of the signal photons are measured using a data-driven technique, based on the observed distribution of the hadronic energy in a narrow cone around the photon candidate and the photon selection criteria. The results are compared with next-to-leading order perturbative QCD calculations and found to be in good agreement over four orders of magnitude in cross-section.Comment: 7 pages plus author list (18 pages total), 2 figures, 4 tables, final version published in Physics Letters

Measurement of D*+/- meson production in jets from pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

This paper reports a measurement of D*+/- meson production in jets from proton-proton collisions at a center-of-mass energy of sqrt(s) = 7 TeV at the CERN Large Hadron Collider. The measurement is based on a data sample recorded with the ATLAS detector with an integrated luminosity of 0.30 pb^-1 for jets with transverse momentum between 25 and 70 GeV in the pseudorapidity range |eta| < 2.5. D*+/- mesons found in jets are fully reconstructed in the decay chain: D*+ -> D0pi+, D0 -> K-pi+, and its charge conjugate. The production rate is found to be N(D*+/-)/N(jet) = 0.025 +/- 0.001(stat.) +/- 0.004(syst.) for D*+/- mesons that carry a fraction z of the jet momentum in the range 0.3 < z < 1. Monte Carlo predictions fail to describe the data at small values of z, and this is most marked at low jet transverse momentum.Comment: 10 pages plus author list (22 pages total), 5 figures, 1 table, matches published version in Physical Review