Learning Mazes with Aliasing States: An LCS Algorithm with Associative Perception

Learning classifier systems (LCSs) belong to a class of algorithms based on the principle of self-organization and have frequently been applied to the task of solving mazes, an important type of reinforcement learning (RL) problem. Maze problems represent a simplified virtual model of real environments that can be used for developing core algorithms of many real-world applications related to the problem of navigation. However, the best achievements of LCSs in maze problems are still mostly bounded to non-aliasing environments, while LCS complexity seems to obstruct a proper analysis of the reasons of failure. We construct a new LCS agent that has a simpler and more transparent performance mechanism, but that can still solve mazes better than existing algorithms. We use the structure of a predictive LCS model, strip out the evolutionary mechanism, simplify the reinforcement learning procedure and equip the agent with the ability of associative perception, adopted from psychology. To improve our understanding of the nature and structure of maze environments, we analyze mazes used in research for the last two decades, introduce a set of maze complexity characteristics, and develop a set of new maze environments. We then run our new LCS with associative perception through the old and new aliasing mazes, which represent partially observable Markov decision problems (POMDP) and demonstrate that it performs at least as well as, and in some cases better than, other published systems

Early microgliosis precedes neuronal loss and behavioural impairment in mice with a frontotemporal dementia-causing CHMP2B mutation

Frontotemporal dementia (FTD)-causing mutations in the CHMP2B gene lead to the generation of mutant C-terminally truncated CHMP2B. We report that transgenic mice expressing endogenous levels of mutant CHMP2B developed late-onset brain volume loss associated with frank neuronal loss and FTD-like changes in social behaviour. These data are the first to show neurodegeneration in mice expressing mutant CHMP2B and indicate that our mouse model is able to recapitulate neurodegenerative changes observed in FTD. Neuroinflammation has been increasingly implicated in neurodegeneration, including FTD. Therefore, we investigated neuroinflammation in our CHMP2B mutant mice. We observed very early microglial proliferation that develops into a clear pro-inflammatory phenotype at late stages. Importantly, we also observed a similar inflammatory profile in CHMP2B patient frontal cortex. Aberrant microglial function has also been implicated in FTD caused by GRN, MAPT and C9orf72 mutations. The presence of early microglial changes in our CHMP2B mutant mice indicates neuroinflammation may be a contributing factor to the neurodegeneration observed in FTD

Contemporary percutaneous treatment of unprotected left main coronary stenoses: initial results from a multicenter registry analysis 1994-1996.

BACKGROUND: Coronary artery bypass surgery (CABG) has been considered the therapy of choice for patients with unprotected left main (ULMT) coronary stenoses. Selected single-center reports suggest that the results of percutaneous intervention may now approach those of CABG. METHODS AND RESULTS: To assess the results of percutaneous ULMT treatment from a wide variety of experienced interventional centers, we requested data on consecutive patients treated after January 1, 1994, from 25 centers. One hundred seven patients were identified who were treated either electively (n=91) or for acute myocardial infarction (n=16). Of patients treated electively, 25% were considered inoperable, and 27% were considered high risk for bypass surgery. Primary treatment included stents (50%), directional atherectomy (24%), and balloon angioplasty (20%). Follow-up was 98.8% complete at 15+/-8 months. Results varied considerably, depending on presentation and treatment. For patient

Atmospheric effects on extensive air showers observed with the Surface Detector of the Pierre Auger Observatory

Atmospheric parameters, such as pressure (P), temperature (T) and density, affect the development of extensive air showers initiated by energetic cosmic rays. We have studied the impact of atmospheric variations on extensive air showers by means of the surface detector of the Pierre Auger Observatory. The rate of events shows a ~10% seasonal modulation and ~2% diurnal one. We find that the observed behaviour is explained by a model including the effects associated with the variations of pressure and density. The former affects the longitudinal development of air showers while the latter influences the Moliere radius and hence the lateral distribution of the shower particles. The model is validated with full simulations of extensive air showers using atmospheric profiles measured at the site of the Pierre Auger Observatory.Comment: 24 pages, 9 figures, accepted for publication in Astroparticle Physic

Update on the correlation of the highest energy cosmic rays with nearby extragalactic matter

Data collected by the Pierre Auger Observatory through 31 August 2007 showed evidence for anisotropy in the arrival directions of cosmic rays above the Greisen-Zatsepin-Kuz'min energy threshold, \nobreak{$6\times 10^{19}$eV}. The anisotropy was measured by the fraction of arrival directions that are less than $3.1^\circ$ from the position of an active galactic nucleus within 75 Mpc (using the V\'eron-Cetty and V\'eron $12^{\rm th}$ catalog). An updated measurement of this fraction is reported here using the arrival directions of cosmic rays recorded above the same energy threshold through 31 December 2009. The number of arrival directions has increased from 27 to 69, allowing a more precise measurement. The correlating fraction is $(38^{+7}_{-6})$, compared with $21$ expected for isotropic cosmic rays. This is down from the early estimate of $(69^{+11}_{-13})$. The enlarged set of arrival directions is examined also in relation to other populations of nearby extragalactic objects: galaxies in the 2 Microns All Sky Survey and active galactic nuclei detected in hard X-rays by the Swift Burst Alert Telescope. A celestial region around the position of the radiogalaxy Cen A has the largest excess of arrival directions relative to isotropic expectations. The 2-point autocorrelation function is shown for the enlarged set of arrival directions and compared to the isotropic expectation.Comment: Accepted for publication in Astroparticle Physics on 31 August 201

The Fluorescence Detector of the Pierre Auger Observatory

The Pierre Auger Observatory is a hybrid detector for ultra-high energy cosmic rays. It combines a surface array to measure secondary particles at ground level together with a fluorescence detector to measure the development of air showers in the atmosphere above the array. The fluorescence detector comprises 24 large telescopes specialized for measuring the nitrogen fluorescence caused by charged particles of cosmic ray air showers. In this paper we describe the components of the fluorescence detector including its optical system, the design of the camera, the electronics, and the systems for relative and absolute calibration. We also discuss the operation and the monitoring of the detector. Finally, we evaluate the detector performance and precision of shower reconstructions.Comment: 53 pages. Submitted to Nuclear Instruments and Methods in Physics Research Section

Anisotropy studies around the galactic centre at EeV energies with the Auger Observatory

Data from the Pierre Auger Observatory are analyzed to search for anisotropies near the direction of the Galactic Centre at EeV energies. The exposure of the surface array in this part of the sky is already significantly larger than that of the fore-runner experiments. Our results do not support previous findings of localized excesses in the AGASA and SUGAR data. We set an upper bound on a point-like flux of cosmic rays arriving from the Galactic Centre which excludes several scenarios predicting sources of EeV neutrons from Sagittarius $A$. Also the events detected simultaneously by the surface and fluorescence detectors (the `hybrid' data set), which have better pointing accuracy but are less numerous than those of the surface array alone, do not show any significant localized excess from this direction.Comment: Matches published versio

Advanced functionality for radio analysis in the Offline software framework of the Pierre Auger Observatory

The advent of the Auger Engineering Radio Array (AERA) necessitates the development of a powerful framework for the analysis of radio measurements of cosmic ray air showers. As AERA performs "radio-hybrid" measurements of air shower radio emission in coincidence with the surface particle detectors and fluorescence telescopes of the Pierre Auger Observatory, the radio analysis functionality had to be incorporated in the existing hybrid analysis solutions for fluoresence and surface detector data. This goal has been achieved in a natural way by extending the existing Auger Offline software framework with radio functionality. In this article, we lay out the design, highlights and features of the radio extension implemented in the Auger Offline framework. Its functionality has achieved a high degree of sophistication and offers advanced features such as vectorial reconstruction of the electric field, advanced signal processing algorithms, a transparent and efficient handling of FFTs, a very detailed simulation of detector effects, and the read-in of multiple data formats including data from various radio simulation codes. The source code of this radio functionality can be made available to interested parties on request.Comment: accepted for publication in NIM A, 13 pages, minor corrections to author list and references in v