Bayesian Nonparametric Inverse Reinforcement Learning

Inverse reinforcement learning (IRL) is the task of learning the reward function of a Markov Decision Process (MDP) given the transition function and a set of observed demonstrations in the form of state-action pairs. Current IRL algorithms attempt to find a single reward function which explains the entire observation set. In practice, this leads to a computationally-costly search over a large (typically infinite) space of complex reward functions. This paper proposes the notion that if the observations can be partitioned into smaller groups, a class of much simpler reward functions can be used to explain each group. The proposed method uses a Bayesian nonparametric mixture model to automatically partition the data and find a set of simple reward functions corresponding to each partition. The simple rewards are interpreted intuitively as subgoals, which can be used to predict actions or analyze which states are important to the demonstrator. Experimental results are given for simple examples showing comparable performance to other IRL algorithms in nominal situations. Moreover, the proposed method handles cyclic tasks (where the agent begins and ends in the same state) that would break existing algorithms without modification. Finally, the new algorithm has a fundamentally different structure than previous methods, making it more computationally efficient in a real-world learning scenario where the state space is large but the demonstration set is small

Modeling gravitational radiation from coalescing binary black holes

With the goal of bringing theory, particularly numerical relativity, to bear on an astrophysical problem of critical interest to gravitational wave observers we introduce a model for coalescence radiation from binary black hole systems. We build our model using the "Lazarus approach", a technique that bridges far and close limit approaches with full numerical relativity to solve Einstein equations applied in the truly nonlinear dynamical regime. We specifically study the post-orbital radiation from a system of equal-mass non-spinning black holes, deriving waveforms which indicate strongly circularly polarized radiation of roughly 3% of the system's total energy and 12% of its total angular momentum in just a few cycles. Supporting this result we first establish the reliability of the late-time part of our model, including the numerical relativity and close-limit components, with a thorough study of waveforms from a sequence of black hole configurations varying from previously treated head-on collisions to representative target for ``ISCO'' data corresponding to the end of the inspiral period. We then complete our model with a simple treatment for the early part of the spacetime based on a standard family of initial data for binary black holes in circular orbit. A detailed analysis shows strong robustness in the results as the initial separation of the black holes is increased from 5.0 to 7.8M supporting our waveforms as a suitable basic description of the astrophysical radiation from this system. Finally, a simple fitting of the plunge waveforms is introduced as a first attempt to facilitate the task of analyzing data from gravitational wave detectors.Comment: 23 pages, 36 figures, RevTeX

Summing up the perturbation series in the Schwinger Model

Perturbation series for the electron propagator in the Schwinger Model is summed up in a direct way by adding contributions coming from individual Feynman diagrams. The calculation shows the complete agreement between nonperturbative and perturbative approaches.Comment: 10 pages (in REVTEX

Search for narrow resonances in e+ e- annihilation between 1.85 and 3.1 GeV with the KEDR Detector

We report results of a search for narrow resonances in e+ e- annihilation at center-of-mass energies between 1.85 and 3.1 GeV performed with the KEDR detector at the VEPP-4M e+ e- collider. The upper limit on the leptonic width of a narrow resonance Gamma(R -> ee) Br(R -> hadr) < 120 eV has been obtained (at 90 % C.L.)

Review of magnetic gear technologies and their applications in marine energy

The marine energy industry is in its early stages but has a large potential for growth. One of the most significant challenges is the reduction of operation and maintenance costs. Magnetic gears (MGs) offer the potential for long periods between maintenance intervals due to their frictionless torque transmission which could reduce these costs. This study presents a summary of the state of the art in MG technology and then investigates its potential for marine energy applications. A brief overview is given of the state of the marine energy industry and the environment in which marine energy converters (MECs) operate. A short history of MG development over the past century is then presented followed by a discussion of the leading MG technologies and their relative advantages. In order to demonstrate the potential of MGs in marine applications, the current technologies, i.e. mechanically geared and direct drive machines, are examined in terms of sizing, reliability and economic value using previous studies on a similar technology, namely wind. MGs are applied to four types of MECs to demonstrate how the technology can be incorporated. The potential to deploy at scale and potential obstacles to this are then discussed

Search for direct production of charginos and neutralinos in events with three leptons and missing transverse momentum in √s = 7 TeV pp collisions with the ATLAS detector

A search for the direct production of charginos and neutralinos in final states with three electrons or muons and missing transverse momentum is presented. The analysis is based on 4.7 fb−1 of proton–proton collision data delivered by the Large Hadron Collider and recorded with the ATLAS detector. Observations are consistent with Standard Model expectations in three signal regions that are either depleted or enriched in Z-boson decays. Upper limits at 95% confidence level are set in R-parity conserving phenomenological minimal supersymmetric models and in simplified models, significantly extending previous results

Jet size dependence of single jet suppression in lead-lead collisions at sqrt(s(NN)) = 2.76 TeV with the ATLAS detector at the LHC

Measurements of inclusive jet suppression in heavy ion collisions at the LHC provide direct sensitivity to the physics of jet quenching. In a sample of lead-lead collisions at sqrt(s) = 2.76 TeV corresponding to an integrated luminosity of approximately 7 inverse microbarns, ATLAS has measured jets with a calorimeter over the pseudorapidity interval |eta| < 2.1 and over the transverse momentum range 38 < pT < 210 GeV. Jets were reconstructed using the anti-kt algorithm with values for the distance parameter that determines the nominal jet radius of R = 0.2, 0.3, 0.4 and 0.5. The centrality dependence of the jet yield is characterized by the jet "central-to-peripheral ratio," Rcp. Jet production is found to be suppressed by approximately a factor of two in the 10% most central collisions relative to peripheral collisions. Rcp varies smoothly with centrality as characterized by the number of participating nucleons. The observed suppression is only weakly dependent on jet radius and transverse momentum. These results provide the first direct measurement of inclusive jet suppression in heavy ion collisions and complement previous measurements of dijet transverse energy imbalance at the LHC.Comment: 15 pages plus author list (30 pages total), 8 figures, 2 tables, submitted to Physics Letters B. All figures including auxiliary figures are available at http://atlas.web.cern.ch/Atlas/GROUPS/PHYSICS/PAPERS/HION-2011-02

Measurement of the polarisation of W bosons produced with large transverse momentum in pp collisions at sqrt(s) = 7 TeV with the ATLAS experiment

This paper describes an analysis of the angular distribution of W->enu and W->munu decays, using data from pp collisions at sqrt(s) = 7 TeV recorded with the ATLAS detector at the LHC in 2010, corresponding to an integrated luminosity of about 35 pb^-1. Using the decay lepton transverse momentum and the missing transverse energy, the W decay angular distribution projected onto the transverse plane is obtained and analysed in terms of helicity fractions f0, fL and fR over two ranges of W transverse momentum (ptw): 35 < ptw < 50 GeV and ptw > 50 GeV. Good agreement is found with theoretical predictions. For ptw > 50 GeV, the values of f0 and fL-fR, averaged over charge and lepton flavour, are measured to be : f0 = 0.127 +/- 0.030 +/- 0.108 and fL-fR = 0.252 +/- 0.017 +/- 0.030, where the first uncertainties are statistical, and the second include all systematic effects.Comment: 19 pages plus author list (34 pages total), 9 figures, 11 tables, revised author list, matches European Journal of Physics C versio