Multi-agent Hierarchical Reinforcement Learning with Dynamic Termination

In a multi-agent system, an agent's optimal policy will typically depend on the policies chosen by others. Therefore, a key issue in multi-agent systems research is that of predicting the behaviours of others, and responding promptly to changes in such behaviours. One obvious possibility is for each agent to broadcast their current intention, for example, the currently executed option in a hierarchical reinforcement learning framework. However, this approach results in inflexibility of agents if options have an extended duration and are dynamic. While adjusting the executed option at each step improves flexibility from a single-agent perspective, frequent changes in options can induce inconsistency between an agent's actual behaviour and its broadcast intention. In order to balance flexibility and predictability, we propose a dynamic termination Bellman equation that allows the agents to flexibly terminate their options. We evaluate our model empirically on a set of multi-agent pursuit and taxi tasks, and show that our agents learn to adapt flexibly across scenarios that require different termination behaviours.Comment: PRICAI 201

No straight lines – young women’s perceptions of their mental health and wellbeing during and after pregnancy: a systematic review and meta-ethnography

Background: Young mothers face mental health challenges during and after pregnancy including increased rates of depression compared to older mothers. While the prevention of teenage pregnancy in countries such as the United States and the United Kingdom has been a focus for policy and research in recent decades, the need to understand young women’s own experiences has been highlighted. The aim of this meta-ethnography was to examine young women’s perceptions of their mental health and wellbeing during and after pregnancy to provide new understandings of those experiences. Methods: A systematic review and meta-ethnographic synthesis of qualitative research was conducted. Seven databases were systematically searched and forward and backward searching conducted. Papers were included if they were from Organisation for Economic Co-operation and Development countries and explored mental health and wellbeing experiences of young mothers (age under 20 in pregnancy; under 25 at time of research) as a primary research question – or where evidence about mental health and wellbeing from participants was foregrounded. Nineteen papers were identified and the Critical Appraisal Skills Programme checklist for qualitative research used to appraise the evidence. Following the seven-step process of meta-ethnography, key constructs were examined within each study and then translated into one another. Results: Seven translated themes were identified forming a new line of argument wherein mental health and wellbeing was analysed as relating to individual bodily experiences; tied into past and present relationships; underpinned by economic insecurity and entangled with feelings of societal surveillance. There were ‘no straight lines’ in young women’s experiences, which were more complex than dominant narratives around overcoming adversity suggest. Conclusions: The synthesis concludes that health and social care professionals need to reflect on the operation of power and stigma in young women’s lives and its impact on wellbeing. It adds to understanding of young women’s mental health and wellbeing during and after pregnancy as located in physical and structural factors rather than individual capacities alone

Funding Source and Research Report Quality in Nutrition Practice-Related Research

BACKGROUND: The source of funding is one of many possible causes of bias in scientific research. One method of detecting potential for bias is to evaluate the quality of research reports. Research exploring the relationship between funding source and nutrition-related research report quality is limited and in other disciplines the findings are mixed. OBJECTIVE: The purpose of this study is to determine whether types of funding sources of nutrition research are associated with differences in research report quality. DESIGN: A retrospective study of research reporting quality, research design and funding source was conducted on 2539 peer reviewed research articles from the American Dietetic Association's Evidence Analysis Library® database. RESULTS: Quality rating frequency distributions indicate 43.3% of research reports were rated as positive, 50.1% neutral, and 6.6% as negative. Multinomial logistic regression results showed that while both funding source and type of research design are significant predictors of quality ratings (χ2 = 118.99, p≤0.001), the model's usefulness in predicting overall research report quality is little better than chance. Compared to research reports with government funding, those not acknowledging any funding sources, followed by studies with University/hospital funding were more likely to receive neutral vs positive quality ratings, OR = 1.85, P <0.001 and OR = 1.54, P<0.001, respectively and those that did not report funding were more likely to receive negative quality ratings (OR = 4.97, P<0.001). After controlling for research design, industry funded research reports were no more likely to receive a neutral or negative quality rating than those funded by government sources. CONCLUSION: Research report quality cannot be accurately predicted from the funding source after controlling for research design. Continued vigilance to evaluate the quality of all research regardless of the funding source and to further understand other factors that affect quality ratings are warranted

Jet energy measurement with the ATLAS detector in proton-proton collisions at root s=7 TeV

The jet energy scale and its systematic uncertainty are determined for jets measured with the ATLAS detector at the LHC in proton-proton collision data at a centre-of-mass energy of √s = 7TeV corresponding to an integrated luminosity of 38 pb-1. Jets are reconstructed with the anti-kt algorithm with distance parameters R=0. 4 or R=0. 6. Jet energy and angle corrections are determined from Monte Carlo simulations to calibrate jets with transverse momenta pT≥20 GeV and pseudorapidities {pipe}η{pipe}<4. 5. The jet energy systematic uncertainty is estimated using the single isolated hadron response measured in situ and in test-beams, exploiting the transverse momentum balance between central and forward jets in events with dijet topologies and studying systematic variations in Monte Carlo simulations. The jet energy uncertainty is less than 2. 5 % in the central calorimeter region ({pipe}η{pipe}<0. 8) for jets with 60≤pT<800 GeV, and is maximally 14 % for pT<30 GeV in the most forward region 3. 2≤{pipe}η{pipe}<4. 5. The jet energy is validated for jet transverse momenta up to 1 TeV to the level of a few percent using several in situ techniques by comparing a well-known reference such as the recoiling photon pT, the sum of the transverse momenta of tracks associated to the jet, or a system of low-pT jets recoiling against a high-pT jet. More sophisticated jet calibration schemes are presented based on calorimeter cell energy density weighting or hadronic properties of jets, aiming for an improved jet energy resolution and a reduced flavour dependence of the jet response. The systematic uncertainty of the jet energy determined from a combination of in situ techniques is consistent with the one derived from single hadron response measurements over a wide kinematic range. The nominal corrections and uncertainties are derived for isolated jets in an inclusive sample of high-pT jets. Special cases such as event topologies with close-by jets, or selections of samples with an enhanced content of jets originating from light quarks, heavy quarks or gluons are also discussed and the corresponding uncertainties are determined. © 2013 CERN for the benefit of the ATLAS collaboration

Measurement of the inclusive and dijet cross-sections of b-jets in pp collisions at sqrt(s) = 7 TeV with the ATLAS detector

The inclusive and dijet production cross-sections have been measured for jets containing b-hadrons (b-jets) in proton-proton collisions at a centre-of-mass energy of sqrt(s) = 7 TeV, using the ATLAS detector at the LHC. The measurements use data corresponding to an integrated luminosity of 34 pb^-1. The b-jets are identified using either a lifetime-based method, where secondary decay vertices of b-hadrons in jets are reconstructed using information from the tracking detectors, or a muon-based method where the presence of a muon is used to identify semileptonic decays of b-hadrons inside jets. The inclusive b-jet cross-section is measured as a function of transverse momentum in the range 20 < pT < 400 GeV and rapidity in the range |y| < 2.1. The bbbar-dijet cross-section is measured as a function of the dijet invariant mass in the range 110 < m_jj < 760 GeV, the azimuthal angle difference between the two jets and the angular variable chi in two dijet mass regions. The results are compared with next-to-leading-order QCD predictions. Good agreement is observed between the measured cross-sections and the predictions obtained using POWHEG + Pythia. MC@NLO + Herwig shows good agreement with the measured bbbar-dijet cross-section. However, it does not reproduce the measured inclusive cross-section well, particularly for central b-jets with large transverse momenta.Comment: 10 pages plus author list (21 pages total), 8 figures, 1 table, final version published in European Physical Journal

Characteristics of the Mesophotic Megabenthic Assemblages of the Vercelli Seamount (North Tyrrhenian Sea)

The biodiversity of the megabenthic assemblages of the mesophotic zone of a Tyrrhenian seamount (Vercelli Seamount) is described using Remotely Operated Vehicle (ROV) video imaging from 100 m depth to the top of the mount around 61 m depth. This pinnacle hosts a rich coralligenous community characterized by three different assemblages: (i) the top shows a dense covering of the kelp Laminaria rodriguezii; (ii) the southern side biocoenosis is mainly dominated by the octocorals Paramuricea clavata and Eunicella cavolinii; while (iii) the northern side of the seamount assemblage is colonized by active filter-feeding organisms such as sponges (sometimes covering 100% of the surface) with numerous colonies of the ascidian Diazona violacea, and the polychaete Sabella pavonina. This study highlights, also for a Mediterranean seamount, the potential role of an isolated rocky peak penetrating the euphotic zone, to work as an aggregating structure, hosting abundant benthic communities dominated by suspension feeders, whose distribution may vary in accordance to the geomorphology of the area and the different local hydrodynamic conditions

Climate Change, Coral Reef Ecosystems, and Management Options for Marine Protected Areas

Marine protected areas (MPAs) provide place-based management of marine ecosystems through various degrees and types of protective actions. Habitats such as coral reefs are especially susceptible to degradation resulting from climate change, as evidenced by mass bleaching events over the past two decades. Marine ecosystems are being altered by direct effects of climate change including ocean warming, ocean acidification, rising sea level, changing circulation patterns, increasing severity of storms, and changing freshwater influxes. As impacts of climate change strengthen they may exacerbate effects of existing stressors and require new or modified management approaches; MPA networks are generally accepted as an improvement over individual MPAs to address multiple threats to the marine environment. While MPA networks are considered a potentially effective management approach for conserving marine biodiversity, they should be established in conjunction with other management strategies, such as fisheries regulations and reductions of nutrients and other forms of land-based pollution. Information about interactions between climate change and more “traditional” stressors is limited. MPA managers are faced with high levels of uncertainty about likely outcomes of management actions because climate change impacts have strong interactions with existing stressors, such as land-based sources of pollution, overfishing and destructive fishing practices, invasive species, and diseases. Management options include ameliorating existing stressors, protecting potentially resilient areas, developing networks of MPAs, and integrating climate change into MPA planning, management, and evaluation

Measurement of the cross-section for b-jets produced in association with a Z boson at root s=7 TeV with the ATLAS detector ATLAS Collaboration

A measurement is presented of the inclusive cross-section for b-jet production in association with a Z boson in pp collisions at a centre-of-mass energy of root s = 7 TeV. The analysis uses the data sample collected by the ATLAS experiment in 2010, corresponding to an integrated luminosity of approximately 36 pb(-1). The event selection requires a Z boson decaying into high P-T electrons or muons, and at least one b-jet, identified by its displaced vertex, with transverse momentum p(T) > 25 GeV and rapidity vertical bar y vertical bar < 2.1. After subtraction of background processes, the yield is extracted from the vertex mass distribution of the candidate b-jets. The ratio of this cross-section to the inclusive Z cross-section (the average number of b-jets per Z event) is also measured. Both results are found to be in good agreement with perturbative QCD predictions at next-to-leading order

First measurement of coherent ρ0 photoproduction in ultra-peripheral Xe–Xe collisions at √sNN = 5.44 TeV

The first measurement of the coherent photoproduction of ρ0 vector mesons in ultra-peripheral Xe–Xe collisions at sNN=5.44 TeV is presented. This result, together with previous HERA γp data and γ–Pb measurements from ALICE, describes the atomic number (A) dependence of this process, which is particularly sensitive to nuclear shadowing effects and to the approach to the black-disc limit of QCD at a semi-hard scale. The cross section of the Xe+Xe→ρ0+Xe+Xe process, measured at midrapidity through the decay channel ρ0→π+π−, is found to be dσ/dy=131.5±5.6(stat.)−16.9+17.5(syst.) mb. The ratio of the continuum to resonant contributions for the production of pion pairs is also measured. In addition, the fraction of events accompanied by electromagnetic dissociation of either one or both colliding nuclei is reported. The dependence on A of cross section for the coherent ρ0 photoproduction at a centre-of-mass energy per nucleon of the γA system of WγA,n=65 GeV is found to be consistent with a power-law behaviour σ(γA→ρ0A)∝Aα with a slope α=0.96±0.02(syst.). This slope signals important shadowing effects, but it is still far from the behaviour expected in the black-disc limit.publishedVersio