Bidding Games on Markov Decision Processes

In two-player games on graphs, the players move a token through a graph to produce an infinite path, which determines the qualitative winner or quantitative payoff of the game. In bidding games, in each turn, we hold an auction between the two players to determine which player moves the token. Bidding games have largely been studied with concrete bidding mechanisms that are variants of a first-price auction: in each turn both players simultaneously submit bids, the higher bidder moves the token, and pays his bid to the lower bidder in Richman bidding, to the bank in poorman bidding, and in taxman bidding, the bid is split between the other player and the bank according to a predefined constant factor. Bidding games are deterministic games. They have an intriguing connection with a fragment of stochastic games called randomturn games. We study, for the first time, a combination of bidding games with probabilistic behavior; namely, we study bidding games that are played on Markov decision processes, where the players bid for the right to choose the next action, which determines the probability distribution according to which the next vertex is chosen. We study parity and meanpayoff bidding games on MDPs and extend results from the deterministic bidding setting to the probabilistic one

An Open Source Simulation Model for Soil and Sediment Bioturbation

Bioturbation is one of the most widespread forms of ecological engineering and has significant implications for the structure and functioning of ecosystems, yet our understanding of the processes involved in biotic mixing remains incomplete. One reason is that, despite their value and utility, most mathematical models currently applied to bioturbation data tend to neglect aspects of the natural complexity of bioturbation in favour of mathematical simplicity. At the same time, the abstract nature of these approaches limits the application of such models to a limited range of users. Here, we contend that a movement towards process-based modelling can improve both the representation of the mechanistic basis of bioturbation and the intuitiveness of modelling approaches. In support of this initiative, we present an open source modelling framework that explicitly simulates particle displacement and a worked example to facilitate application and further development. The framework combines the advantages of rule-based lattice models with the application of parameterisable probability density functions to generate mixing on the lattice. Model parameters can be fitted by experimental data and describe particle displacement at the spatial and temporal scales at which bioturbation data is routinely collected. By using the same model structure across species, but generating species-specific parameters, a generic understanding of species-specific bioturbation behaviour can be achieved. An application to a case study and comparison with a commonly used model attest the predictive power of the approach

Biogeochemical consequences of a changing Arctic shelf seafloor ecosystem

Unprecedented and dramatic transformations are occurring in the Arctic in response to climate change, but academic, public, and political discourse has disproportionately focussed on the most visible and direct aspects of change, including sea ice melt, permafrost thaw, the fate of charismatic megafauna, and the expansion of fisheries. Such narratives disregard the importance of less visible and indirect processes and, in particular, miss the substantive contribution of the shelf seafloor in regulating nutrients and sequestering carbon. Here, we summarise the biogeochemical functioning of the Arctic shelf seafloor before considering how climate change and regional adjustments to human activities may alter its biogeochemical and ecological dynamics, including ecosystem function, carbon burial, or nutrient recycling. We highlight the importance of the Arctic benthic system in mitigating climatic and anthropogenic change and, with a focus on the Barents Sea, offer some observations and our perspectives on future management and policy

Research in progress: report on the ICAIL 2017 doctoral consortium

This paper arose out of the 2017 international conference on AI and law doctoral consortium. There were five students who presented their Ph.D. work, and each of them has contributed a section to this paper. The paper offers a view of what topics are currently engaging students, and shows the diversity of their interests and influences

Science Priorities for Seamounts: Research Links to Conservation and Management

Seamounts shape the topography of all ocean basins and can be hotspots of biological activity in the deep sea. The Census of Marine Life on Seamounts (CenSeam) was a field program that examined seamounts as part of the global Census of Marine Life (CoML) initiative from 2005 to 2010. CenSeam progressed seamount science by collating historical data, collecting new data, undertaking regional and global analyses of seamount biodiversity, mapping species and habitat distributions, challenging established paradigms of seamount ecology, developing new hypotheses, and documenting the impacts of human activities on seamounts. However, because of the large number of seamounts globally, much about the structure, function and connectivity of seamount ecosystems remains unexplored and unknown. Continual, and potentially increasing, threats to seamount resources from fishing and seabed mining are creating a pressing demand for research to inform conservation and management strategies. To meet this need, intensive science effort in the following areas will be needed: 1) Improved physical and biological data; of particular importance is information on seamount location, physical characteristics (e.g. habitat heterogeneity and complexity), more complete and intensive biodiversity inventories, and increased understanding of seamount connectivity and faunal dispersal; 2) New human impact data; these shall encompass better studies on the effects of human activities on seamount ecosystems, as well as monitoring long-term changes in seamount assemblages following impacts (e.g. recovery); 3) Global data repositories; there is a pressing need for more comprehensive fisheries catch and effort data, especially on the high seas, and compilation or maintenance of geological and biodiversity databases that underpin regional and global analyses; 4) Application of support tools in a data-poor environment; conservation and management will have to increasingly rely on predictive modelling techniques, critical evaluation of environmental surrogates as faunal “proxies”, and ecological risk assessment

Nuclear Factor-Kappa B Family Member RelB Inhibits Human Immunodeficiency Virus-1 Tat-Induced Tumor Necrosis Factor-Alpha Production

Human Immunodeficiency Virus-1 (HIV-1)-associated neurocognitive disorder (HAND) is likely neuroinflammatory in origin, believed to be triggered by inflammatory and oxidative stress responses to cytokines and HIV protein gene products such as the HIV transactivator of transcription (Tat). Here we demonstrate increased messenger RNA for nuclear factor-kappa B (NF-κB) family member, transcription factor RelB, in the brain of doxycycline-induced Tat transgenic mice, and increased RelB synthesis in Tat-exposed microglial cells. Since genetic ablation of RelB in mice leads to multi-organ inflammation, we hypothesized that Tat-induced, newly synthesized RelB inhibits cytokine production by microglial cells, possibly through the formation of transcriptionally inactive RelB/RelA complexes. Indeed, tumor necrosis factor-alpha (TNFα) production in monocytes isolated from RelB deficient mice was significantly higher than in monocytes isolated from RelB expressing controls. Moreover, RelB overexpression in microglial cells inhibited Tat-induced TNFα synthesis in a manner that involved transcriptional repression of the TNFα promoter, and increased phosphorylation of RelA at serine 276, a prerequisite for increased RelB/RelA protein interactions. The Rel-homology-domain within RelB was necessary for this interaction. Overexpression of RelA itself, in turn, significantly increased TNFα promoter activity, an effect that was completely blocked by RelB overexpression. We conclude that RelB regulates TNFα cytokine synthesis by competitive interference binding with RelA, which leads to downregulation of TNFα production. Moreover, because Tat activates both RelB and TNFα in microglia, and because Tat induces inflammatory TNFα synthesis via NF-κB, we posit that RelB serves as a cryoprotective, anti-inflammatory, counter-regulatory mechanism for pathogenic NF-κB activation. These findings identify a novel regulatory pathway for controlling HIV-induced microglial activation and cytokine production that may have important therapeutic implications for the management of HAND

Finite-Step Algorithms for Single-Controller and Perfect Information Stochastic Games

Abstract. After a brief survey of iterative algorithms for general stochas-tic games, we concentrate on finite-step algorithms for two special classes of stochastic games. They are Single-Controller Stochastic Games and Per-fect Information Stochastic Games. In the case of single-controller games, the transition probabilities depend on the actions of the same player in all states. In perfect information stochastic games, one of the players has exactly one action in each state. Single-controller zero-sum games are effi-ciently solved by linear programming. Non-zero-sum single-controller stochastic games are reducible to linear complementary problems (LCP). In the discounted case they can be modified to fit into the so-called LCPs of Eave’s class L. In the undiscounted case the LCP’s are reducible to Lemke’s copositive plus class. In either case Lemke’s algorithm can be used to find a Nash equilibrium. In the case of discounted zero-sum perfect informa-tion stochastic games, a policy improvement algorithm is presented. Many other classes of stochastic games with orderfield property still await efficient finite-step algorithms. 1

An approach for the identification of exemplar sites for scaling up targeted field observations of benthic biogeochemistry in heterogeneous environments

Continental shelf sediments are globally important for biogeochemical activity. Quantification of shelf-scale stocks and fluxes of carbon and nutrients requires the extrapolation of observations made at limited points in space and time. The procedure for selecting exemplar sites to form the basis of this up-scaling is discussed in relation to a UK-funded research programme investigating biogeochemistry in shelf seas. A three-step selection process is proposed in which (1) a target area representative of UK shelf sediment heterogeneity is selected, (2) the target area is assessed for spatial heterogeneity in sediment and habitat type, bed and water column structure and hydrodynamic forcing, and (3) study sites are selected within this target area encompassing the range of spatial heterogeneity required to address key scientific questions regarding shelf scale biogeochemistry, and minimise confounding variables. This led to the selection of four sites within the Celtic Sea that are significantly different in terms of their sediment, bed structure, and macrofaunal, meiofaunal and microbial community structures and diversity, but have minimal variations in water depth, tidal and wave magnitudes and directions, temperature and salinity. They form the basis of a research cruise programme of observation, sampling and experimentation encompassing the spring bloom cycle. Typical variation in key biogeochemical, sediment, biological and hydrodynamic parameters over a pre to post bloom period are presented, with a discussion of anthropogenic influences in the region. This methodology ensures the best likelihood of site-specific work being useful for up-scaling activities, increasing our understanding of benthic biogeochemistry at the UK-shelf scale