Opponent modelling in the game of tron using reinforcement learning

In this paper we propose the use of vision grids as state representation to learn to play the game Tron using neural networks and reinforcement learning. This approach speeds up learning by significantly reducing the number of unique states. Furthermore, we introduce a novel opponent modelling technique, which is used to predict the opponent’s next move. The learned model of the opponent is subsequently used in Monte-Carlo roll-outs, in which the game is simulated n-steps ahead in order to determine the expected value of conducting a certain action. Finally, we compare the performance using two different activation functions in the multi-layer perceptron, namely the sigmoid and exponential linear unit (Elu). The results show that the Elu activation function outperforms the sigmoid activation function in most cases. Furthermore, vision grids significantly increase learning speed and in most cases this also increases the agent’s performance compared to when the full grid is used as state representation. Finally, the opponent modelling technique allows the agent to learn a predictive model of the opponent’s actions, which in combination with Monte-Carlo roll-outs significantly increases the agent’s performance

Toward more flood resilience: is a diversification of flood risk management strategies the way forward?

European countries face increasing flood risks due to urbanization, increase of exposure and damage potential, and the effects of climate change. In literature and in practice, it is argued that a diversification of strategies for flood risk management (FRM) - including flood risk prevention (through pro-active spatial planning), flood defense, flood risk mitigation, flood preparation and flood recovery - makes countries more flood resilient. While this thesis is plausible, it should still be empirically scrutinized. This paper aims to do this. Drawing on existing literature we operationalize the notion of "flood resilience" into three capacities: capacity to resist; capacity to absorb and recover; and capacity to transform and adapt. Based on findings from the EU FP7 project STAR-FLOOD, we explore the degree of diversification of FRM strategies and related flood risk governance arrangements at the national level in Belgium, England, France, The Netherlands, Poland and Sweden, as well as these countries' achievement in terms of the three capacities. We found that The Netherlands and to a lesser extent Belgium have a strong "capacity to resist", France a strong "capacity to absorb and recover" and especially England a high capacity to transform and adapt. Having a diverse portfolio of FRM strategies in place may be conducive to high achievements related to the capacities to absorb/recover and to transform and adapt. Hence, we conclude that diversification of FRM strategies contributes to resilience. However, the diversification thesis should be nuanced in the sense that there are different ways to be resilient. First, the three capacities imply different rationales and normative starting points for flood risk governance, the choice between which is inherently political. Second, we found trade-offs between the three capacities, e.g. being resistant seems to lower the possibility to be absorbent. Third, to explain countries' achievements in terms of resilience, the strategies' feasibility in specific physical circumstances and their fit in existing institutional contexts (appropriateness) as well as the establishment of links between strategies, through bridging mechanisms, have also been shown to be crucial factors. The paper provides much needed reflection on the implications of this diagnosis for governments, private parties and citizens who want to increase flood resilience

Grenzen aan de samenwerking in het Rijnstroomgebied

Contains fulltext : 86851.pdf (publisher's version ) (Open Access)2 p

Achtergrond - Waterbeleid volgt calamiteit?

Contains fulltext : 82596.pdf (publisher's version ) (Open Access)8 p

Nieuwe beleidsarrangementen voor waterbeheer en ruimtelijke ordening?

Contains fulltext : 78456.pdf (author's version ) (Open Access

Natuuronderzoek in Vlaanderen. Kennis van natuur en voor beleid?

Contains fulltext : 67148.pdf (publisher's version ) (Open Access

Pioneers revisited: broadening the pioneers concept in EU environmental policy

Contains fulltext : 116925.pdf (publisher's version ) (Open Access