ViZDoom Competitions: Playing Doom from Pixels

This paper presents the first two editions of Visual Doom AI Competition, held in 2016 and 2017. The challenge was to create bots that compete in a multi-player deathmatch in a first-person shooter (FPS) game, Doom. The bots had to make their decisions based solely on visual information, i.e., a raw screen buffer. To play well, the bots needed to understand their surroundings, navigate, explore, and handle the opponents at the same time. These aspects, together with the competitive multi-agent aspect of the game, make the competition a unique platform for evaluating the state of the art reinforcement learning algorithms. The paper discusses the rules, solutions, results, and statistics that give insight into the agents' behaviors. Best-performing agents are described in more detail. The results of the competition lead to the conclusion that, although reinforcement learning can produce capable Doom bots, they still are not yet able to successfully compete against humans in this game. The paper also revisits the ViZDoom environment, which is a flexible, easy to use, and efficient 3D platform for research for vision-based reinforcement learning, based on a well-recognized first-person perspective game Doom

Greening of the District Heating Systems—Case Study of Local Systems

The integration of renewable energy resources into district heating systems is gaining momentum across Europe, as heat producers are expected to work towards the EU Directive of Efficient District Heating and Cooling to achieve carbon neutrality by 2050. This paper studies the techno-economic implications of transforming conventional district heating systems of six locations in Poland, generating 8.5 PJ of heat annually, into sustainable and efficient district heating systems. These new systems consist of flat solar collectors integrated with seasonal pit thermal energy storages and gas heating plants, acting as flexible heat sources, covering residual heat demand and/or increasing the parameters of the working medium in the network. Using the IEA-TIMES software, two scenarios were considered, namely STAT and DYN. The results show that reaching a 20% share of heat production by solar thermal would demand extra construction of seasonal heat storage facilities with a total capacity of 197 TJ, which is approximately 4.5 times bigger than the largest seasonal heat storage located in Vojens, Denmark. The projected increase in the prices of natural gas and CO2 emission allowances accelerates the transformation of systems towards greater use of solar heating plants. In the period 2025–2050 the heat generation costs increase by ca. 65%. The contribution of the CAPEX and OPEX costs components are presented

Greening of the District Heating Systems—Case Study of Local Systems

The integration of renewable energy resources into district heating systems is gaining momentum across Europe, as heat producers are expected to work towards the EU Directive of Efficient District Heating and Cooling to achieve carbon neutrality by 2050. This paper studies the techno-economic implications of transforming conventional district heating systems of six locations in Poland, generating 8.5 PJ of heat annually, into sustainable and efficient district heating systems. These new systems consist of flat solar collectors integrated with seasonal pit thermal energy storages and gas heating plants, acting as flexible heat sources, covering residual heat demand and/or increasing the parameters of the working medium in the network. Using the IEA-TIMES software, two scenarios were considered, namely STAT and DYN. The results show that reaching a 20% share of heat production by solar thermal would demand extra construction of seasonal heat storage facilities with a total capacity of 197 TJ, which is approximately 4.5 times bigger than the largest seasonal heat storage located in Vojens, Denmark. The projected increase in the prices of natural gas and CO2 emission allowances accelerates the transformation of systems towards greater use of solar heating plants. In the period 2025–2050 the heat generation costs increase by ca. 65%. The contribution of the CAPEX and OPEX costs components are presented