AI for Classic Video Games using Reinforcement Learning

Deep reinforcement learning is a technique to teach machines tasks based on trial and error experiences in the way humans learn. In this paper, some preliminary research is done to understand how reinforcement learning and deep learning techniques can be combined to train an agent to play Archon, a classic video game. We compare two methods to estimate a Q function, the function used to compute the best action to take at each point in the game. In the first approach, we used a Q table to store the states and weights of the corresponding actions. In our experiments, this method converged very slowly. Our second approach was similar to that of [1]: We used a convolutional neural network (CNN) to determine a Q function. This deep neural network model successfully learnt to control the Archon player using keyboard event that it generated. We observed that the second approaches Q function converged faster than the first. For the latter method, the neural net was trained only using prediodic screenshots taken while it was playing. Experiments were conducted on a machine that did not have a GPU, so our training was slower as compared to [1]

Multi-Agent Cooperation for Particle Accelerator Control

We present practical investigations in a real industrial controls environment for justifying theoretical DAI (Distributed Artificial Intelligence) results, and we discuss theoretical aspects of practical investigations for accelerator control and operation. A generalized hypothesis is introduced, based on a unified view of control, monitoring, diagnosis, maintenance and repair tasks leading to a general method of cooperation for expert systems by exchanging hypotheses. This has been tested for task and result sharing cooperation scenarios. Generalized hypotheses also allow us to treat the repetitive diagnosis-recovery cycle as task sharing cooperation. Problems with such a loop or even recursive calls between the different agents are discussed

Cooperation in Industrial Systems

ARCHON is an ongoing ESPRIT II project (P-2256) which is approximately half way through its five year duration. It is concerned with defining and applying techniques from the area of Distributed Artificial Intelligence to the development of real-size industrial applications. Such techniques enable multiple problem solvers (e.g. expert systems, databases and conventional numerical software systems) to communicate and cooperate with each other to improve both their individual problem solving behavior and the behavior of the community as a whole. This paper outlines the niche of ARCHON in the Distributed AI world and provides an overview of the philosophy and architecture of our approach the essence of which is to be both general (applicable to the domain of industrial process control) and powerful enough to handle real-world problems

Sustaining Public Engagement: Embedded Deliberation in Local Communities

Describes nine communities using organized deliberation to consider public issues over several years and their accomplishments and analyzes how public deliberation addresses deficits in local democratic governance. Includes benchmarks and strategies

Coordination approaches and systems - part I : a strategic perspective

This is the first part of a two-part paper presenting a fundamental review and summary of research of design coordination and cooperation technologies. The theme of this review is aimed at the research conducted within the decision management aspect of design coordination. The focus is therefore on the strategies involved in making decisions and how these strategies are used to satisfy design requirements. The paper reviews research within collaborative and coordinated design, project and workflow management, and, task and organization models. The research reviewed has attempted to identify fundamental coordination mechanisms from different domains, however it is concluded that domain independent mechanisms need to be augmented with domain specific mechanisms to facilitate coordination. Part II is a review of design coordination from an operational perspective

Practical applications of multi-agent systems in electric power systems

The transformation of energy networks from passive to active systems requires the embedding of intelligence within the network. One suitable approach to integrating distributed intelligent systems is multi-agent systems technology, where components of functionality run as autonomous agents capable of interaction through messaging. This provides loose coupling between components that can benefit the complex systems envisioned for the smart grid. This paper reviews the key milestones of demonstrated agent systems in the power industry and considers which aspects of agent design must still be addressed for widespread application of agent technology to occur

Public Participation and Ecological Valuation: Inclusive=Radical

This paper discusses the gender and class implications of “public participation” processes, which are increasingly used in Europe, North America, and elsewhere as a basic component of environmental and public policy decision-making. While they are grounded in strong political and ecological rationales, public participation processes can potentially exacerbate gender, ethnic, class, and other inequities. The paper focuses on the complexities of conceptualizing and designing public participation processes which are gender- and diversity-sensitive and take into account the different kinds of relationships with the environment held by different members of society. The more inclusive and diversity-sensitive these processes are, the more radical their implications

On Being Responsible

Joint responsibility is a mental and behavioural state which captures and formalizes many of the intuitive underpinnings of collaborative problem solving. It defines the pre-conditions which must hold before such activity can commence, how individuals should behave (in their own problem solving and towards others) once such problem solving has begun and minimum conditions which group participants must satisfy

A Global Administrative Law Bibliography

Additive Manufacturing (AM) comprises a family of different technologies that build up parts by adding materials layer by layer at a time based on a digital 3D solid model. After thirty years of development, AM has become a mainstream manufacturing process with more materials and new technologies involved in this process. Undoubtedly, the most dramatic and challenging development of group of technologies has been the printing of metals. Nowadays, the use of AM for the production of parts for final products continues to grow. Organizations around the world are successfully applying the technology to the production of finished goods. AM allows design optimization and produces customized parts on-demand with almost similar material properties with the conventional manufactured parts. It does not require the use of coolants, fixtures, cutting tools and other assisting resources. The advantages of AM over conventional manufacturing can change the world of industry and lead to a new industrial revolution. In this research after reviewing mostly the different technologies and materials used in metallic AM, the application of them in a component of a passenger car engine is described. A criticality analysis is carried out in order to decide which AM development of the parts that compose the final product is more significant for the efficiency of the overall product. Based on that development a sustainability analysis is performed consisting of the analysis of the environmental impacts, the production cost analysis and the societal impact. But what has been derived from the analysis is that despite the lower environmental impact compared with the casting as a conventional method of forming of metals, AM is costly for the production of a small number of industrial products and its societal impact needs further investigation. In fact, the cost depends on the production volume, the batch size as well as the high price of the material powders and the building rates of the machines. In the future, with more advanced machines and cheaper material input the cost of metallic AM is going to drop dramatically. In spite of all the progress, the application of metallic AM is still not widespread. Since the materials as well as its technologies are still evolving, a better and more promising future is foreseen for metallic AM. Keywords: Additive Manufacturing, Direct Digital Manufacturing, Mass Production, Automotive, Internal Combustion Engine, Turbocharger, Development, Sustainability Analysis, Lifecycle AssessmentAdditive Manufacturing (AM) består av en familj av olika teknologier som bygger upp komponenter genom att lägga till material lager efter lager ett lager i taget baserat på en digital 3D solid modell. Efter trettio år av utveckling, har AM blivit en mainstream tillverkningsprocess med fler material och nya teknologier involverade i denna process. Utan tvekan har den mest dramatiska och utmanande utvecklingen inom denna grupp av teknologier varit tryckningen av metaller. Nuförtiden fortsätter användningen av AM för tillverkning av delar till slutprodukter att växa. Företag runtom i världen använder tekniken framgångsrikt för produktionen av färdiga varor. AM tillåter designoptimering och tillverkar kundanpassade delar on-demand med nästan samma materialegenskaper som konventionellt tillverkade delar. Det behövs inte användning av kylmedel, fixturer, skärverktyg och andra källor. Fördelarna med AM jämfört med konventionell tillverkning kan förändra den industriella världen och leda till en ny industriell revolution. Efter att mestadels ha gått igenom de olika tekniker och material som används i metallisk AM, beskrivs i denna forskning applikationen av dem i en komponent av motorn till en personbil. En kritikalitet analys görs för att bestämma vilken AM utveckling av de delar som utgör den slutgiltiga produkten som är viktigast för effektiviteten av den totala produktionen. Baserat på denna utveckling utförs en hållbarhetsanalys som består av en analys av miljöpåverkan, produktionskostnad och de samhälleliga effekterna. Men det som har härletts från analysen är att trots den lägre miljöpåverkan i jämförelse med gjutning som en konventionell metod för formning av metaller, är AM kostsamt för produktionen av ett fåtal industriella produkter och dess samhälleliga effekter behöver studeras ytterligare. I själva verket beror kostnaden på produktionsvolymen, satsstorleken samt det höga priset på materialpulvren och byggnadstakten av maskinerna. I framtiden, med mer avancerade maskiner och billigare material kommer kostnaden för metallisk AM att sjunka dramatiskt. Trots alla utveckling, är applikationen av metallisk AM fortfarande inte utbredd. Eftersom materialen samt dess teknik fortfarande är under utveckling förutses en bättre och mer lovande framtid för metallisk AM. Nyckelord: Additive Manufacturing, Direct Digital Manufacturing, massproduktion, bilindustrin, förbränningsmotor, Turbocharger, utveckling, hållbarhetsanalys, livscykelanalys