Multi-Agent Distributed Reinforcement Learning for Making Decentralized Offloading Decisions

We formulate computation offloading as a decentralized decision-making problem with autonomous agents. We design an interaction mechanism that incentivizes agents to align private and system goals by balancing between competition and cooperation. The mechanism provably has Nash equilibria with optimal resource allocation in the static case. For a dynamic environment, we propose a novel multi-agent online learning algorithm that learns with partial, delayed and noisy state information, and a reward signal that reduces information need to a great extent. Empirical results confirm that through learning, agents significantly improve both system and individual performance, e.g., 40% offloading failure rate reduction, 32% communication overhead reduction, up to 38% computation resource savings in low contention, 18% utilization increase with reduced load variation in high contention, and improvement in fairness. Results also confirm the algorithm's good convergence and generalization property in significantly different environments

How Many Minds Do We Need? Toward A One-System Account of Human Reasoning

To explain data from the reasoning and decision-making literature, dual-process theorists claim that human reasoning is divided: Type-1 processes are fast, automatic, associative, and evolutionarily old, while Type-2 processes are slow, effortful, rule-based, and evolutionarily new. Philosophers have used this distinction to their own philosophic ends in moral reasoning, epistemology, and philosophy of mind. I criticize dual-process theory on conceptual and empirical grounds and propose an alternative cognitive architecture for human reasoning. In chapter 1, I identify and clarify the key elements of dual-process and dual-system theory. Then, in chapter 2, I undercut an inference to the best explanation for dual-process theory by offering a one-system alternative. I argue that a single reasoning system can accomplish the explanatory work done by positing two distinct processes or systems. In chapter 3, I argue that a one-system account of human reasoning is empirically testable—it is incompatible with there being contradictory beliefs that are produced by simultaneously occurring reasoning processes. I further argue, contra Sloman (1996), that we do not have evidence for such beliefs. Next, in chapter 4, I argue that the properties used to distinguish Type-1 from Type-2 processes cross-cut each other (e.g. there are evolutionarily new processes that are effortless). The upshot is that even if human reasoning were divided, it would not parse neatly into two tidy categories: ‘Type-1’ and ‘Type-2.’ Finally, in chapter 5, I fill in the details of my own one-system alternative. I argue that there is one reasoning system that can operate in many modes: consciously or unconsciously, automatically or controlled, and inductively or deductively. In contrast to the dual-process theorists, these properties do not cluster. For each property pair (e.g. automatic/controlled), and for a single instance of a task, the reasoning system will operate in a definitive mode. The reasoning system is like a mixing board: it has several switches and slides, one for each property pair. As subjects work through problems, they can alter the switches and slides—they can, perhaps unconsciously, change the process they use to complete the problem

Special Topics in Information Technology

This open access book presents thirteen outstanding doctoral dissertations in Information Technology from the Department of Electronics, Information and Bioengineering, Politecnico di Milano, Italy. Information Technology has always been highly interdisciplinary, as many aspects have to be considered in IT systems. The doctoral studies program in IT at Politecnico di Milano emphasizes this interdisciplinary nature, which is becoming more and more important in recent technological advances, in collaborative projects, and in the education of young researchers. Accordingly, the focus of advanced research is on pursuing a rigorous approach to specific research topics starting from a broad background in various areas of Information Technology, especially Computer Science and Engineering, Electronics, Systems and Control, and Telecommunications. Each year, more than 50 PhDs graduate from the program. This book gathers the outcomes of the thirteen best theses defended in 2019-20 and selected for the IT PhD Award. Each of the authors provides a chapter summarizing his/her findings, including an introduction, description of methods, main achievements and future work on the topic. Hence, the book provides a cutting-edge overview of the latest research trends in Information Technology at Politecnico di Milano, presented in an easy-to-read format that will also appeal to non-specialists

3D-in-2D Displays for ATC.

This paper reports on the efforts and accomplishments of the 3D-in-2D Displays for ATC project at the end of Year 1. We describe the invention of 10 novel 3D/2D visualisations that were mostly implemented in the Augmented Reality ARToolkit. These prototype implementations of visualisation and interaction elements can be viewed on the accompanying video. We have identified six candidate design concepts which we will further research and develop. These designs correspond with the early feasibility studies stage of maturity as defined by the NASA Technology Readiness Level framework. We developed the Combination Display Framework from a review of the literature, and used it for analysing display designs in terms of display technique used and how they are combined. The insights we gained from this framework then guided our inventions and the human-centered innovation process we use to iteratively invent. Our designs are based on an understanding of user work practices. We also developed a simple ATC simulator that we used for rapid experimentation and evaluation of design ideas. We expect that if this project continues, the effort in Year 2 and 3 will be focus on maturing the concepts and employment in a operational laboratory settings

An investigation into Indian apparel and textile supply chain networks

The activities of the Indian clothing industry supplying Western markets have been investigated, with particular reference to identifying where improvements could be made to supply chain management. Focus group discussions, case studies and questionnaire analysis established that long lead-times in pre-production areas were of great concern. However Indian apparel manufacturers were found to be more cost conscious and rather less conscious about the value of time in pre-production areas. It was found that pre-production activities constituted 73% of total manufacturing lead time and have high positive correlation (0.96) with total manufacturing lead time. Preproduction activities in India mainly consist of prototype making and pre-production sample development; of which approval processes were found to have a high correlation (0.63) with pre-production. A significant (more than 50%) time of all activities consist of waiting time, which has positive influence on total lead time (0.86)

Evolutionary games on graphs

Game theory is one of the key paradigms behind many scientific disciplines from biology to behavioral sciences to economics. In its evolutionary form and especially when the interacting agents are linked in a specific social network the underlying solution concepts and methods are very similar to those applied in non-equilibrium statistical physics. This review gives a tutorial-type overview of the field for physicists. The first three sections introduce the necessary background in classical and evolutionary game theory from the basic definitions to the most important results. The fourth section surveys the topological complications implied by non-mean-field-type social network structures in general. The last three sections discuss in detail the dynamic behavior of three prominent classes of models: the Prisoner's Dilemma, the Rock-Scissors-Paper game, and Competing Associations. The major theme of the review is in what sense and how the graph structure of interactions can modify and enrich the picture of long term behavioral patterns emerging in evolutionary games.Comment: Review, final version, 133 pages, 65 figure

Complexity and the Economics of Climate Change: a Survey and a Look Forward

URL des Documents de travail : http://ces.univ-paris1.fr/cesdp/cesdp2016.htmlDocuments de travail du Centre d'Economie de la Sorbonne 2016.58 - ISSN : 1955-611XWe provide a survey of the micro and macro economics of climate change from a complexity science perspective and we discuss the challenges ahead for this line of research. We identify four areas of the literature where complex system models have already produced valuable insights: (i) coalition formation and climate negotiations, (ii) macroeconomic impacts of climate-related events, (iii) energy markets and (iv) diffusion of climate-friendly technologies. On each of these issues, accounting for heterogeneity, interactions and disequilibrium dynamics provides a complementary and novel perspective to the one of standard equilibrium models. Furthermore, it highlights the potential economic benefits of mitigation and adaptation policies and the risk of under-estimating systemic climate change-related risks

Optimization Methods Applied to Power Systems Ⅱ

Electrical power systems are complex networks that include a set of electrical components that allow distributing the electricity generated in the conventional and renewable power plants to distribution systems so it can be received by final consumers (businesses and homes). In practice, power system management requires solving different design, operation, and control problems. Bearing in mind that computers are used to solve these complex optimization problems, this book includes some recent contributions to this field that cover a large variety of problems. More specifically, the book includes contributions about topics such as controllers for the frequency response of microgrids, post-contingency overflow analysis, line overloads after line and generation contingences, power quality disturbances, earthing system touch voltages, security-constrained optimal power flow, voltage regulation planning, intermittent generation in power systems, location of partial discharge source in gas-insulated switchgear, electric vehicle charging stations, optimal power flow with photovoltaic generation, hydroelectric plant location selection, cold-thermal-electric integrated energy systems, high-efficiency resonant devices for microwave power generation, security-constrained unit commitment, and economic dispatch problems