Local and Global Explanations of Agent Behavior: Integrating Strategy Summaries with Saliency Maps

With advances in reinforcement learning (RL), agents are now being developed in high-stakes application domains such as healthcare and transportation. Explaining the behavior of these agents is challenging, as the environments in which they act have large state spaces, and their decision-making can be affected by delayed rewards, making it difficult to analyze their behavior. To address this problem, several approaches have been developed. Some approaches attempt to convey the $\textit{global}$ behavior of the agent, describing the actions it takes in different states. Other approaches devised $\textit{local}$ explanations which provide information regarding the agent's decision-making in a particular state. In this paper, we combine global and local explanation methods, and evaluate their joint and separate contributions, providing (to the best of our knowledge) the first user study of combined local and global explanations for RL agents. Specifically, we augment strategy summaries that extract important trajectories of states from simulations of the agent with saliency maps which show what information the agent attends to. Our results show that the choice of what states to include in the summary (global information) strongly affects people's understanding of agents: participants shown summaries that included important states significantly outperformed participants who were presented with agent behavior in a randomly set of chosen world-states. We find mixed results with respect to augmenting demonstrations with saliency maps (local information), as the addition of saliency maps did not significantly improve performance in most cases. However, we do find some evidence that saliency maps can help users better understand what information the agent relies on in its decision making, suggesting avenues for future work that can further improve explanations of RL agents

Complex Adaptive Systems in a Contentious World

This article is about developing and implementing interventions that are systemically viable in a world that is constantly evolving. Geopolitical and economic forces, environmental stressors, and the weaponization of information confront us with an unprecedented level of complexity, requiring new ways of seeing and being when intervening in conflictual situations. I draw on the Complex Adaptive Systems paradigm to explore how world order emerges from the dynamics of network relationships between the players in the cyber-social landscape. This treatment elaborates on mechanisms underpinning resilience, adaptation, and transformation of socioeconomic systems in turbulent contexts. It emphasizes a need to reconsider conventional logics and mindsets. In its final analysis the article suggests that world leaders need to choose whether to persist in defending the international rule-based order or to embrace network thinking and create conditions under which each country can find a sustainable niche in a global ecosystem

Social Preferences and the Third Sector: Looking for a Microeconomic Foundation of the Local Development Path

The aim of the paper is to endorse the principle, recurrent in non-profit literature, that the third sector is an institution that supports the development process of economic systems. The third sector is considered as an institution that âÃÂÃÂfavors, transmits and cementsâÃÂàthe role of social preferences in a given economy and, in this way, it contributes to development. The paper thus considers two stances taken up in economic theory: (i) the theory of social preferences; (ii) the modern theory of development. These two stances do not exclusively and specifically refer to the third sector, and they generally follow parallel paths, rarely being aware of each other: in the paper, the third sector is assumed to form a bridge between them in that social preferences are supposed to be one of the driving forces in the change process of an economy.endogenous social preferences; third sector; local development

Knowledge management for self-organised resource allocation

Many open systems, such as networks, distributed computing and socio-technical systems address a common problem of how to define knowledge management processes to structure and guide decision-making, coordination and learning. While participation is an essential and desirable feature of such systems, the amount of information produced by its individual agents can often be overwhelming and intractable. The challenge, thus, is how to organise and process such information, so it is transformed into productive knowledge used for the resolution of collective action problems. To address this problem, we consider a study of classical Athenian democracy which investigates how the governance model of the city-state flourished. The work suggests that exceptional knowledge management, i.e. making information available for socially productive purposes, played a crucial role in sustaining its democracy for nearly 200 years, by creating processes for aggregation, alignment and codification of knowledge. We therefore examine the proposition that some properties of this historical experience can be generalised and applied to computational systems, so we establish a set of design principles intended to make knowledge management processes open, inclusive, transparent and effective in self-governed social technical systems. We operationalise three of these principles in the context of a collective action situation, namely self-organised common-pool resource allocation, exploring four governance problems: (a) how fairness can be perceived; (b) how resources can be distributed; (c) how policies should be enforced and (d) how tyranny can be opposed. By applying this operationalisation of the design principles for knowledge management processes as a complement to institutional approaches to governance, we demonstrate empirically how it can guide solutions that satisfice shared values, distribute power fairly, apply "common sense" in dealing with rule violations, and protect agents against abuse of power. We conclude by arguing that this approach to the design of open systems can provide the foundations for sustainable and democratic self-governance in socio-technical systems.Open Acces

The Emergent Logic of Health Law

The American health care system is on a glide path toward ruin. Health spending has become the fiscal equivalent of global warming, and the number of uninsured Americans is approaching fifty million. Can law help to divert our country from this path? There are reasons for deep skepticism. Law governs the provision and financing of medical care in fragmented and incoherent fashion. Commentators from diverse perspectives bemoan this chaos, casting it as an obstacle to change. I contend in this Article that pessimism about health law’s prospects is unjustified, but that a new understanding of health law’s disarray is urgently needed to guide reform. My core proposition is that the law of health care provision is best understood as an emergent system. Its contradictions and dysfunctions cannot be repaired by some master design. No one actor has a grand overview—or the power to impose a unifying vision. Countless market players, public planners, and legal and regulatory decisionmakers interact in oft-chaotic ways, clashing with, reinforcing, and adjusting to each other. Out of these interactions, a larger scheme emerges—one that incorporates the health sphere’s competing interests and values. Change in this system, for worse and for better, arises from the interplay between its myriad actors. By quitting the quest for a single, master design, we can better focus our efforts on possibilities for legal and policy change. We can and should continuously survey the landscape of stakeholders and expectations with an eye toward potential launching points for evolutionary processes—processes that leverage current institutions and incentives. What we cannot do is plan or predict these evolutionary pathways in precise detail; the complexity of interactions among market and government actors precludes fine-grained foresight of this sort. But we can determine the general direction of needed change, identify seemingly intractable obstacles, and envision ways to diminish or finesse them over time. Dysfunctional legal doctrines, interest group expectations, consumers’ anxieties, and embedded institutional and cultural barriers can all be dealt with in this way, in iterative fashion. This Article sets out a strategy for doing so. To illustrate this strategy, I suggest emergent approaches to the most urgent challenges in health care policy and law—the crises of access, value, and cost

Proceedings of Abstracts Engineering and Computer Science Research Conference 2019

© 2019 The Author(s). This is an open-access work distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. For further details please see https://creativecommons.org/licenses/by/4.0/. Note: Keynote: Fluorescence visualisation to evaluate effectiveness of personal protective equipment for infection control is © 2019 Crown copyright and so is licensed under the Open Government Licence v3.0. Under this licence users are permitted to copy, publish, distribute and transmit the Information; adapt the Information; exploit the Information commercially and non-commercially for example, by combining it with other Information, or by including it in your own product or application. Where you do any of the above you must acknowledge the source of the Information in your product or application by including or linking to any attribution statement specified by the Information Provider(s) and, where possible, provide a link to this licence: http://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/This book is the record of abstracts submitted and accepted for presentation at the Inaugural Engineering and Computer Science Research Conference held 17th April 2019 at the University of Hertfordshire, Hatfield, UK. This conference is a local event aiming at bringing together the research students, staff and eminent external guests to celebrate Engineering and Computer Science Research at the University of Hertfordshire. The ECS Research Conference aims to showcase the broad landscape of research taking place in the School of Engineering and Computer Science. The 2019 conference was articulated around three topical cross-disciplinary themes: Make and Preserve the Future; Connect the People and Cities; and Protect and Care

The Fairness Doctrine: Time for the Graveyard?

The comments examines the rationale for the fairness doctrine, the obligations arising under it, and the FCC\u27s administration of the doctrine. It further analyzes the judicial construction of the doctrine with emphasis on the doctrine\u27s functional role and Constitutional ramifications. The fairness doctrine is part of a basic broadcast philosophy that mandates viewpoints on any controversial issue of public importance be fairly presented. It is partially codified by the FCC. However, after litigation, it seems clear to the courts that the fairness doctrine and the first amendment cannot share a peaceful coexistence. It may well be that the Court is waiting for a propitious opportunity to declare that the first amendment must prevail. The Federal Communications Commission will soon be required to oversee a potential source of virtually unlimited information making this job nearly impossible