Cooperative planning in multi-agent systems

Tesis por compendio[EN] Automated planning is a centralized process in which a single planning entity, or agent, synthesizes a course of action, or plan, that satisfies a desired set of goals from an initial situation. A Multi-Agent System (MAS) is a distributed system where a group of autonomous agents pursue their own goals in a reactive, proactive and social way. Multi-Agent Planning (MAP) is a novel research field that emerges as the integration of automated planning in MAS. Agents are endowed with planning capabilities and their mission is to find a course of action that attains the goals of the MAP task. MAP generalizes the problem of automated planning in domains where several agents plan and act together by combining their knowledge, information and capabilities. In cooperative MAP, agents are assumed to be collaborative and work together towards the joint construction of a competent plan that solves a set of common goals. There exist different methods to address this objective, which vary according to the typology and coordination needs of the MAP task to solve; that is, to which extent agents are able to make their own local plans without affecting the activities of the other agents. The present PhD thesis focuses on the design, development and experimental evaluation of a general-purpose and domain-independent resolution framework that solves cooperative MAP tasks of different typology and complexity. More precisely, our model performs a multi-agent multi-heuristic search over a plan space. Agents make use of an embedded search engine based on forward-chaining Partial Order Planning to successively build refinement plans starting from an initial empty plan while they jointly explore a multi-agent search tree. All the reasoning processes, algorithms and coordination protocols are fully distributed among the planning agents and guarantee the preservation of the agents' private information. The multi-agent search is guided through the alternation of two state-based heuristic functions. These heuristic estimators use the global information on the MAP task instead of the local projections of the task of each agent. The experimental evaluation shows the effectiveness of our multi-heuristic search scheme, obtaining significant results in a wide variety of cooperative MAP tasks adapted from the benchmarks of the International Planning Competition.[ES] La planificación automática es un proceso centralizado en el que una única entidad de planificación, o agente, sintetiza un curso de acción, o plan, que satisface un conjunto deseado de objetivos a partir de una situación inicial. Un Sistema Multi-Agente (SMA) es un sistema distribuido en el que un grupo de agentes autónomos persiguen sus propias metas de forma reactiva, proactiva y social. La Planificación Multi-Agente (PMA) es un nuevo campo de investigación que surge de la integración de planificación automática en SMA. Los agentes disponen de capacidades de planificación y su propósito consiste en generar un curso de acción que alcance los objetivos de la tarea de PMA. La PMA generaliza el problema de planificación automática en dominios en los que diversos agentes planifican y actúan conjuntamente mediante la combinación de sus conocimientos, información y capacidades. En PMA cooperativa, se asume que los agentes son colaborativos y trabajan conjuntamente para la construcción de un plan competente que resuelva una serie de objetivos comunes. Existen distintos métodos para alcanzar este objetivo que varían de acuerdo a la tipología y las necesidades de coordinación de la tarea de PMA a resolver; esto es, hasta qué punto los agentes pueden generar sus propios planes locales sin afectar a las actividades de otros agentes. La presente tesis doctoral se centra en el diseño, desarrollo y evaluación experimental de una herramienta independiente del dominio y de propósito general para la resolución de tareas de PMA cooperativa de distinta tipología y nivel de complejidad. Particularmente, nuestro modelo realiza una búsqueda multi-agente y multi-heurística sobre el espacio de planes. Los agentes hacen uso de un motor de búsqueda embebido basado en Planificación de Orden Parcial de encadenamiento progresivo para generar planes refinamiento de forma sucesiva mientras exploran conjuntamente el árbol de búsqueda multiagente. Todos los procesos de razonamiento, algoritmos y protocolos de coordinación están totalmente distribuidos entre los agentes y garantizan la preservación de la información privada de los agentes. La búsqueda multi-agente se guía mediante la alternancia de dos funciones heurísticas basadas en estados. Estos estimadores heurísticos utilizan la información global de la tarea de PMA en lugar de las proyecciones locales de la tarea de cada agente. La evaluación experimental muestra la efectividad de nuestro esquema de búsqueda multi-heurístico, que obtiene resultados significativos en una amplia variedad de tareas de PMA cooperativa adaptadas a partir de los bancos de pruebas de las Competición Internacional de Planificación.[CA] La planificació automàtica és un procés centralitzat en el que una única entitat de planificació, o agent, sintetitza un curs d'acció, o pla, que satisfau un conjunt desitjat d'objectius a partir d'una situació inicial. Un Sistema Multi-Agent (SMA) és un sistema distribuït en el que un grup d'agents autònoms persegueixen les seues pròpies metes de forma reactiva, proactiva i social. La Planificació Multi-Agent (PMA) és un nou camp d'investigació que sorgeix de la integració de planificació automàtica en SMA. Els agents estan dotats de capacitats de planificació i el seu propòsit consisteix en generar un curs d'acció que aconseguisca els objectius de la tasca de PMA. La PMA generalitza el problema de planificació automàtica en dominis en què diversos agents planifiquen i actúen conjuntament mitjançant la combinació dels seus coneixements, informació i capacitats. En PMA cooperativa, s'assumeix que els agents són col·laboratius i treballen conjuntament per la construcció d'un pla competent que ressolga una sèrie d'objectius comuns. Existeixen diferents mètodes per assolir aquest objectiu que varien d'acord a la tipologia i les necessitats de coordinació de la tasca de PMA a ressoldre; és a dir, fins a quin punt els agents poden generar els seus propis plans locals sense afectar a les activitats d'altres agents. La present tesi doctoral es centra en el disseny, desenvolupament i avaluació experimental d'una ferramenta independent del domini i de propòsit general per la resolució de tasques de PMA cooperativa de diferent tipologia i nivell de complexitat. Particularment, el nostre model realitza una cerca multi-agent i multi-heuristica sobre l'espai de plans. Els agents fan ús d'un motor de cerca embegut en base a Planificació d'Ordre Parcial d'encadenament progressiu per generar plans de refinament de forma successiva mentre exploren conjuntament l'arbre de cerca multiagent. Tots els processos de raonament, algoritmes i protocols de coordinació estan totalment distribuïts entre els agents i garanteixen la preservació de la informació privada dels agents. La cerca multi-agent es guia mitjançant l'aternança de dues funcions heurístiques basades en estats. Aquests estimadors heurístics utilitzen la informació global de la tasca de PMA en lloc de les projeccions locals de la tasca de cada agent. L'avaluació experimental mostra l'efectivitat del nostre esquema de cerca multi-heurístic, que obté resultats significatius en una ampla varietat de tasques de PMA cooperativa adaptades a partir dels bancs de proves de la Competició Internacional de Planificació.Torreño Lerma, A. (2016). Cooperative planning in multi-agent systems [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/65815TESISPremiadoCompendi

A Better-response Strategy for Self-interested Planning Agents

[EN] When self-interested agents plan individually, interactions that prevent them from executing their actions as planned may arise. In these coordination problems, game-theoretic planning can be used to enhance the agents¿ strategic behavior considering the interactions as part of the agents¿ utility. In this work, we define a general-sum game in which interactions such as conflicts and congestions are reflected in the agents¿ utility. We propose a better-response planning strategy that guarantees convergence to an equilibrium joint plan by imposing a tax to agents involved in conflicts. We apply our approach to a real-world problem in which agents are Electric Autonomous Vehicles (EAVs). The EAVs intend to find a joint plan that ensures their individual goals are achievable in a transportation scenario where congestion and conflicting situations may arise. Although the task is computationally hard, as we theoretically prove, the experimental results show that our approach outperforms similar approaches in both performance and solution quality.This work is supported by the GLASS project TIN2014-55637-C2-2-R of the Spanish MINECO and the Prometeo project II/2013/019 funded by the Valencian Government.Jordán, J.; Torreño Lerma, A.; De Weerdt, M.; Onaindia De La Rivaherrera, E. (2018). A Better-response Strategy for Self-interested Planning Agents. Applied Intelligence. 48(4):1020-1040. https://doi.org/10.1007/s10489-017-1046-5S10201040484Aghighi M, Bäckström C (2016) A multi-parameter complexity analysis of cost-optimal and net-benefit planning. In: Proceedings of the Twenty-Sixth International Conference on International Conference on Automated Planning and Scheduling. AAAI Press, London, pp 2–10Bercher P, Mattmüller R (2008) A planning graph heuristic for forward-chaining adversarial planning. In: ECAI, vol 8, pp 921–922Brafman RI, Domshlak C, Engel Y, Tennenholtz M (2009) Planning games. In: IJCAI 2009, Proceedings of the 21st international joint conference on artificial intelligence, pp 73–78Bylander T (1994) The computational complexity of propositional strips planning. Artif Intell 69(1):165–204Chen X, Deng X (2006) Settling the complexity of two-player nash equilibrium. In: 47th annual IEEE symposium on foundations of computer science, 2006. FOCS’06. IEEE, pp 261–272Chien S, Sinclair A (2011) Convergence to approximate nash equilibria in congestion games. Games and Economic Behavior 71(2):315–327de Cote EM, Chapman A, Sykulski AM, Jennings N (2010) Automated planning in repeated adversarial games. In: 26th conference on uncertainty in artificial intelligence (UAI 2010), pp 376–383Dunne PE, Kraus S, Manisterski E, Wooldridge M (2010) Solving coalitional resource games. Artif Intell 174(1):20–50Fabrikant A, Papadimitriou C, Talwar K (2004) The complexity of pure nash equilibria. In: Proceedings of the thirty-sixth annual ACM symposium on theory of computing, STOC ’04, pp 604–612Friedman JW, Mezzetti C (2001) Learning in games by random sampling. J Econ Theory 98(1):55–84Ghallab M, Nau D, Traverso P (2004) Automated planning: theory & practice. ElsevierGoemans M, Mirrokni V, Vetta A (2005) Sink equilibria and convergence. In: Proceedings of the 46th annual IEEE symposium on foundations of computer science, FOCS ’05, pp 142–154Hadad M, Kraus S, Hartman IBA, Rosenfeld A (2013) Group planning with time constraints. Ann Math Artif Intell 69(3):243–291Hart S, Mansour Y (2010) How long to equilibrium? the communication complexity of uncoupled equilibrium procedures. Games and Economic Behavior 69(1):107–126Helmert M (2003) Complexity results for standard benchmark domains in planning. Artif Intell 143(2):219–262Helmert M (2006) The fast downward planning system. J Artif Intell Res 26(1):191–246Jennings N, Faratin P, Lomuscio A, Parsons S, Wooldrige M, Sierra C (2001) Automated negotiation: prospects, methods and challenges. Group Decis Negot 10(2):199–215Johnson DS, Papadimtriou CH, Yannakakis M (1988) How easy is local search? J Comput Syst Sci 37 (1):79–100Jonsson A, Rovatsos M (2011) Scaling up multiagent planning: a best-response approach. In: Proceedings of the 21st international conference on automated planning and scheduling, ICAPSJordán J, Onaindía E (2015) Game-theoretic approach for non-cooperative planning. In: 29th AAAI conference on artificial intelligence (AAAI-15), pp 1357–1363McDermott D, Ghallab M, Howe A, Knoblock C, Ram A, Veloso M, Weld D, Wilkins D (1998) PDDL: the planning domain definition language. Yale Center for Computational Vision and Control, New HavenMilchtaich I (1996) Congestion games with player-specific payoff functions. Games and Economic Behavior 13(1):111–124Monderer D, Shapley LS (1996) Potential games. Games and Economic Behavior 14(1):124–143Nigro N, Welch D, Peace J (2015) Strategic planning to implement publicly available ev charching stations: a guide for business and policy makers. Tech rep, Center for Climate and Energy SolutionsNisan N, Ronen A (2007) Computationally feasible vcg mechanisms. J Artif Intell Res 29(1):19–47Nisan N, Roughgarden T, Tardos E, Vazirani VV (2007) Algorithmic game theory. Cambridge University Press, New YorkPapadimitriou CH (1994) On the complexity of the parity argument and other inefficient proofs of existence. J Comput Syst Sci 48(3):498–532Richter S, Westphal M (2010) The LAMA planner: guiding cost-based anytime planning with landmarks. J Artif Intell Res 39(1):127–177Rosenthal RW (1973) A class of games possessing pure-strategy nash equilibria. Int J Game Theory 2(1):65–67Shoham Y, Leyton-Brown K (2009) Multiagent systems: algorithmic, game-theoretic, and logical foundations. Cambridge University PressTorreño A, Onaindia E, Sapena Ó (2014) A flexible coupling approach to multi-agent planning under incomplete information. Knowl Inf Syst 38(1):141–178Torreño A, Onaindia E, Sapena Ó (2014) FMAP: distributed cooperative multi-agent planning. Appl Intell 41(2):606– 626Torreño A, Sapena Ó, Onaindia E (2015) Global heuristics for distributed cooperative multi-agent planning. In: ICAPS 2015. 25th international conference on automated planning and scheduling. AAAI Press, pp 225–233Von Neumann J, Morgenstern O (2007) Theory of games and economic behavior. Princeton University Pressde Weerdt M, Bos A, Tonino H, Witteveen C (2003) A resource logic for multi-agent plan merging. Ann Math Artif Intell 37(1):93–130Wooldridge M, Endriss U, Kraus S, Lang J (2013) Incentive engineering for boolean games. Artif Intell 195:418–43

Global Heuristics for Distributed Cooperative Multi-Agent Planning

Almost every planner needs good heuristics to be efficient. Heuristic planning has experienced an impressive progress over the last years thanks to the emergence of more and more powerful estimators. However, this progress has not been translated to multi-agent planning (MAP) due to the difficulty of applying classical heuristics in distributed environments. The application of local search heuristics in each agent has been the most widely adopted approach in MAP but there exist some recent attempts to use global heuristics. In this paper we show that the success of global heuristics in MAP depends on a proper selection of heuristics for a distributed environment as well as on their adequate combination

Cooperative Multi-Agent Planning: A survey

[EN] Cooperative multi-agent planning (MAP) is a relatively recent research field that combines technologies, algorithms, and techniques developed by the Artificial Intelligence Planning and Multi-Agent Systems communities. While planning has been generally treated as a single-agent task, MAP generalizes this concept by considering multiple intelligent agents that work cooperatively to develop a course of action that satisfies the goals of the group. This article reviews the most relevant approaches to MAP, putting the focus on the solvers that took part in the 2015 Competition of Distributed and Multi-Agent Planning, and classifies them according to their key features and relative performance.This work is supported by the GLASS project Grant No. TIN2014-55637-C2-2-R MINECO of the Spanish Ministerio de Economia, Industria y Competitividad, the Prometeo project II/2013/019 funded by the Valencian Government, and the four-year FPI-UPV research scholarship granted to the first author by the Universitat Politecnica de Valencia. Additionally, this research was partially supported by the Czech Science Foundation under Grant No. 15-20433Y CSF.Torreño Lerma, A.; Onaindia De La Rivaherrera, E.; Komenda, A.; Tolba, M. (2017). Cooperative Multi-Agent Planning: A survey. ACM Computing Surveys. 50(6):84:1-84:32. https://doi.org/10.1145/3128584S84:184:32506Eyal Amir and Barbara Engelhardt. 2003. Factored planning. In Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI’03), Vol. 3. 929--935.J. Benton, Amanda J. Coles, and Andrew I. Coles. 2012. Temporal planning with preferences and time-dependent continuous costs. In Proceedings of the 22nd International Conference on Automated Planning and Scheduling (ICAPS’12). 2--10.Andrea Bonisoli, Alfonso E. Gerevini, Alessandro Saetti, and Ivan Serina. 2014. A privacy-preserving model for the multi-agent propositional planning problem. In Proceedings of the 21st European Conference on Artificial Intelligence (ECAI’14). 973--974.Daniel Borrajo. 2013. Multi-agent planning by plan reuse. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-agent Systems (AAMAS’13). 1141--1142.Daniel Borrajo and Susana Fernández. 2015. MAPR and CMAP. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 1--3.Craig Boutilier and Ronen I. Brafman. 2001. Partial-order planning with concurrent interacting actions. J. Artific. Intell. Res. 14 (2001), 105--136.Ronen I. Brafman. 2015. A privacy preserving algorithm for multi-agent planning and search. In Proceedings of the 24th International Joint Conference on Artificial Intelligence (IJCAI’15). 1530--1536.Ronen I. Brafman and Carmel Domshlak. 2006. Factored planning: How, when, and when not. In Proceedings of the 21st National Conference on Artificial Intelligence and the 18th Innovative Applications of Artificial Intelligence Conference. 809--814.Ronen I. Brafman and Carmel Domshlak. 2008. From one to many: Planning for loosely coupled multi-agent systems. In Proceedings of the 18th International Conference on Automated Planning and Scheduling (ICAPS’08). 28--35.Isabel Cenamor, Tomás de la Rosa, and Fernando Fernández. 2014. IBACOP and IBACOP2 planner. In Proceedings of the International Planning Competition (IPC’14).Bradley J. Clement and Edmund H. Durfee. 1999. Top-down search for coordinating the hierarchical plans of multiple agents. In Proceedings of the 3rd Annual Conference on Autonomous Agents (AGENTS’99). ACM, New York, NY, 252--259.Daniel D. Corkill. 1979. Hierarchical planning in a distributed environment. In Proceedings of the 6th International Joint Conference on Artificial Intelligence (IJCAI’79). 168--175.Jeffrey S. Cox and Edmund H. Durfee. 2004. Efficient mechanisms for multiagent plan merging. In Proceedings of the 3rd Conference on Autonomous Agents and Multiagent Systems (AAMAS’04). 1342--1343.Jeffrey S. Cox and Edmund H. Durfee. 2009. Efficient and distributable methods for solving the multiagent plan coordination problem. Multiagent Grid Syst. 5, 4 (2009), 373--408.Matthew Crosby, Anders Jonsson, and Michael Rovatsos. 2014. A single-agent approach to multiagent planning. In Proceedings of the 21st European Conference on Artificial Intelligence (ECAI’14). 237--242.Matthew Crosby, Michael Rovatsos, and Ronald P. A. Petrick. 2013. Automated agent decomposition for classical planning. In Proceedings of the 23rd International Conference on Automated Planning and Scheduling (ICAPS’13). 46--54.Mathijs de Weerdt, André Bos, Hans Tonino, and Cees Witteveen. 2003. A resource logic for multi-agent plan merging. Ann. Math. Artific. Intell. 37, 1-2 (2003), 93--130.Mathijs de Weerdt and Bradley J. Clement. 2009. Introduction to planning in multiagent systems. Multiagent Grid Syst. 5, 4 (2009), 345--355.Keith Decker, Salim Khan, Carl Schmidt, Gang Situ, Ravi Makkena, and Dennis Michaud. 2002. BioMAS: A multi-agent system for genomic annotation. Int. J. Coop. Info. Syst. 11, 3 (2002), 265--292.Keith Decker and Victor R. Lesser. 1992. Generalizing the partial global planning algorithm. Int. J. Coop. Info. Syst. 2, 2 (1992), 319--346.Marie desJardins and Michael Wolverton. 1999. Coordinating a distributed planning system. AI Mag. 20, 4 (1999), 45--53.Marie E. desJardins, Edmund H. Durfee, Charles L. Ortiz, and Michael J. Wolverton. 1999. A survey of research in distributed continual planning. AI Mag. 20, 4 (1999), 13--22.Yannis Dimopoulos, Muhammad A. Hashmi, and Pavlos Moraitis. 2012. -SATPLAN: Multi-agent planning as satisfiability. Knowl.-Based Syst. 29 (2012), 54--62.Jürgen Dix, Héctor Muñoz-Avila, Dana S. Nau, and Lingling Zhang. 2003. IMPACTing SHOP: Putting an AI planner into a multi-agent environment. Ann. Math. Artific. Intell. 37, 4 (2003), 381--407.Edmund H. Durfee. 1999. Distributed Problem Solving and Planning, Gerhard Weiss (ed.). MIT Press,118--149.Edmund H. Durfee and Victor Lesser. 1991. Partial global planning: A coordination framework for distributed hypothesis formation. IEEE Trans. Syst. Man Cybernet. Spec. Issue Distrib. Sensor Netw. 21, 5 (1991), 1167--1183.Eithan Ephrati and Jeffrey S. Rosenschein. 1994. Divide and conquer in multi-agent planning. In Proceedings of the 12th National Conference on Artificial Intelligence (AAAI’94). 375--380.Eithan Ephrati and Jeffrey S. Rosenschein. 1997. A heuristic technique for multi-agent planning. Ann. Math. Artific. Intell. 20, 1–4 (1997), 13--67.Eric Fabre, Loïg Jezequel, Patrik Haslum, and Sylvie Thiébaux. 2010. Cost-optimal factored planning: Promises and pitfalls. In Proceedings of the 20th International Conference on Automated Planning and Scheduling (ICAPS’10). 65--72.Boi Faltings, Thomas Léauté, and Adrian Petcu. 2008. Privacy guarantees through distributed constraint satisfaction. In Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT’08), Vol. 2. IEEE, 350--358.Richard Fikes and Nils J. Nilsson. 1971. STRIPS: A new approach to the application of theorem proving to problem solving. Artific. Intell. 2, 3 (1971), 189--208.Daniel Fišer, Michal Štolba, and Antonín Komenda. 2015. MAPlan. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 8--10.Foundation for Intelligent Physical Agents. 2002. FIPA Interaction Protocol Specification. Retrieved from http://www.fipa.org/repository/ips.php3.Maria Fox and Derek Long. 2003. PDDL2.1: An extension to PDDL for expressing temporal planning domains. J. Artific. Intell. Res. 20 (2003), 61--124.Malik Ghallab, Adele Howe, Craig Knoblock, Drew McDermott, Ashwin Ram, Manuela M. Veloso, Daniel Weld, and David Wilkins. 1998. PDDL—The planning domain definition language. AIPS-98 Planning Committee (1998).Malik Ghallab, Dana Nau, and Paolo Traverso. 2004. Automated Planning. Theory and Practice. Morgan Kaufmann.Barbara J. Grosz, Luke Hunsberger, and Sarit Kraus. 1999. Planning and acting together. AI Mag. 20, 4 (1999), 23--34.Malte Helmert. 2004. A planning heuristic based on causal graph analysis. Proceedings of the 14th International Conference on Automated Planning and Scheduling (ICAPS’04), 161--170.Malte Helmert. 2006. The fast downward planning system. J. Artific. Intell. Res. 26, 1 (2006), 191--246.Malte Helmert and Carmel Domshlak. 2009. Landmarks, critical paths and abstractions: What’s the difference anyway? In Proceedings of the 19th International Conference on Automated Planning and Scheduling (ICAPS’09). 162--169.Malte Helmert, Patrik Haslum, and Jörg Hoffmann. 2007. Flexible abstraction heuristics for optimal sequential planning. In Proceedings of the 17th International Conference on Automated Planning and Scheduling (ICAPS’07). 176--183.Jörg Hoffmann and Bernhard Nebel. 2001. The FF planning system: Fast planning generation through heuristic search. J. Artific. Intell. Res. 14 (2001), 253--302.Jörg Hoffmann, Julie Porteous, and Laura Sebastiá. 2004. Ordered landmarks in planning. J. Artific. Intell. Res. 22 (2004), 215--278.Jan Hrncír, Michael Rovatsos, and Michal Jakob. 2015. Ridesharing on timetabled transport services: A multiagent planning approach. J. Intell. Transportat. Syst. 19, 1 (2015), 89--105.Loïg Jezequel and Eric Fabre. 2012. A#: A distributed version of A* for factored planning. In Proceedings of the 51th IEEE Conference on Decision and Control (CDC’12). 7377--7382.Anders Jonsson and Michael Rovatsos. 2011. Scaling up multiagent planning: A best-response approach. In Proceedings of the 21st International Conference on Automated Planning and Scheduling (ICAPS’11). AAAI, 114--121.Jaume Jordán and Eva Onaindia. 2015. Game-theoretic approach for non-cooperative planning. In Proceedings of the 29th Conference on Artificial Intelligence (AAAI’15). 1357--1363.Froduald Kabanza, Lu Shuyun, and Scott Goodwin. 2004. Distributed hierarchical task planning on a network of clusters. In Proceedings of the 16th International Conference on Parallel and Distributed Computing and Systems (PDCS’04). 139--140.Henry A. Kautz. 2006. Deconstructing planning as satisfiability. In Proceedings of the National Conference on Artificial Intelligence, Vol. 21, 1524.Elena Kelareva, Olivier Buffet, Jinbo Huang, and Sylvie Thiébaux. 2007. Factored planning using decomposition trees. In Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI’07). 1942--1947.Antonín Komenda, Michal Stolba, and Daniel L. Kovacs. 2016. The international competition of distributed and multiagent planners (CoDMAP). AI Mag. 37, 3 (2016), 109--115.Daniel L. Kovacs. 2012. A multi-agent extension of PDDL3.1. In Proceedings of the 3rd Workshop on the International Planning Competition (IPC’12). 19--27.Jonas Kvarnström. 2011. Planning for loosely coupled agents using partial order forward-chaining. In Proceedings of the 21st International Conference on Automated Planning and Scheduling (ICAPS’11). AAAI, 138--145.Victor Lesser, Keith Decker, Thomas Wagner, Norman Carver, Alan Garvey, Bryan Horling, Daniel Neiman, Rodion Podorozhny, M. Nagendra Prasad, Anita Raja, Regis Vincent, Ping Xuan, and X. Q. Zhang. 2004. Evolution of the GPGP/TAEMS domain-independent coordination framework. Auton. Agents Multi-Agent Syst. 9, 1–2 (2004), 87--143.Derek Long, Henry Kautz, Bart Selman, Blai Bonet, Hector Geffner, Jana Koehler, Michael Brenner, Joerg Hoffmann, Frank Rittinger, Corin R. Anderson, Daniel S. Weld, David E. Smith, Maria Fox, and Derek Long. 2000. The AIPS-98 planning competition. AI Mag. 21, 2 (2000), 13--33.Nerea Luis and Daniel Borrajo. 2014. Plan merging by reuse for multi-agent planning. In Proceedings of the 2nd ICAPS Workshop on Distributed and Multi-Agent Planning (DMAP’14). 38--44.Nerea Luis and Daniel Borrajo. 2015. PMR: Plan merging by reuse. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 11--13.Shlomi Maliah, Ronen I. Brafman, and Guy Shani. 2017. Increased privacy with reduced communication in multi-agent planning. In Proceedings of the 27th International Conference on Automated Planning and Scheduling (ICAPS’17). 209--217.Shlomi Maliah, Guy Shani, and Roni Stern. 2014. Privacy preserving landmark detection. In Proceedings of the 21st European Conference on Artificial Intelligence (ECAI’14). 597--602.Shlomi Maliah, Guy Shani, and Roni Stern. 2016. Collaborative privacy preserving multi-agent planning. Auton. Agents Multi-Agent Syst. (2016), 1--38.Felipe Meneguzzi and Lavindra de Silva. 2015. Planning in BDI agents: A survey of the integration of planning algorithms and agent reasoning. Knowl. Eng. Rev. 30, 1 (2015), 1--44.Christian Muise, Nir Lipovetzky, and Miquel Ramirez. 2015. MAP-LAPKT: Omnipotent multi-agent planning via compilation to classical planning. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 14--16.Dana S. Nau, Tsz-Chiu Au, Okhtay Ilghami, Ugur Kuter, J. William Murdock, Dan Wu, and Fusun Yaman. 2003. SHOP2: An HTN planning system. J. Artific. Intell. Res. 20 (2003), 379--404.Raz Nissim and Ronen I. Brafman. 2012. Multi-agent A* for parallel and distributed systems. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’12). 1265--1266.Raz Nissim and Ronen I. Brafman. 2013. Cost-optimal planning by self-interested agents. In Proceedings of the 27th Conference on Artificial Intelligence (AAAI’13).Raz Nissim and Ronen I. Brafman. 2014. Distributed heuristic forward search for multi-agent planning. J. Artific. Intell. Res. 51 (2014), 293--332.Raz Nissim, Ronen I. Brafman, and Carmel Domshlak. 2010. A general, fully distributed multi-agent planning algorithm. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’10). 1323--1330.Sergio Pajares and Eva Onaindia. 2013. Context-aware multi-agent planning in intelligent environments. Info. Sciences 227 (2013), 22--42.Michal Pechoucek, Martin Rehák, Petr Charvát, Tomáš Vlcek, and Michal Kolar. 2007. Agent-based approach to mass-oriented production planning: Case study. IEEE Trans. Syst. Man Cybernet. Part C 37, 3 (2007), 386--395.Damien Pellier. 2010. Distributed planning through graph merging. In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (ICAART’10). 128--134.Miquel Ramirez, Nir Lipovetzky, and Christian Muise. 2015. Lightweight Automated Planning ToolKiT. Retrieved from http://lapkt.org/.Prashant P. Reddy and Manuela M. Veloso. 2011. Strategy learning for autonomous agents in smart grid markets. In Proceedings of the 22nd International Joint Conference on Artificial Intelligence (IJCAI’11). 1446--1451.Silvia Richter and Matthias Westphal. 2010. The LAMA planner: Guiding cost-based anytime planning with landmarks. J. Artific. Intell. Res. 39, 1 (2010), 127--177.Valentin Robu, Han Noot, Han La Poutré, and Willem-Jan van Schijndel. 2011. A multi-agent platform for auction-based allocation of loads in transportation logistics. Expert Syst. Appl. 38, 4 (2011), 3483--3491.Óscar Sapena, Eva Onaindia, Antonio Garrido, and Marlene Arangú. 2008. A distributed CSP approach for collaborative planning systems. Eng. Appl. Artific. Intell. 21, 5 (2008), 698--709.Emilio Serrano, Jose M. Such, Juan A. Botía, and Ana García-Fornes. 2013. Strategies for avoiding preference profiling in agent-based e-commerce environments. Appl. Intell. (2013), 1--16.Sven Seuken and Shlomo Zilberstein. 2008. Formal models and algorithms for decentralized decision making under uncertainty. Auton. Agents Multi-Agent Syst. 17, 2 (2008), 190--250.Guy Shani, Shlomi Maliah, and Roni Stern. 2016. Stronger privacy preserving projections for multi-agent planning. In Proceedings of the 26th International Conference on Automated Planning and Scheduling (ICAPS’16). 221--229.Claude E. Shannon. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27, 3 (1948), 379--423.Evren Sirin, Bijan Parsia, Dan Wu, James Hendler, and Dana Nau. 2004. HTN planning for web service composition using SHOP2. J. Web Semant. 1, 4 (2004), 377--396.Sarath Sreedharan, Yu Zhang, and Subbarao Kambhampati. 2015. A first multi-agent planner for required cooperation (MARC). In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 17--20.Michal Štolba, Daniel Fišer, and Antonín Komenda. 2015. Admissible landmark heuristic for multi-agent planning. In Proceedings of the 25th International Conference on Automated Planning and Scheduling (ICAPS’15). 211--219.Michal Štolba and Antonín Komenda. 2014. Relaxation heuristics for multiagent planning. In Proceedings of the 24th International Conference on Automated Planning and Scheduling (ICAPS’14). 298--306.Michal Štolba and Antonín Komenda. 2015. MADLA: Planning with distributed and local search. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 21--24.Michal Štolba, Jan Tožička, and Antonín Komenda. 2016. Quantifying privacy leakage in multi-agent planning. Proceedings of the 4rd ICAPS Workshop on Distributed and Multi-Agent Planning (DMAP’16). 80--88.Jose M. Such, Ana García-Fornes, Agustín Espinosa, and Joan Bellver. 2012. Magentix2: A privacy-enhancing agent platform. Eng. Appl. Artific. Intell. (2012), 96--109.Milind Tambe. 1997. Towards flexible teamwork. J. Artific. Intell. Res. 7 (1997), 83--124.Alejandro Torreño, Eva Onaindia, and Óscar Sapena. 2012. An approach to multi-agent planning with incomplete information. In Proceedings of the 20th European Conference on Artificial Intelligence (ECAI’12), Vol. 242. IOS Press, 762--767.Alejandro Torreño, Eva Onaindia, and Óscar Sapena. 2014. A flexible coupling approach to multi-agent planning under incomplete information. Knowl. Info. Syst. 38, 1 (2014), 141--178.Alejandro Torreño, Eva Onaindia, and Óscar Sapena. 2014. FMAP: Distributed cooperative multi-agent planning. Appl. Intell. 41, 2 (2014), 606--626.Alejandro Torreño, Eva Onaindia, and Óscar Sapena. 2015. Global heuristics for distributed cooperative multi-agent planning. In Proceedings of the 25th International Conference on Automated Planning and Scheduling (ICAPS’15). 225--233.Alejandro Torreño, Óscar Sapena, and Eva Onaindia. 2015. MH-FMAP: Alternating global heuristics in multi-agent planning. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 25--28.Jan Tožička, Jan Jakubuv, and Antonín Komenda. 2015. PSM-based planners description for CoDMAP 2015 competition. In Proceedings of the Competition of Distributed and Multi-Agent Planners (CoDMAP’15). 29--32.Jan Tožička, Jan Jakubuv, Antonín Komenda, and Michal Pěchouček. 2015. Privacy-concerned multiagent planning. Knowl. Info. Syst. 48, 3 (2016), 581–618.Jan Tožička, Michal Štolba, and Antonín Komenda. 2017. The limits of strong privacy preserving multi-agent planning. In Proceedings of the 27th International Conference on Automated Planning and Scheduling (ICAPS’17). 221--229.Roman van der Krogt. 2007. Privacy loss in classical multiagent planning. In Proceedings of the IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT’07). 168--174.Roman van der Krogt. 2009. Quantifying privacy in multiagent planning. Multiagent Grid Syst. 5, 4 (2009), 451--469.David E. Wilkins. 1988. Practical Planning: Extending the Classical AI Planning Paradigm. Morgan Kaufmann.David E. Wilkins and Karen L. Myers. 1998. A multiagent planning architecture. In Proceedings of the 4th International Conference on Artificial Intelligence Planning Systems (AIPS’98). 154--162.Michael Wolverton and Marie desJardins. 1998. Controlling communication in distributed planning using irrelevance reasoning. In Proceedings of the 15th National Conference on Artificial Intelligence (AAAI’98). 868--874.Michael Wooldridge. 1997. Agent-based software engineering. IEEE Proc. Softw. Eng. 144, 1 (1997), 26--37.Yu Zhang and Subbarao Kambhampati. 2014. A formal analysis of required cooperation in multi-agent planning. CoRR abs/1404.5643 (2014). http://arxiv.org/abs/1404.5643