An Evolutionary Learning Approach for Adaptive Negotiation Agents

Developing effective and efficient negotiation mechanisms for real-world applications such as e-Business is challenging since negotiations in such a context are characterised by combinatorially complex negotiation spaces, tough deadlines, very limited information about the opponents, and volatile negotiator preferences. Accordingly, practical negotiation systems should be empowered by effective learning mechanisms to acquire dynamic domain knowledge from the possibly changing negotiation contexts. This paper illustrates our adaptive negotiation agents which are underpinned by robust evolutionary learning mechanisms to deal with complex and dynamic negotiation contexts. Our experimental results show that GA-based adaptive negotiation agents outperform a theoretically optimal negotiation mechanism which guarantees Pareto optimal. Our research work opens the door to the development of practical negotiation systems for real-world applications

A hybrid model of electronic negotiation : integration of negotiation support and automated negotiation models

Electronic business negotiations are enabled by different electronic negotiation models: automated negotiation models for software agents, negotiation support models for human negotiators, and auction models for both. To date, there is no electronic negotiation model that enables bilateral multi-issue negotiations between a human negotiator and a negotiation agent?an important task in electronic negotiation research. In this thesis, a model is presented that integrates the automated negotiation model and the negotiation support model. The resulting hybrid negotiation model paves the way for human-agent business negotiations. The integration of two models is realised at the levels of negotiation process, communication support and decision making. To this end, the negotiation design, negotiation process, negotiation decision making, and negotiation communication in negotiation support systems (NSSs) and agent negotiation systems (ANSs) are studied and analysed. The analyses on these points help in strengthening the motivation behind hybrid negotiation model and setting aims for the integration of an NSS and an ANS in hybrid negotiation model. We mainly propose a human-agent negotiation design, negotiation process protocols to support the design, a hybrid communication model for human-agent interaction, an agent decision-making model for negotiation with human, and a component for interoperability between NSS and ANS. The agent decision-making model is composed of heuristic and argumentation-based negotiation techniques. It is proposed after analysing different automated negotiation models for different human negotiation strategies. The proposed communication model supports human negotiator and negotiation agent to understand and process negotiation messages from each other. This communication model consists of negotiation ontology, a wrapper agent, and a proper selection of an agent communication language (ACL) and a content language. The wrapper agent plays a role for interoperability between agent system and NSS by providing a communication interface along with the negotiation ontology. The negotiation ontology, ACL and agent content language make the communication model of negotiation agent in ANS. The proposed hybrid model is realised by integrating an ANS into NSS Negoisst. The research aim is to show that a hybrid negotiation system, composed of two heterogeneous negotiation models, can enable human-agent multi-issue integrative negotiations.Elektronische ökonomische Verhandlungen werden durch verschiedene Verhandlungsmodelle ermöglicht: Automatisierte Verhandlungsmodelle für Softwareagenten, Verhandlungsunterstützung für menschliche Verhandelnde und Auktionsmodelle für Beide. Bis heute existiert kein elektronisches Verhandlungsmodell, das bilaterale multi-attributive Verhandlungen zwischen einem menschlichen Verhandelnden und einem Verhandlungsagenten ? eine wichtige Aufgabe in der Forschung im Bereich elektronischer Verhandlungen. In dieser Arbeit wird ein Modell präsentiert, welches das automatisierte Verhandlungsmodell und das Verhandlungsunterstützungsmodell integriert. Das resultierende hybride Verhandlungsmodell ebnet den Weg für ökonomische Mensch-Agent-Verhandlungen. Die Integration der zwei Modelle ist realisiert auf der Ebene von Verhandlungsprozess, Kommunikationsunterstützung und Entscheidungsunterstützung. Dazu werden Verhandlungsdesign, Verhandlungsprozess, verhandlungsbezogene Entscheidungsfindung und Verhandlungskommunikation in Verhandlungsunterstützungssystemen (NSS) und Agentenverhandlungssystemen (ANS) studiert und analysiert. Die Analysen zu diesen Punkten verstärken die Motivation hinter dem hybriden Verhandlungsmodell und bestimmen die Ziele für die Integration von NSS und ANS. Es werden hauptsächlich ein Mensch-Agent-Verhandlungsdesign, Verhandlungsprozessprotokolle zur Unterstützung des Designs, ein hybrides Kommunikationsmodell für Mensch-Agent-Kommunikation, ein Agenten-Entscheidungsmodell für die Verhandlung mit menschlichem Gegenpart und eine Komponente für die Interoperabilität zwischen NSS und ANS. Das Entscheidungsmodell für Agenten besteht aus heuristischen und argumentativen Verhandlungstechniken. Es wird aufgestellt nachdem verschiedene automatisierte Verhandlungsmodelle für verschiedene menschliche Verhandlungsstrategien analysiert worden sind. Die vorgeschlagenen Kommunikationsmodelle unterstützen menschliche Verhandler und Verhandlungsagenten dabei Verhandlungsnachrichten voneinander zu verstehen und zu verarbeiten. Dieses Kommunikationsmodell besteht aus einer Verhandlungsontologie, einem Wrapper-Agenten und einer angemessenen Auswahl der Agentenkommunikationssprache (ACL) und der Inhaltssprache. Der Wrapper-Agent spielt eine Rolle bei der Interoperabilität zwischen dem Agentensystem und dem NSS durch eine Kommunikationsschnittstelle zusammen mit der Verhandlungsontologie. Die Verhandlungsontologie, die ACL und die Inhaltssprache der Agenten ergeben das Kommunikationsmodell der Verhandlungsagenten im ANS. Das vorgestellte hybride Modell ist realisiert als Integration eines ANS in das NSS Negoisst. Das Forschungsziel ist zu zeigen, dass ein hybrides Verhandlungssystem, basierend auf zwei heterogenen Verhandlungsmodellen, integrative multi-attributive Mensch-Agent-Verhandlungen ermöglicht

A hybrid model of electronic negotiation : integration of negotiation support and automated negotiation models

Electronic business negotiations are enabled by different electronic negotiation models: automated negotiation models for software agents, negotiation support models for human negotiators, and auction models for both. To date, there is no electronic negotiation model that enables bilateral multi-issue negotiations between a human negotiator and a negotiation agent?an important task in electronic negotiation research. In this thesis, a model is presented that integrates the automated negotiation model and the negotiation support model. The resulting hybrid negotiation model paves the way for human-agent business negotiations. The integration of two models is realised at the levels of negotiation process, communication support and decision making. To this end, the negotiation design, negotiation process, negotiation decision making, and negotiation communication in negotiation support systems (NSSs) and agent negotiation systems (ANSs) are studied and analysed. The analyses on these points help in strengthening the motivation behind hybrid negotiation model and setting aims for the integration of an NSS and an ANS in hybrid negotiation model. We mainly propose a human-agent negotiation design, negotiation process protocols to support the design, a hybrid communication model for human-agent interaction, an agent decision-making model for negotiation with human, and a component for interoperability between NSS and ANS. The agent decision-making model is composed of heuristic and argumentation-based negotiation techniques. It is proposed after analysing different automated negotiation models for different human negotiation strategies. The proposed communication model supports human negotiator and negotiation agent to understand and process negotiation messages from each other. This communication model consists of negotiation ontology, a wrapper agent, and a proper selection of an agent communication language (ACL) and a content language. The wrapper agent plays a role for interoperability between agent system and NSS by providing a communication interface along with the negotiation ontology. The negotiation ontology, ACL and agent content language make the communication model of negotiation agent in ANS. The proposed hybrid model is realised by integrating an ANS into NSS Negoisst. The research aim is to show that a hybrid negotiation system, composed of two heterogeneous negotiation models, can enable human-agent multi-issue integrative negotiations.Elektronische ökonomische Verhandlungen werden durch verschiedene Verhandlungsmodelle ermöglicht: Automatisierte Verhandlungsmodelle für Softwareagenten, Verhandlungsunterstützung für menschliche Verhandelnde und Auktionsmodelle für Beide. Bis heute existiert kein elektronisches Verhandlungsmodell, das bilaterale multi-attributive Verhandlungen zwischen einem menschlichen Verhandelnden und einem Verhandlungsagenten ? eine wichtige Aufgabe in der Forschung im Bereich elektronischer Verhandlungen. In dieser Arbeit wird ein Modell präsentiert, welches das automatisierte Verhandlungsmodell und das Verhandlungsunterstützungsmodell integriert. Das resultierende hybride Verhandlungsmodell ebnet den Weg für ökonomische Mensch-Agent-Verhandlungen. Die Integration der zwei Modelle ist realisiert auf der Ebene von Verhandlungsprozess, Kommunikationsunterstützung und Entscheidungsunterstützung. Dazu werden Verhandlungsdesign, Verhandlungsprozess, verhandlungsbezogene Entscheidungsfindung und Verhandlungskommunikation in Verhandlungsunterstützungssystemen (NSS) und Agentenverhandlungssystemen (ANS) studiert und analysiert. Die Analysen zu diesen Punkten verstärken die Motivation hinter dem hybriden Verhandlungsmodell und bestimmen die Ziele für die Integration von NSS und ANS. Es werden hauptsächlich ein Mensch-Agent-Verhandlungsdesign, Verhandlungsprozessprotokolle zur Unterstützung des Designs, ein hybrides Kommunikationsmodell für Mensch-Agent-Kommunikation, ein Agenten-Entscheidungsmodell für die Verhandlung mit menschlichem Gegenpart und eine Komponente für die Interoperabilität zwischen NSS und ANS. Das Entscheidungsmodell für Agenten besteht aus heuristischen und argumentativen Verhandlungstechniken. Es wird aufgestellt nachdem verschiedene automatisierte Verhandlungsmodelle für verschiedene menschliche Verhandlungsstrategien analysiert worden sind. Die vorgeschlagenen Kommunikationsmodelle unterstützen menschliche Verhandler und Verhandlungsagenten dabei Verhandlungsnachrichten voneinander zu verstehen und zu verarbeiten. Dieses Kommunikationsmodell besteht aus einer Verhandlungsontologie, einem Wrapper-Agenten und einer angemessenen Auswahl der Agentenkommunikationssprache (ACL) und der Inhaltssprache. Der Wrapper-Agent spielt eine Rolle bei der Interoperabilität zwischen dem Agentensystem und dem NSS durch eine Kommunikationsschnittstelle zusammen mit der Verhandlungsontologie. Die Verhandlungsontologie, die ACL und die Inhaltssprache der Agenten ergeben das Kommunikationsmodell der Verhandlungsagenten im ANS. Das vorgestellte hybride Modell ist realisiert als Integration eines ANS in das NSS Negoisst. Das Forschungsziel ist zu zeigen, dass ein hybrides Verhandlungssystem, basierend auf zwei heterogenen Verhandlungsmodellen, integrative multi-attributive Mensch-Agent-Verhandlungen ermöglicht

Automated Service Negotiation Between Autonomous Computational Agents

PhDMulti-agent systems are a new computational approach for solving real world, dynamic and open system problems. Problems are conceptualized as a collection of decentralised autonomous agents that collaborate to reach the overall solution. Because of the agents autonomy, their limited rationality, and the distributed nature of most real world problems, the key issue in multi-agent system research is how to model interactions between agents. Negotiation models have emerged as suitable candidates to solve this interaction problem due to their decentralised nature, emphasis on mutual selection of an action, and the prevalence of negotiation in real social systems. The central problem addressed in this thesis is the design and engineering of a negotiation model for autonomous agents for sharing tasks and/or resources. To solve this problem a negotiation protocol and a set of deliberation mechanisms are presented which together coordinate the actions of a multiple agent system. In more detail, the negotiation protocol constrains the action selection problem solving of the agents through the use of normative rules of interaction. These rules temporally order, according to the agents' roles, communication utterances by specifying both who can say what, as well as when. Specifically, the presented protocol is a repeated, sequential model where offers are iteratively exchanged. Under this protocol, agents are assumed to be fully committed to their utterances and utterances are private between the two agents. The protocol is distributed, symmetric, supports bi and/or multi-agent negotiation as well as distributive and integrative negotiation. In addition to coordinating the agent interactions through normative rules, a set of mechanisms are presented that coordinate the deliberation process of the agents during the ongoing negotiation. Whereas the protocol normatively describes the orderings of actions, the mechanisms describe the possible set of agent strategies in using the protocol. These strategies are captured by a negotiation architecture that is composed of responsive and deliberative decision mechanisms. Decision making with the former mechanism is based on a linear combination of simple functions called tactics, which manipulate the utility of deals. The latter mechanisms are subdivided into trade-off and issue manipulation mechanisms. The trade-off mechanism generates offers that manipulate the value, rather than the overall utility, of the offer. The issue manipulation mechanism aims to increase the likelihood of an agreement by adding and removing issues into the negotiation set. When taken together, these mechanisms represent a continuum of possible decision making capabilities: ranging from behaviours that exhibit greater awareness of environmental resources and less to solution quality, to behaviours that attempt to acquire a given solution quality independently of the resource consumption. The protocol and mechanisms are empirically evaluated and have been applied to real world task distribution problems in the domains of business process management and telecommunication management. The main contribution and novelty of this research are: i) a domain independent computational model of negotiation that agents can use to support a wide variety of decision making strategies, ii) an empirical evaluation of the negotiation model for a given agent architecture in a number of different negotiation environments, and iii) the application of the developed model to a number of target domains. An increased strategy set is needed because the developed protocol is less restrictive and less constrained than the traditional ones, thus supporting development of strategic interaction models that belong more to open systems. Furthermore, because of the combination of the large number of environmental possibilities and the size of the set of possible strategies, the model has been empirically investigated to evaluate the success of strategies in different environments. These experiments have facilitated the development of general guidelines that can be used by designers interested in developing strategic negotiating agents. The developed model is grounded from the requirement considerations from both the business process management and telecommunication application domains. It has also been successfully applied to five other real world scenarios

Multi-Agent Systems

A multi-agent system (MAS) is a system composed of multiple interacting intelligent agents. Multi-agent systems can be used to solve problems which are difficult or impossible for an individual agent or monolithic system to solve. Agent systems are open and extensible systems that allow for the deployment of autonomous and proactive software components. Multi-agent systems have been brought up and used in several application domains

The Impacts of the Relation between Users and Software Agents in Delegated Negotiation: A Control Perspective

Software agents are being increasingly applied to e-commerce activities, including commerce negotiations. Agents can be used to conduct negotiation tasks on behalf of users. When users delegate negotiation tasks to agents, information technology plays a role in determining social affairs. The locus of control over social affairs partially shifts from human participants to technology. When this negotiation approach is adopted, an important question arises: how will users treat and assess their agents when they delegate negotiations to agents? It is challenging to develop agents that are able to connect with users in meaningful ways. This thesis argues that users will not treat their negotiating agents in the same manner as they treat classical computer-enabled tools or aids, because of the autonomy of the agents. When assessing agents, users will be heavily oriented towards their relationships with the agents. Drawing on several streams of literature, this thesis proposes that the notion of control helps to characterize the relationships between users and agents. Users’ experienced control will influence their assessments and adoption of their negotiating agents. Users’ experienced control can connect to instrumental control, which is a set of means that empowers the interaction between users and agents. An experiment was conducted in order to test these propositions. The experiment results provide support for the propositions

Processes of International Negotiations

Negotiations are essential mechanisms for the peaceful resolution of disputes and for maintaining stability in international relations. Negotiations can and should contribute to predictability, equity, and security among states. In achieving these goals, negotiations become important confidence-building measures. The increasing role of negotiations and of international organizations for managing the system of international order and for pursuing/achieving states' interests/policies through peaceful means has produced a fundamental evolution in the agenda, functions, and intensity of international negotiations. In the view of both researchers and negotiators over the recent past, the negotiations process that is organized along traditional lines is becoming more complex, difficult, and less effective. The processes of negotiations are in general taking more and more time and lagging behind the evolution of the international environment. Not only are the issues themselves more complex, but also, in the implementation of any agreements reached, the resolution of the issues involved will need to take place over a longer time and therefore to be managed jointly or multilaterally. Because of the increasing complexity of issues and the fast pace of changes affecting both national and international interests, it has become essential for international agreements to contain sufficient flexibility in certain of their provisions to permit dealing with uncertainty and the needs of the parties to adapt to new and changing circumstances. In this sense, international negotiations and agreements must be not only reactive but also anticipatory. These considerations indicate that a much-needed approach is one which is concerned specifically with bringing about a multinational, multicultural, and multidisciplinary understanding of and perspective on international negotiations and which also bridges the gap between practitioners and researchers. A specific objective and unique aspect of the IIASA Project on the Processes of International Negotiations (PIN Project), which started in April 1986 and was funded by the Carnegie Corporation, is the international, multidisciplinary approach brought to bear on all of the Project's activities. This was especially evident at the IIASA Conference on the Processes of International Negotiations, held in May 1987. The PIN networks in IIASA's member countries played an essential role in this Conference. To keep the focus of the work on substantive issues and on relevant applications-oriented results, while taking into account the importance and impact of different cultural and political systems in the various national approaches to negotiations, both practitioners and researchers involved in the processes of negotiations made presentations at the PIN Conference and took part in the panel discussions. These presentations form the basis for the chapters of this book. The goals of the Conference were to foster increased communication and understanding between practitioners and researchers and among various research disciplines, to present and discuss research results, and to identify possible future research activities. The participation and interaction of both high-level negotiations practitioners and researchers were considered especially valuable and unique aspects of the Conference. All of the subjects dealt with at the Conference have direct and obvious relevance to improving negotiations outcomes on, and the ability to deal effectively with, such issues as the transboundary effects (environmental, economic, etc.) of technological risk, security and confidence-building measures, and international economic cooperation -- all of which are high on the negotiations agenda of many countries