Design choices for agent-based control of AGVs in the dough making process

In this paper we consider a multi-agent system (MAS) for the logistics control of Automatic Guided Vehicles (AGVs) that are used in the dough making process at an industrial bakery. Here, logistics control refers to constructing robust schedules for all transportation jobs. The paper discusses how alternative MAS designs can be developed and compared using cost, frequency of messages between agents, and computation time for evaluating control rules as performance indicators. Qualitative design guidelines turn out to be insufficient to select the best agent architecture. Therefore, we also use simulation to support decision making, where we use real-life data from the bakery to evaluate several alternative designs. We find that architectures in which line agents initiate allocation of transportation jobs, and AGV agents schedule multiple jobs in advance, perform best. We conclude by discussing the benefits of our MAS systems design approach for real-life applications

Application of Reinforcement Learning to Multi-Agent Production Scheduling

Reinforcement learning (RL) has received attention in recent years from agent-based researchers because it can be applied to problems where autonomous agents learn to select proper actions for achieving their goals based on interactions with their environment. Each time an agent performs an action, the environment¡Šs response, as indicated by its new state, is used by the agent to reward or penalize its action. The agent¡Šs goal is to maximize the total amount of reward it receives over the long run. Although there have been several successful examples demonstrating the usefulness of RL, its application to manufacturing systems has not been fully explored. The objective of this research is to develop a set of guidelines for applying the Q-learning algorithm to enable an individual agent to develop a decision making policy for use in agent-based production scheduling applications such as dispatching rule selection and job routing. For the dispatching rule selection problem, a single machine agent employs the Q-learning algorithm to develop a decision-making policy on selecting the appropriate dispatching rule from among three given dispatching rules. In the job routing problem, a simulated job shop system is used for examining the implementation of the Q-learning algorithm for use by job agents when making routing decisions in such an environment. Two factorial experiment designs for studying the settings used to apply Q-learning to the single machine dispatching rule selection problem and the job routing problem are carried out. This study not only investigates the main effects of this Q-learning application but also provides recommendations for factor settings and useful guidelines for future applications of Q-learning to agent-based production scheduling

An iterative agent bidding mechanism for responsive manufacturing

In today's market, the global competition has put manufacturing businesses in great pressures to respond rapidly to dynamic variations in demand patterns across products and changing product mixes. To achieve substantial responsiveness, the manufacturing activities associated with production planning and control must be integrated dynamically, efficiently and cost-effectively. This paper presents an iterative agent bidding mechanism, which performs dynamic integration of process planning and production scheduling to generate optimised process plans and schedules in response to dynamic changes in the market and production environment. The iterative bidding procedure is carried out based on currency-like metrics in which all operations (e.g. machining processes) to be performed are assigned with virtual currency values, and resource agents bid for the operations if the costs incurred for performing them are lower than the currency values. The currency values are adjusted iteratively and resource agents re-bid for the operations based on the new set of currency values until the total production cost is minimised. A simulated annealing optimisation technique is employed to optimise the currency values iteratively. The feasibility of the proposed methodology has been validated using a test case and results obtained have proven the method outperforming non-agent-based methods

A human centred hybrid MAS and meta-heuristics based system for simultaneously supporting scheduling and plant layout adjustment

Manufacturing activities and production control are constantly growing. Despite this, it is necessary to improve the increasing variety of scheduling and layout adjustments for dynamic and flexible responses in volatile environments with disruptions or failures. Faced with the lack of realistic and practical manufacturing scenarios, this approach allows simulating and solving the problem of job shop scheduling on a production system by taking advantage of genetic algorithm and particle swarm optimization algorithm combined with the flexibility and robustness of a multi-agent system and dynamic rescheduling alternatives. Therefore, this hybrid decision support system intends to obtain optimized solutions and enable humans to interact with the system to properly adjust priorities or refine setups or solutions, in an interactive and user-friendly way. The system allows to evaluate the optimization performance of each one of the algorithms proposed, as well as to obtain decentralization in responsiveness and dynamic decisions for rescheduling due to the occurance of unexpected events.This work has been supported by FCT - Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2019

Multi Agent Systems in Logistics: A Literature and State-of-the-art Review

Based on a literature survey, we aim to answer our main question: “How should we plan and execute logistics in supply chains that aim to meet today’s requirements, and how can we support such planning and execution using IT?†Today’s requirements in supply chains include inter-organizational collaboration and more responsive and tailored supply to meet specific demand. Enterprise systems fall short in meeting these requirements The focus of planning and execution systems should move towards an inter-enterprise and event-driven mode. Inter-organizational systems may support planning going from supporting information exchange and henceforth enable synchronized planning within the organizations towards the capability to do network planning based on available information throughout the network. We provide a framework for planning systems, constituting a rich landscape of possible configurations, where the centralized and fully decentralized approaches are two extremes. We define and discuss agent based systems and in particular multi agent systems (MAS). We emphasize the issue of the role of MAS coordination architectures, and then explain that transportation is, next to production, an important domain in which MAS can and actually are applied. However, implementation is not widespread and some implementation issues are explored. In this manner, we conclude that planning problems in transportation have characteristics that comply with the specific capabilities of agent systems. In particular, these systems are capable to deal with inter-organizational and event-driven planning settings, hence meeting today’s requirements in supply chain planning and execution.supply chain;MAS;multi agent systems

Organizational alternatives for flexible manufacturing systems

There is an increasing importance of different productive architectures related to worker involvement in the decision making, where is given due attention to the intuitive capabilities and the human knowledge in the optimization and flexibilization of manufacturing processes. Thus having reference point architecture of a flexible manufacturing and assembling system existent at UNINOVA-CRI, we will present some exploratory hypothesis about applicability of the concept of hybridization and its repercussions on the definition of jobs, in those organizations and in the formation of working teams.flexibility; robotics; work organization; manufacturing industry

Exact and Heuristic Algorithms for the Job Shop Scheduling Problem with Earliness and Tardiness Over a Common Due Date

Scheduling has turned out to be a fundamental activity for both production and service organizations. As competitive markets emerge, Just-In-Time (JIT) production has obtained more importance as a way of rapidly responding to continuously changing market forces. Due to their realistic assumptions, job shop production environments have gained much research effort among scheduling researchers. This research develops exact and heuristic methods and algorithms to solve the job shop scheduling problem when the objective is to minimize both earliness and tardiness costs over a common due date. The objective function of minimizing earliness and tardiness costs captures the essence of the JIT approach in job shops. A dynamic programming procedure is developed to solve smaller instances of the problem, and a Multi-Agent Systems approach is developed and implemented to solve the problem for larger instances since this problem is known to be NP-Hard in a strong sense. A combinational auction-based approach using a Mixed-Integer Linear Programming (MILP) model to construct and evaluate the bids is proposed. The results showed that the proposed combinational auction-based algorithm is able to find optimal solutions for problems that are balanced in processing times across machines. A price discrimination process is successfully implemented to deal with unbalanced problems. The exact and heuristic procedures developed in this research are the first steps to create a structured approach to handle this problem and as a result, a set of benchmark problems will be available to the scheduling research community

Proceedings of the third International Workshop of the IFIP WG5.7

Contents of the papers presented at the international workshop deal with the wide variety of new and computer-based techniques for production planning and control that has become available to the scientific and industrial world in the past few years: formal modeling techniques, artificial neural networks, autonomous agent theory, genetic algorithms, chaos theory, fuzzy logic, simulated annealing, tabu search, simulation and so on. The approach, while being scientifically rigorous, is focused on the applicability to industrial environment

Agent-based hierarchical production planning and scheduling in make-to-order manufacturing system

PublishedThis is the author accepted manuscript. The final version is available from Elsevier via the DOI in this record.Nowadays, manufacturing organisations face increasing pressures from the frequent change in product type, continuous demand fluctuation and unexpected change in customer requirements. In order to survive in the turbulent environment, manufacturing organisations must become flexible and responsive to these dynamic changes in the business environment. This paper presents a hierarchical agent bidding mechanism that is particularly designed for Make-to-Order manufacturing system and attempts to enhance the operational flexibility of manufacturing system in dealing with dynamic changes in the business environment. The novelty of this mechanism is that it enables manufacturing resources to be self-organised cost-efficiently within structural constraints of manufacturing system for fulfilling customer orders. However, when orders cannot be fulfilled within the structural constraints of manufacturing systems, the mechanism can enable manufacturing resources to be regrouped flexibly across system boundaries but with minimum disturbances to existing system structure. Based on an example application to a manufacturing company, this paper demonstrates that the operational flexibility provided by this mechanism is able to help manufacturing system to respond demand fluctuation through balancing the capacity across the entire system. Meanwhile, this mechanism potentially enables manufacturing systems to deal with unexpected changes in product type. As long as the manufacturing system has the technicality required by a new product, this mechanism enables resources across the manufacturing system to be cost-efficiently and flexibly self-organised to fulfil the new product