A distributed knowledge-based approach to flexible automation : the contract-net framework

Includes bibliographical references (p. 26-29)

Application of Reinforcement Learning to Multi-Agent Production Scheduling

Reinforcement learning (RL) has received attention in recent years from agent-based researchers because it can be applied to problems where autonomous agents learn to select proper actions for achieving their goals based on interactions with their environment. Each time an agent performs an action, the environment¡Šs response, as indicated by its new state, is used by the agent to reward or penalize its action. The agent¡Šs goal is to maximize the total amount of reward it receives over the long run. Although there have been several successful examples demonstrating the usefulness of RL, its application to manufacturing systems has not been fully explored. The objective of this research is to develop a set of guidelines for applying the Q-learning algorithm to enable an individual agent to develop a decision making policy for use in agent-based production scheduling applications such as dispatching rule selection and job routing. For the dispatching rule selection problem, a single machine agent employs the Q-learning algorithm to develop a decision-making policy on selecting the appropriate dispatching rule from among three given dispatching rules. In the job routing problem, a simulated job shop system is used for examining the implementation of the Q-learning algorithm for use by job agents when making routing decisions in such an environment. Two factorial experiment designs for studying the settings used to apply Q-learning to the single machine dispatching rule selection problem and the job routing problem are carried out. This study not only investigates the main effects of this Q-learning application but also provides recommendations for factor settings and useful guidelines for future applications of Q-learning to agent-based production scheduling

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Agent-based material transportation scheduling of AGV systems and its manufacturing applications

制度:新 ; 報告番号:甲3743号 ; 学位の種類:博士(工学) ; 授与年月日:2012/9/10 ; 早大学位記番号:新6114Waseda Universit

Design and development of a hybrid flexible manufacturing system : a thesis presented in fulfilment of the requirements for the degree of Master of Technology at Massey University

Volumes 1 and 2 merged.The ability of a manufacturing environment to be able to modify itself and to incorporate a wide variety of heterogeneous multi-vendor devices is becoming a matter of increasing importance in the modern manufacturing enterprise. Many companies in the past have been forced to procure devices which are compatible with existing systems but are not as suitable as other less compatible devices. The inability to be able to integrate new devices into an existing company has made such enterprises dependent on one vendor and has decreased their ability to be able to respond to changes in the market. It is said that typically 60% of orders received in a company are new orders. Therefore the ability of a company to be able to reconfigure itself and respond to such demands and reintegrate itself with new equipment requirements is of paramount importance. In the past much effort has been made towards the integration of shop floor devices in industry whereby such devices can communicate with each other so that certain tasks are able to be achieved in a single environment. Up until recently however much of this was carried out in a very much improvised fashion with no real structure existing within the factory. This meant that once the factory was set up it became a hard-wired entity and extensibility and modiflability were difficult indeed. When formalised Computer Integrated Manufacturing (CIM) system architectures were developed it was found that although they solved many existing shortcomings there were inherent problems associated with these as well. What became apparent was that a fresh approach was required that took the advantages of existing architectures and combined them into an new architecture that not only capitalised on these advantages but also nullified the weaknesses of the existing systems. This thesis outlines the design of a new FMS architecture and its implementation in a factory environment on a PC based system

PROSIS: An isoarchic structure for HMS control

International audienceThis paper presents a holonic and isoarchic approach to the Flexible Manufacturing System (FMS) control. This approach is based on a flat holonic form, where each holon is a model for each entity of the FMS, with a unifying level of communication between holons. After description of this model, called PROSIS, the interaction protocol and decision rules are presented. The objective is to increase the FMS productivity and flexibility, particularly on responsiveness aspects. This responsiveness is achieved through decentralized generation of the production tasks. The reactive behaviour of the FMS control is illustrated by the example of a flexible turning cell, upon occurrence of a failure or of an urgent batch order, and the resulting Gantt charts are shown