Bio-inspired multi-agent systems for reconfigurable manufacturing systems

The current market’s demand for customization and responsiveness is a major challenge for producing intelligent, adaptive manufacturing systems. The Multi-Agent System (MAS) paradigm offers an alternative way to design this kind of system based on decentralized control using distributed, autonomous agents, thus replacing the traditional centralized control approach. The MAS solutions provide modularity, flexibility and robustness, thus addressing the responsiveness property, but usually do not consider true adaptation and re-configuration. Understanding how, in nature, complex things are performed in a simple and effective way allows us to mimic nature’s insights and develop powerful adaptive systems that able to evolve, thus dealing with the current challenges imposed on manufactur- ing systems. The paper provides an overview of some of the principles found in nature and biology and analyses the effectiveness of bio-inspired methods, which are used to enhance multi-agent systems to solve complex engineering problems, especially in the manufacturing field. An industrial automation case study is used to illustrate a bio-inspired method based on potential fields to dynamically route pallets

Agent-based distributed manufacturing scheduling: an ontological approach

The purpose of this paper is the need for self-sequencing operation plans in autonomous agents. These allow resolution of combinatorial optimisation of a global schedule, which consists of the fixed process plan jobs and which requires operations offered by manufacturers. The proposed agent-based approach was adapted from the bio-inspired metaheuristic- particle swarm optimisation (PSO), where agents move towards the schedule with the best global makespan. The research has achieved a novel ontology-based optimisation algorithm to allow agents to schedule operations whilst cutting down on the duration of the computational analysis, as well as improving the performance extensibility amongst others. The novelty of the research is evidenced in the development of a synchronised data sharing system allowing better decision-making resources with intrinsic manufacturing intelligence. The multi-agent platform is built upon the Java Agent Development Environment (JADE) framework. The operation research case studies were used as benchmarks for the evaluation of the proposed model. The presented approach not only showed a practical use case of a decentralised manufacturing system, but also demonstrated near optimal makespans compared to the operational research benchmarks

A human centred hybrid MAS and meta-heuristics based system for simultaneously supporting scheduling and plant layout adjustment

Manufacturing activities and production control are constantly growing. Despite this, it is necessary to improve the increasing variety of scheduling and layout adjustments for dynamic and flexible responses in volatile environments with disruptions or failures. Faced with the lack of realistic and practical manufacturing scenarios, this approach allows simulating and solving the problem of job shop scheduling on a production system by taking advantage of genetic algorithm and particle swarm optimization algorithm combined with the flexibility and robustness of a multi-agent system and dynamic rescheduling alternatives. Therefore, this hybrid decision support system intends to obtain optimized solutions and enable humans to interact with the system to properly adjust priorities or refine setups or solutions, in an interactive and user-friendly way. The system allows to evaluate the optimization performance of each one of the algorithms proposed, as well as to obtain decentralization in responsiveness and dynamic decisions for rescheduling due to the occurance of unexpected events.This work has been supported by FCT - Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2019

Use of bio-inspired techniques to solve complex engineering problems: industrial automation case study

Nowadays local markets have disappeared and the world lives in a global economy. Due to this reality, every company virtually competes with all others companies in the world. In addition to this, markets constantly search products with higher quality at lower costs, with high customization. Also, products tend to have a shorter period of life, making the demanding more intense. With this scenario, companies, to remain competitive, must constantly adapt themselves to the market changes, i.e., companies must exhibit a great degree of self-organization and self-adaptation. Biology with the millions of years of evolution may offer inspiration to develop new algorithms, methods and techniques to solve real complex problems. As an example, the behaviour of ants and bees, have inspired researchers in the pursuit of solutions to solve complex and evolvable engineering problems. This dissertation has the goal of explore the world of bio-inspired engineering. This is done by studying some of the bio-inspired solutions and searching for bio-inspired solutions to solve the daily problems. A more deep focus will be made to the engineering problems and particularly to the manufacturing domain. Multi-agent systems is a concept aligned with the bio-inspired principles offering a new approach to develop solutions that exhibit robustness, flexibility, responsiveness and re-configurability. In such distributed bio-inspired systems, the behaviour of each entity follows simple few rules, but the overall emergent behaviour is very complex to understand and to demonstrate. Therefore, the design and simulation of distributed agent-based solutions, and particularly those exhibiting self-organizing, are usually a hard task. Agent Based Modelling (ABM) tools simplifies this task by providing an environment for programming, modelling and simulating agent-based solutions, aiming to test and compare alternative model configurations. A deeply analysis of the existing ABM tools was also performed aiming to select the platform to be used in this work. Aiming to demonstrate the benefits of bio-inspired techniques for the industrial automation domain, a production system was used as case study for the development of a self-organizing agent-based system developed using the NetLogo tool. Hoje em dia os mercados locais desapareceram e o mundo vive numa economia global. Devido a esta realidade, cada companhia compete, virtualmente, com todas as outras companhias do mundo. A acrescentar a isto, os mercados estão constantemente à procura de produtos com maior qualidade a preços mais baixos e com um grande nível de customização Também, os produtos tendem a ter um tempo curto de vida, fazendo com que a procura seja mais intensa. Com este cenário, as companhias, para permanecer competitivas, têm que se adaptar constantemente de acordo com as mudanças de mercado, i.e., as companhias têm que exibir um alto grau de auto-organização e auto-adaptação. A biologia com os milhões de anos de evolução, pode oferecer inspiração para desenvolver novos algoritmos, métodos e técnicas para resolver problemas complexos reais. Como por exemplo, o comportamento das formigas e das abelhas inspiraram investigadores na descoberta de soluções para resolver problemas complexos e evolutivos de engenharia. Esta dissertação tem como objectivo explorar o mundo da engenharia bio-inspirada. Isto é feito através do estudo de algumas das soluções bio-inspiradas existentes e da procura de soluções bio-inspiradas para resolver os problemas do dia-a-dia. Uma atenção especial vai ser dada aos problemas de engenharia e particularmente aos problemas do domínio da manufactura. Os sistemas multi-agentes são um conceito que estão em linha com os princípios bio-inspirados oferecendo uma abordagem nova para desenvolver soluções que exibam robustez, flexibilidade, rapidez de resposta e reconfiguração. Nestes sistemas distribuídos bio-inspirados, o comportamento de cada entidade segue um pequeno conjunto de regras simples, mas o comportamento emergente global é muito complexo de perceber e de demonstrar. Por isso, o desenho e simulação de soluções distribuídas de agentes, e particularmente aqueles que exibem auto-organização, são normalmente uma tarefa árdua. As ferramentas de Modelação Baseada de Agentes (MBA) simplificam esta tarefa providenciando um ambiente para programar, modelar e simular, com o objectivo de testar e comparar diferentes configurações do modelo. Uma análise mais aprofundada das ferramentas MBA foi também efectuada tendo como objectivo seleccionar a plataforma a usar neste trabalho

Proposition d’une architecture holonique auto-organisée et évolutive pour le pilotage des systèmes de production

The manufacturing world is being deeply challenged with a set of ever demanding constraints where from one side, the costumers are requiring products to be more customizable, with higher quality at lower prices, and on other side, companies have to deal on a daily basis with internal disturbances that range from machine breakdown to worker absence and from demand fluctuation to frequent production changes. This dissertation proposes a manufacturing control architecture, following the holonic principles developed in the ADAptive holonic COntrol aRchitecture (ADACOR) and extending it taking inspiration in evolutionary theories and making use of self- organization mechanisms. The use of evolutionary theories enrich the proposed control architecture by allowing evolution in two distinct ways, responding accordingly to the type and degree of the disturbance that appears. The first component, named behavioural self- organization, allows each system’s entity to dynamically adapt its internal behaviour, addressing small disturbances. The second component, named structural self-organization, addresses bigger disturbances by allowing the system entities to re-arrange their rela- tionships, and consequently changing the system in a structural manner. The proposed self-organized holonic manufacturing control architecture was validated at a AIP-PRIMECA flexible manufacturing cell. The achieved experimental results have also shown an improvement of the key performance indicators over the hierarchical and heterarchical control architecture.Le monde des entreprises est profondément soumis à un ensemble de contraintes toujours plus exigeantes provenant d’une part des clients, exigeant des produits plus personnalisables, de qualité supérieure et à faible coût, et d’autre part des aléas internes auxentreprises, comprenant les pannes machines, les défaillances humaines, la fluctuation de la demande, les fréquentes variations de production. Cette thèse propose une architecture de contrôle de systèmes de production, basée sur les principes holoniques développées dans l’architecture ADACOR (ADAptive holonic COntrol aRchitecture), et l’étendant en s’inspirant des théories de l’évolution et en utilisant des mécanismes d’auto-organisation. L’utilisation des théories de l’évolution enrichit l’architecture de contrôle en permettant l’évolution de deux manières distinctes, en réponse au type et au degré de la perturbation apparue. Le premier mode d’adaptation, appelé auto-organisation comportementale, permet à chaque entité qui compose le système d’adapter dynamiquement leur comportement interne, gérant de cette façon de petites perturbations. Le second mode, nommé auto-organisation structurelle, traite de plus grandes perturbations, en permettant aux entités du système de ré-organiser leurs relations, et par conséquent modifier structurellement le système. L’architecture holonique auto-organisée de contrôle de systèmes de production proposée dans cette thèse a été validée sur une cellule de production flexible AIP-PRIMECA. Les résultats ont montré une amélioration des indicateurs clés de performance par rapport aux architectures de contrôle hiérarchiques et hétérarchiques

A hybrid multi-objective evolutionary algorithm-based semantic foundation for sustainable distributed manufacturing systems

Rising energy prices, increasing maintenance costs, and strict environmental regimes have augmented the already existing pressure on the contemporary manufacturing environment. Although the decentralization of supply chain has led to rapid advancements in manufacturing systems, finding an efficient supplier simultaneously from the pool of available ones as per customer requirement and enhancing the process planning and scheduling functions are the predominant approaches still needed to be addressed. Therefore, this paper aims to address this issue by considering a set of gear manufacturing industries located across India as a case study. An integrated classifier-assisted evolutionary multi-objective evolutionary approach is proposed for solving the objectives of makespan, energy consumption, and increased service utilization rate, interoperability, and reliability. To execute the approach initially, text-mining-based supervised machine-learning models, namely Decision Tree, Naïve Bayes, Random Forest, and Support Vector Machines (SVM) were adopted for the classification of suppliers into task-specific suppliers. Following this, with the identified suppliers as input, the problem was formulated as a multi-objective Mixed-Integer Linear Programming (MILP) model. We then proposed a Hybrid Multi-Objective Moth Flame Optimization algorithm (HMFO) to optimize process planning and scheduling functions. Numerical experiments have been carried out with the formulated problem for 10 different instances, along with a comparison of the results with a Non-Dominated Sorting Genetic Algorithm (NSGA-II) to illustrate the feasibility of the approach.The project is funded by Department of Science and Technology, Science and Engineering Research Board (DST-SERB), Statutory Body Established through an Act of Parliament: SERB Act 2008, Government of India with Sanction Order No ECR/2016/001808, and also by FCT–Portuguese Foundation for Science and Technology within the R&D Units Projects Scopes: UIDB/00319/2020, UIDP/04077/2020, and UIDB/04077/2020

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

© 2020 by the authors. Licensee MDPI, Basel, Switzerland. Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Improving just-in-time delivery performance of IoT-enabled flexible manufacturing systems with AGV based material transportation

Autonomous guided vehicles (AGVs) are driverless material handling systems used for transportation of pallets and line side supply of materials to provide flexibility and agility in shop-floor logistics. Scheduling of shop-floor logistics in such systems is a challenging task due to their complex nature associated with the multiple part types and alternate material transfer routings. This paper presents a decision support system capable of supporting shop-floor decision-making activities during the event of manufacturing disruptions by automatically adjusting both AGV and machine schedules in Flexible Manufacturing Systems (FMSs). The proposed system uses discrete event simulation (DES) models enhanced by the Internet-of-Things (IoT) enabled digital integration and employs a nonlinear mixed integer programming Genetic Algorithm (GA) to find near-optimal production schedules prioritising the just-in-time (JIT) material delivery performance and energy efficiency of the material transportation. The performance of the proposed system is tested on the Integrated Manufacturing and Logistics (IML) demonstrator at WMG, University of Warwick. The results showed that the developed system can find the near-optimal solutions for production schedules subjected to production anomalies in a negligible time, thereby supporting shop-floor decision-making activities effectively and rapidly

Task Allocation on Layered Multi-Agent Systems: When Evolutionary Many-Objective Optimization Meets Deep Q-Learning

IEEE This paper is concerned with the multi-task multi-agent allocation problem via many-objective optimization for multi-agent systems (MASs). First, a novel layered MAS model is constructed to address the multi-task multi-agent allocation problem that includes both the original task simplification and the many-objective allocation. In the first layer of the model, the deep Q-learning method is introduced to simplify the prioritization of the original task set. In the second layer of the model, the modified shift-based density estimation (MSDE) method is put forward to improve the conventional Strength Pareto Evolutionary Algorithm 2 (SPEA2) in order to achieve many-objective optimization on task assignments. Then, an MSDE-SPEA2-based method is proposed to tackle the many-objective optimization problem with objectives including task allocation, makespan, agent satisfaction, resource utilization, task completion, and task waiting time. As compared with existing allocation methods, the developed method in this paper exhibits an outstanding feature that the task assignment and the task scheduling are carried out simultaneously. Finally, extensive experiments are conducted to 1) verify the validity of the proposed model and the effectiveness of two main algorithms; and 2) illustrate the optimal solution for task allocation and efficient strategy for task scheduling under different scenarios.National Key Research and Development Program of China; National Natural Science Foundation of China under Grants ;European Union’s Horizon 2020 Research and Innovation Programme; Royal Society of the UK; Alexander von Humboldt Foundatio

Agent-based manufacturing — review and expert evaluation

The advent of smart manufacturing and the exposure to a new generation of technological enablers have revolutionized the way manufacturing process is carried out. Cyber-Physical Production Systems (CPPS) are introduced as main actors of this manufacturing shift. They are characterized for having high levels of communication, integration and computational capabilities that led them to a certain level of autonomy. Despite the high expectations and vision of CPPS, it still remains an exploratory topic. Multi-Agent Systems (MAS) have been widely used by software engineers to solve traditional computing problems, e.g., banking transactions. Because of their high levels of distribution and autonomous capabilities, MAS have been considered by the research community as a good solution to design and implement CPPS. This work first introduces a collection of requirements and characteristics of smart manufacturing. A comprehensive review of various research applications is presented to understand the current state of the art and the application of agent technology in manufacturing. Considering the smart manufacturing requirements and current research application, a SWOT analysis was formulated which identifies pros and cons of the implementation of agents in industry. The SWOT analysis was further validated by an industrial expert evaluation and the main findings and discussion of the results are presented