Particle swarm optimization for cooperative multi-robot task allocation: a multi-objective approach

This paper presents a new Multi-Objective Particle Swarm Optimization (MOPSO) approach to a Cooperative Multi Robot Task Allocation (CMRTA) problem, where the robots have to minimize the total team cost and, additionally, balance their workloads. We formulate the CMRTA problem as a more complex variant of multiple Travelling Salesman Problems (mTSP) and, in particular, address how to minimize the total travel distance of the entire robot team, as well as how to minimize the highest travel distance of an individual robot. The proposed approach extends the standard single-objective Particle Swarm Optimization (PSO) to cope with the multiple objectives, and its novel feature lies in a Pareto front refinement strategy and a probability-based leader selection strategy. To validate the proposed approach, we first use three benchmark functions to evaluate the performance of finding the true Pareto fronts in comparison with four existing well-known algorithms in continuous spaces. Afterwards, we use six datasets to investigate the task allocation mechanisms in dealing with the CMRTA problem in discrete spaces.benchmark functions to evaluate the performance of findingthe true Pareto fronts in comparison with four existing wellknownalgorithms in continuous spaces. Afterwards, we use sixdatasets to investigate the task allocation mechanisms in dealingwith the CMRTA problem in discrete spaces

Dealing with data and software interoperability issues in digital factories

The digital factory paradigm comprises a multi-layered integration of the information related to various activities along the factory and product lifecycle manufacturing related resources. A central aspect of a digital factory is that of enabling the product lifecycle stakeholders to collaborate through the use of software solutions. The digital factory thus expands outside the actual company boundaries and offers the opportunity for the business and its suppliers to collaborate on business processes that affect the whole supply chain. This paper discusses an interoperability architecture for digital factories. To this end, it delves into the issue by analysing the main challenges that must be addressed to support an integrated and scalable factory architecture characterized by access to services, aggregation of data, and orchestration of production processes. Then, it revises the state of the art in the light of these requirements and proposes a general architectural framework conjugating the most interesting features of serviceoriented architectures and data sharing architectures. The study is exemplified through a case study

Modelling uncertainties in human-robot industrial collaborations

With the rise of Industry 4.0 technological trends, there is a growing tendency in manufacturing automation towards collaborative robots. Human-robot collaboration (HRC) is motivated by the combination of complementary human and robot skills and intelligence, which can increase productivity, flexibility and adaptability. However, it is still challenging to achieve safe and efficient human-robot collaborative systems due to the dynamics of human presence, uncertainties in the dynamic environment, and the need for adaptability. Such uncertainties could relate to the human-robot capabilities and availability, parts positioning, unexpected obstacles, etc. This paper develops time-based simulations and event-based simulations to model and analyse the dynamic factors in human-robot collaboration systems. The novelty of this work is the systematic modelling and analysis of dynamic factors in HRC manufacturing scenarios through the development of digital simulations of human-robot collaboration scenarios while considering the dynamic nature of humans and environments. A real-world industrial case study was redesigned into a collaborative workstation. The simulated scenario is developed using the software called Tecnomatix Process Simulate, which can help to visualise the dynamic factors and analyse the impact of the factors on the HRC. The simulation illustrates and analyses possible uncertainties in human-robot industrial collaborative workstations, which can contribute to the future design of HRC industrial workstations and the optimisation of productivity

Ubiquitous Robotic Technology for Smart Manufacturing System

As the manufacturing tasks become more individualized and more flexible, the machines in smart factory are required to do variable tasks collaboratively without reprogramming. This paper for the first time discusses the similarity between smart manufacturing systems and the ubiquitous robotic systems and makes an effort on deploying ubiquitous robotic technology to the smart factory. Specifically, a component based framework is proposed in order to enable the communication and cooperation of the heterogeneous robotic devices. Further, compared to the service robotic domain, the smart manufacturing systems are often in larger size. So a hierarchical planning method was implemented to improve the planning efficiency. A test bed of smart factory is developed. It demonstrates that the proposed framework is suitable for industrial domain, and the hierarchical planning method is able to solve large problems intractable with flat methods

TOWARD INTELLIGENT WELDING BY BUILDING ITS DIGITAL TWIN

To meet the increasing requirements for production on individualization, efficiency and quality, traditional manufacturing processes are evolving to smart manufacturing with the support from the information technology advancements including cyber-physical systems (CPS), Internet of Things (IoT), big industrial data, and artificial intelligence (AI). The pre-requirement for integrating with these advanced information technologies is to digitalize manufacturing processes such that they can be analyzed, controlled, and interacted with other digitalized components. Digital twin is developed as a general framework to do that by building the digital replicas for the physical entities. This work takes welding manufacturing as the case study to accelerate its transition to intelligent welding by building its digital twin and contributes to digital twin in the following two aspects (1) increasing the information analysis and reasoning ability by integrating deep learning; (2) enhancing the human user operative ability to physical welding manufacturing via digital twins by integrating human-robot interaction (HRI). Firstly, a digital twin of pulsed gas tungsten arc welding (GTAW-P) is developed by integrating deep learning to offer the strong feature extraction and analysis ability. In such a system, the direct information including weld pool images, arc images, welding current and arc voltage is collected by cameras and arc sensors. The undirect information determining the welding quality, i.e., weld joint top-side bead width (TSBW) and back-side bead width (BSBW), is computed by a traditional image processing method and a deep convolutional neural network (CNN) respectively. Based on that, the weld joint geometrical size is controlled to meet the quality requirement in various welding conditions. In the meantime, this developed digital twin is visualized to offer a graphical user interface (GUI) to human users for their effective and intuitive perception to physical welding processes. Secondly, in order to enhance the human operative ability to the physical welding processes via digital twins, HRI is integrated taking virtual reality (VR) as the interface which could transmit the information bidirectionally i.e., transmitting the human commends to welding robots and visualizing the digital twin to human users. Six welders, skilled and unskilled, tested this system by completing the same welding job but demonstrate different patterns and resulted welding qualities. To differentiate their skill levels (skilled or unskilled) from their demonstrated operations, a data-driven approach, FFT-PCA-SVM as a combination of fast Fourier transform (FFT), principal component analysis (PCA), and support vector machine (SVM) is developed and demonstrates the 94.44% classification accuracy. The robots can also work as an assistant to help the human welders to complete the welding tasks by recognizing and executing the intended welding operations. This is done by a developed human intention recognition algorithm based on hidden Markov model (HMM) and the welding experiments show that developed robot-assisted welding can help to improve welding quality. To further take the advantages of the robots i.e., movement accuracy and stability, the role of the robot upgrades to be a collaborator from an assistant to complete a subtask independently i.e., torch weaving and automatic seam tracking in weaving GTAW. The other subtask i.e., welding torch moving along the weld seam is completed by the human users who can adjust the travel speed to control the heat input and ensure the good welding quality. By doing that, the advantages of humans (intelligence) and robots (accuracy and stability) are combined together under this human-robot collaboration framework. The developed digital twin for welding manufacturing helps to promote the next-generation intelligent welding and can be applied in other similar manufacturing processes easily after small modifications including painting, spraying and additive manufacturing

Towards Robotic Laboratory Automation Plug & Play: The "LAPP" Framework

Increasing the level of automation in pharmaceutical laboratories and production facilities plays a crucial role in delivering medicine to patients. However, the particular requirements of this field make it challenging to adapt cutting-edge technologies present in other industries. This article provides an overview of relevant approaches and how they can be utilized in the pharmaceutical industry, especially in development laboratories. Recent advancements include the application of flexible mobile manipulators capable of handling complex tasks. However, integrating devices from many different vendors into an end-to-end automation system is complicated due to the diversity of interfaces. Therefore, various approaches for standardization are considered in this article, and a concept is proposed for taking them a step further. This concept enables a mobile manipulator with a vision system to "learn" the pose of each device and - utilizing a barcode - fetch interface information from a universal cloud database. This information includes control and communication protocol definitions and a representation of robot actions needed to operate the device. In order to define the movements in relation to the device, devices have to feature - besides the barcode - a fiducial marker as standard. The concept will be elaborated following appropriate research activities in follow-up papers

The 1990 Goddard Conference on Space Applications of Artificial Intelligence

The papers presented at the 1990 Goddard Conference on Space Applications of Artificial Intelligence are given. The purpose of this annual conference is to provide a forum in which current research and development directed at space applications of artificial intelligence can be presented and discussed. The proceedings fall into the following areas: Planning and Scheduling, Fault Monitoring/Diagnosis, Image Processing and Machine Vision, Robotics/Intelligent Control, Development Methodologies, Information Management, and Knowledge Acquisition