SLS-PLAN-IT: A knowledge-based blackboard scheduling system for Spacelab life sciences missions

The primary scheduling tool in use during the Spacelab Life Science (SLS-1) planning phase was the operations research (OR) based, tabular form Experiment Scheduling System (ESS) developed by NASA Marshall. PLAN-IT is an artificial intelligence based interactive graphic timeline editor for ESS developed by JPL. The PLAN-IT software was enhanced for use in the scheduling of Spacelab experiments to support the SLS missions. The enhanced software SLS-PLAN-IT System was used to support the real-time reactive scheduling task during the SLS-1 mission. SLS-PLAN-IT is a frame-based blackboard scheduling shell which, from scheduling input, creates resource-requiring event duration objects and resource-usage duration objects. The blackboard structure is to keep track of the effects of event duration objects on the resource usage objects. Various scheduling heuristics are coded in procedural form and can be invoked any time at the user's request. The system architecture is described along with what has been learned with the SLS-PLAN-IT project

Combinatorial optimization and metaheuristics

Today, combinatorial optimization is one of the youngest and most active areas of discrete mathematics. It is a branch of optimization in applied mathematics and computer science, related to operational research, algorithm theory and computational complexity theory. It sits at the intersection of several fields, including artificial intelligence, mathematics and software engineering. Its increasing interest arises for the fact that a large number of scientific and industrial problems can be formulated as abstract combinatorial optimization problems, through graphs and/or (integer) linear programs. Some of these problems have polynomial-time (“efficient”) algorithms, while most of them are NP-hard, i.e. it is not proved that they can be solved in polynomial-time. Mainly, it means that it is not possible to guarantee that an exact solution to the problem can be found and one has to settle for an approximate solution with known performance guarantees. Indeed, the goal of approximate methods is to find “quickly” (reasonable run-times), with “high” probability, provable “good” solutions (low error from the real optimal solution). In the last 20 years, a new kind of algorithm commonly called metaheuristics have emerged in this class, which basically try to combine heuristics in high level frameworks aimed at efficiently and effectively exploring the search space. This report briefly outlines the components, concepts, advantages and disadvantages of different metaheuristic approaches from a conceptual point of view, in order to analyze their similarities and differences. The two very significant forces of intensification and diversification, that mainly determine the behavior of a metaheuristic, will be pointed out. The report concludes by exploring the importance of hybridization and integration methods

Pollux: a dynamic hybrid control architecture for flexible job shop systems

Nowadays, manufacturing control systems can respond more effectively to exigent market requirements and real-time demands. Indeed, they take advantage of changing their structural and behavioural arrangements to tailor the control solution from a diverse set of feasible configurations. However, the challenge of this approach is to determine efficient mechanisms that dynamically optimise the configuration between different architectures. This paper presents a dynamic hybrid control architecture that integrates a switching mechanism to control changes at both structural and behavioural level. The switching mechanism is based on a genetic algorithm and strives to find the most suitable operating mode of the architecture with regard to optimality and reactivity. The proposed approach was tested in a real flexible job shop to demonstrate the applicability and efficiency of including an optimisation algorithm in the switching process of a dynamic hybrid control architecture.This work was supported by the Colombian scholarship programme of department of science – COLCIENCIAS under grant ‘Convocatoria 568 – Doctorados en el exterior’ and the Pontificia Universidad Javeriana under grant ‘Programa de Formacion de posgrados del Profesor Javeriano’.info:eu-repo/semantics/publishedVersio

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While researchers worldwide have proposed a wide variety of EAs, certain limitations remain, such as slow convergence speed and poor generalization capabilities. Consequently, numerous scholars actively explore improvements to algorithmic structures, operators, search patterns, etc., to enhance their optimization performance. Reinforcement learning (RL) integrated as a component in the EA framework has demonstrated superior performance in recent years. This paper presents a comprehensive survey on integrating reinforcement learning into the evolutionary algorithm, referred to as reinforcement learning-assisted evolutionary algorithm (RL-EA). We begin with the conceptual outlines of reinforcement learning and the evolutionary algorithm. We then provide a taxonomy of RL-EA. Subsequently, we discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. The RL-assisted procedure is divided according to the implemented functions including solution generation, learnable objective function, algorithm/operator/sub-population selection, parameter adaptation, and other strategies. Finally, we analyze potential directions for future research. This survey serves as a rich resource for researchers interested in RL-EA as it overviews the current state-of-the-art and highlights the associated challenges. By leveraging this survey, readers can swiftly gain insights into RL-EA to develop efficient algorithms, thereby fostering further advancements in this emerging field.Comment: 26 pages, 16 figure

A biased-randomized discrete-event algorithm for the hybrid flow shop problem with time dependencies and priority constraints

Based on a real-world application in the semiconductor industry, this article models and discusses a hybrid flow shop problem with time dependencies and priority constraints. The analyzed problem considers a production where a large number of heterogeneous jobs are processed by a number of machines. The route that each job has to follow depends upon its type, and, in addition, some machines require that a number of jobs are combined in batches before starting their processing. The hybrid flow model is also subject to a global priority rule and a “same setup” rule. The primary goal of this study was to find a solution set (permutation of jobs) that minimizes the production makespan. While simulation models are frequently employed to model these time-dependent flow shop systems, an optimization component is needed in order to generate high-quality solution sets. In this study, a novel algorithm is proposed to deal with the complexity of the underlying system. Our algorithm combines biased-randomization techniques with a discrete-event heuristic, which allows us to model dependencies caused by batching and different paths of jobs efficiently in a near-natural way. As shown in a series of numerical experiments, the proposed simulation-optimization algorithm can find solutions that significantly outperform those provided by employing state-of-the-art simulation software.Peer ReviewedPostprint (published version

Internet of Things in urban waste collection

Nowadays, the waste collection management has an important role in urban areas. This paper faces this issue and proposes the application of a metaheuristic for the optimization of a weekly schedule and routing of the waste collection activities in an urban area. Differently to several contributions in literature, fixed periodic routes are not imposed. The results significantly improve the performance of the company involved, both in terms of resources used and costs saving

Energy-aware coordination of machine scheduling and support device recharging in production systems

Electricity generation from renewable energy sources is crucial for achieving climate targets, including greenhouse gas neutrality. Germany has made significant progress in increasing renewable energy generation. However, feed-in management actions have led to losses of renewable electricity in the past years, primarily from wind energy. These actions aim to maintain grid stability but result in excess renewable energy that goes unused. The lost electricity could have powered a multitude of households and saved CO2 emissions. Moreover, feed-in management actions incurred compensation claims of around 807 million Euros in 2021. Wind-abundant regions like Schleswig-Holstein are particularly affected by these actions, resulting in substantial losses of renewable electricity production. Expanding the power grid infrastructure is a costly and time-consuming solution to avoid feed-in management actions. An alternative approach is to increase local electricity consumption during peak renewable generation periods, which can help balance electricity supply and demand and reduce feed-in management actions. The dissertation focuses on energy-aware manufacturing decision-making, exploring ways to counteract feed-in management actions by increasing local industrial consumption during renewable generation peaks. The research proposes to guide production management decisions, synchronizing a company's energy consumption profile with renewable energy availability for more environmentally friendly production and improved grid stability

XVI Congresso da Associação Portuguesa de Investigação Operacional: livro de resumos

Fundação para a Ciência e a Tecnologia - FC