An Enhanced Estimation of Distribution Algorithm for Energy-Efficient Job-Shop Scheduling Problems with Transportation Constraints

[EN] Nowadays, the manufacturing industry faces the challenge of reducing energy consumption and the associated environmental impacts. Production scheduling is an effective approach for energy-savings management. During the entire workshop production process, both the processing and transportation operations consume large amounts of energy. To reduce energy consumption, an energy-efficient job-shop scheduling problem (EJSP) with transportation constraints was proposed in this paper. First, a mixed-integer programming model was established to minimize both the comprehensive energy consumption and makespan in the EJSP. Then, an enhanced estimation of distribution algorithm (EEDA) was developed to solve the problem. In the proposed algorithm, an estimation of distribution algorithm was employed to perform the global search and an improved simulated annealing algorithm was designed to perform the local search. Finally, numerical experiments were implemented to analyze the performance of the EEDA. The results showed that the EEDA is a promising approach and that it can solve EJSP effectively and efficiently.This work was supported by the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (No. 17KJB460018), the Innovation Foundation for Science and Technology of Yangzhou University (No. 2016CXJ020 and No. 2017CXJ018), Science and Technology Project of Yangzhou under (No. YZ2017278), Research Topics of Teaching Reform of Yangzhou University under (No. YZUJX2018-28B), and the Spanish Government (No. TIN2016-80856-R and No. TIN2015-65515-C4-1-R).Dai, M.; Zhang, Z.; Giret Boggino, AS.; Salido, MA. (2019). An Enhanced Estimation of Distribution Algorithm for Energy-Efficient Job-Shop Scheduling Problems with Transportation Constraints. Sustainability. 11(11):1-23. https://doi.org/10.3390/su11113085S1231111Wu, X., & Sun, Y. (2018). A green scheduling algorithm for flexible job shop with energy-saving measures. Journal of Cleaner Production, 172, 3249-3264. doi:10.1016/j.jclepro.2017.10.342Wang, Q., Tang, D., Li, S., Yang, J., Salido, M., Giret, A., & Zhu, H. (2019). An Optimization Approach for the Coordinated Low-Carbon Design of Product Family and Remanufactured Products. Sustainability, 11(2), 460. doi:10.3390/su11020460Meng, Y., Yang, Y., Chung, H., Lee, P.-H., & Shao, C. (2018). Enhancing Sustainability and Energy Efficiency in Smart Factories: A Review. Sustainability, 10(12), 4779. doi:10.3390/su10124779Gahm, C., Denz, F., Dirr, M., & Tuma, A. (2016). Energy-efficient scheduling in manufacturing companies: A review and research framework. European Journal of Operational Research, 248(3), 744-757. doi:10.1016/j.ejor.2015.07.017Giret, A., Trentesaux, D., & Prabhu, V. (2015). Sustainability in manufacturing operations scheduling: A state of the art review. Journal of Manufacturing Systems, 37, 126-140. doi:10.1016/j.jmsy.2015.08.002Akbar, M., & Irohara, T. (2018). Scheduling for sustainable manufacturing: A review. Journal of Cleaner Production, 205, 866-883. doi:10.1016/j.jclepro.2018.09.100Che, A., Wu, X., Peng, J., & Yan, P. (2017). Energy-efficient bi-objective single-machine scheduling with power-down mechanism. Computers & Operations Research, 85, 172-183. doi:10.1016/j.cor.2017.04.004Lee, S., Do Chung, B., Jeon, H. W., & Chang, J. (2017). A dynamic control approach for energy-efficient production scheduling on a single machine under time-varying electricity pricing. Journal of Cleaner Production, 165, 552-563. doi:10.1016/j.jclepro.2017.07.102Rubaiee, S., & Yildirim, M. B. (2019). An energy-aware multiobjective ant colony algorithm to minimize total completion time and energy cost on a single-machine preemptive scheduling. Computers & Industrial Engineering, 127, 240-252. doi:10.1016/j.cie.2018.12.020Zhang, M., Yan, J., Zhang, Y., & Yan, S. (2019). Optimization for energy-efficient flexible flow shop scheduling under time of use electricity tariffs. Procedia CIRP, 80, 251-256. doi:10.1016/j.procir.2019.01.062Li, J., Sang, H., Han, Y., Wang, C., & Gao, K. (2018). Efficient multi-objective optimization algorithm for hybrid flow shop scheduling problems with setup energy consumptions. Journal of Cleaner Production, 181, 584-598. doi:10.1016/j.jclepro.2018.02.004Lu, C., Gao, L., Li, X., Pan, Q., & Wang, Q. (2017). Energy-efficient permutation flow shop scheduling problem using a hybrid multi-objective backtracking search algorithm. Journal of Cleaner Production, 144, 228-238. doi:10.1016/j.jclepro.2017.01.011Fu, Y., Tian, G., Fathollahi-Fard, A. M., Ahmadi, A., & Zhang, C. (2019). Stochastic multi-objective modelling and optimization of an energy-conscious distributed permutation flow shop scheduling problem with the total tardiness constraint. Journal of Cleaner Production, 226, 515-525. doi:10.1016/j.jclepro.2019.04.046Schulz, S., Neufeld, J. S., & Buscher, U. (2019). A multi-objective iterated local search algorithm for comprehensive energy-aware hybrid flow shop scheduling. Journal of Cleaner Production, 224, 421-434. doi:10.1016/j.jclepro.2019.03.155Liu, Y., Dong, H., Lohse, N., Petrovic, S., & Gindy, N. (2014). An investigation into minimising total energy consumption and total weighted tardiness in job shops. Journal of Cleaner Production, 65, 87-96. doi:10.1016/j.jclepro.2013.07.060Liu, Y., Dong, H., Lohse, N., & Petrovic, S. (2016). A multi-objective genetic algorithm for optimisation of energy consumption and shop floor production performance. International Journal of Production Economics, 179, 259-272. doi:10.1016/j.ijpe.2016.06.019May, G., Stahl, B., Taisch, M., & Prabhu, V. (2015). Multi-objective genetic algorithm for energy-efficient job shop scheduling. International Journal of Production Research, 53(23), 7071-7089. doi:10.1080/00207543.2015.1005248Zhang, R., & Chiong, R. (2016). Solving the energy-efficient job shop scheduling problem: a multi-objective genetic algorithm with enhanced local search for minimizing the total weighted tardiness and total energy consumption. Journal of Cleaner Production, 112, 3361-3375. doi:10.1016/j.jclepro.2015.09.097Salido, M. A., Escamilla, J., Giret, A., & Barber, F. (2015). A genetic algorithm for energy-efficiency in job-shop scheduling. The International Journal of Advanced Manufacturing Technology, 85(5-8), 1303-1314. doi:10.1007/s00170-015-7987-0Masmoudi, O., Delorme, X., & Gianessi, P. (2019). Job-shop scheduling problem with energy consideration. International Journal of Production Economics, 216, 12-22. doi:10.1016/j.ijpe.2019.03.021Mokhtari, H., & Hasani, A. (2017). An energy-efficient multi-objective optimization for flexible job-shop scheduling problem. Computers & Chemical Engineering, 104, 339-352. doi:10.1016/j.compchemeng.2017.05.004Meng, L., Zhang, C., Shao, X., & Ren, Y. (2019). MILP models for energy-aware flexible job shop scheduling problem. Journal of Cleaner Production, 210, 710-723. doi:10.1016/j.jclepro.2018.11.021Dai, M., Tang, D., Giret, A., & Salido, M. A. (2019). Multi-objective optimization for energy-efficient flexible job shop scheduling problem with transportation constraints. Robotics and Computer-Integrated Manufacturing, 59, 143-157. doi:10.1016/j.rcim.2019.04.006Lacomme, P., Larabi, M., & Tchernev, N. (2013). Job-shop based framework for simultaneous scheduling of machines and automated guided vehicles. International Journal of Production Economics, 143(1), 24-34. doi:10.1016/j.ijpe.2010.07.012Nageswararao, M., Narayanarao, K., & Ranagajanardhana, G. (2014). Simultaneous Scheduling of Machines and AGVs in Flexible Manufacturing System with Minimization of Tardiness Criterion. Procedia Materials Science, 5, 1492-1501. doi:10.1016/j.mspro.2014.07.336Saidi-Mehrabad, M., Dehnavi-Arani, S., Evazabadian, F., & Mahmoodian, V. (2015). An Ant Colony Algorithm (ACA) for solving the new integrated model of job shop scheduling and conflict-free routing of AGVs. Computers & Industrial Engineering, 86, 2-13. doi:10.1016/j.cie.2015.01.003Guo, Z., Zhang, D., Leung, S. Y. S., & Shi, L. (2016). A bi-level evolutionary optimization approach for integrated production and transportation scheduling. Applied Soft Computing, 42, 215-228. doi:10.1016/j.asoc.2016.01.052Karimi, S., Ardalan, Z., Naderi, B., & Mohammadi, M. (2017). Scheduling flexible job-shops with transportation times: Mathematical models and a hybrid imperialist competitive algorithm. Applied Mathematical Modelling, 41, 667-682. doi:10.1016/j.apm.2016.09.022Liu, Z., Guo, S., & Wang, L. (2019). Integrated green scheduling optimization of flexible job shop and crane transportation considering comprehensive energy consumption. Journal of Cleaner Production, 211, 765-786. doi:10.1016/j.jclepro.2018.11.231Tang, D., & Dai, M. (2015). Energy-efficient approach to minimizing the energy consumption in an extended job-shop scheduling problem. Chinese Journal of Mechanical Engineering, 28(5), 1048-1055. doi:10.3901/cjme.2015.0617.082Hao, X., Lin, L., Gen, M., & Ohno, K. (2013). Effective Estimation of Distribution Algorithm for Stochastic Job Shop Scheduling Problem. Procedia Computer Science, 20, 102-107. doi:10.1016/j.procs.2013.09.246Wang, L., Wang, S., Xu, Y., Zhou, G., & Liu, M. (2012). A bi-population based estimation of distribution algorithm for the flexible job-shop scheduling problem. Computers & Industrial Engineering, 62(4), 917-926. doi:10.1016/j.cie.2011.12.014Jarboui, B., Eddaly, M., & Siarry, P. (2009). An estimation of distribution algorithm for minimizing the total flowtime in permutation flowshop scheduling problems. Computers & Operations Research, 36(9), 2638-2646. doi:10.1016/j.cor.2008.11.004Hauschild, M., & Pelikan, M. (2011). An introduction and survey of estimation of distribution algorithms. Swarm and Evolutionary Computation, 1(3), 111-128. doi:10.1016/j.swevo.2011.08.003Liu, F., Xie, J., & Liu, S. (2015). A method for predicting the energy consumption of the main driving system of a machine tool in a machining process. Journal of Cleaner Production, 105, 171-177. doi:10.1016/j.jclepro.2014.09.058Dai, M., Tang, D., Giret, A., Salido, M. A., & Li, W. D. (2013). Energy-efficient scheduling for a flexible flow shop using an improved genetic-simulated annealing algorithm. Robotics and Computer-Integrated Manufacturing, 29(5), 418-429. doi:10.1016/j.rcim.2013.04.001Beasley, J. E. (1990). OR-Library: Distributing Test Problems by Electronic Mail. Journal of the Operational Research Society, 41(11), 1069-1072. doi:10.1057/jors.1990.166Zhao, F., Shao, Z., Wang, J., & Zhang, C. (2015). A hybrid differential evolution and estimation of distribution algorithm based on neighbourhood search for job shop scheduling problems. International Journal of Production Research, 54(4), 1039-1060. doi:10.1080/00207543.2015.1041575Van Laarhoven, P. J. M., Aarts, E. H. L., & Lenstra, J. K. (1992). Job Shop Scheduling by Simulated Annealing. Operations Research, 40(1), 113-125. doi:10.1287/opre.40.1.113Wang, L., & Zheng, D.-Z. (2001). An effective hybrid optimization strategy for job-shop scheduling problems. Computers & Operations Research, 28(6), 585-596. doi:10.1016/s0305-0548(99)00137-9Dorndorf, U., & Pesch, E. (1995). Evolution based learning in a job shop scheduling environment. Computers & Operations Research, 22(1), 25-40. doi:10.1016/0305-0548(93)e0016-mPark, B. J., Choi, H. R., & Kim, H. S. (2003). A hybrid genetic algorithm for the job shop scheduling problems. Computers & Industrial Engineering, 45(4), 597-613. doi:10.1016/s0360-8352(03)00077-

Reinforcement Learning-assisted Evolutionary Algorithm: A Survey and Research Opportunities

Evolutionary algorithms (EA), a class of stochastic search methods based on the principles of natural evolution, have received widespread acclaim for their exceptional performance in various real-world optimization problems. While researchers worldwide have proposed a wide variety of EAs, certain limitations remain, such as slow convergence speed and poor generalization capabilities. Consequently, numerous scholars actively explore improvements to algorithmic structures, operators, search patterns, etc., to enhance their optimization performance. Reinforcement learning (RL) integrated as a component in the EA framework has demonstrated superior performance in recent years. This paper presents a comprehensive survey on integrating reinforcement learning into the evolutionary algorithm, referred to as reinforcement learning-assisted evolutionary algorithm (RL-EA). We begin with the conceptual outlines of reinforcement learning and the evolutionary algorithm. We then provide a taxonomy of RL-EA. Subsequently, we discuss the RL-EA integration method, the RL-assisted strategy adopted by RL-EA, and its applications according to the existing literature. The RL-assisted procedure is divided according to the implemented functions including solution generation, learnable objective function, algorithm/operator/sub-population selection, parameter adaptation, and other strategies. Finally, we analyze potential directions for future research. This survey serves as a rich resource for researchers interested in RL-EA as it overviews the current state-of-the-art and highlights the associated challenges. By leveraging this survey, readers can swiftly gain insights into RL-EA to develop efficient algorithms, thereby fostering further advancements in this emerging field.Comment: 26 pages, 16 figure

Multi-Objective Flexible Job Shop Scheduling Using Genetic Algorithms

Flexible Job Shop Scheduling is an important problem in the fields of combinatorial optimization and production management. This research addresses multi-objective flexible job shop scheduling problem with the objective of simultaneous minimization of: (1) makespan, (2) workload of the most loaded machine, and (3) total workload. A general-purpose, domain independent genetic algorithm implemented in a spreadsheet environment is proposed for the flexible job shop. Spreadsheet functions are used to develop the shop model. Performance of the proposed algorithm is compared with heuristic algorithms already reported in the literature. Simulation experiments demonstrated that the proposed methodology can achieve solutions that are comparable to previous approaches in terms of solution quality and computational time. Flexible job shop models presented herein are easily customizable to cater for different objective functions without changing the basic genetic algorithm routine or the spreadsheet model. Experimental analysis demonstrates the robustness, simplicity, and general-purpose nature of the proposed approach

Enhanced Differential Evolution Based on Adaptive Mutation and Wrapper Local Search Strategies for Global Optimization Problems

AbstractDifferential evolution (DE) is a simple, powerful optimization algorithm, which has been widely used in many areas. However, the choices of the best mutation and search strategies are difficult for the specific issues. To alleviate these drawbacks and enhance the performance of DE, in this paper, the hybrid framework based on the adaptive mutation and Wrapper Local Search (WLS) schemes, is proposed to improve searching ability to efficiently guide the evolution of the population toward the global optimum. Furthermore, the effective particle encoding representation named Particle Segment Operation-Machine Assignment (PSOMA) that we previously published is applied to always produce feasible candidate solutions for solving the Flexible Job-shop Scheduling Problem (FJSP). Experiments were conducted on comprehensive set of complex benchmarks including the unimodal, multimodal and hybrid composition function, to validate performance of the proposed method and to compare with other state-of-the art DE variants such as jDE, JADE, MDE_pBX etc. Meanwhile, the hybrid DE model incorporating PSOMA is used to solve different representative instances based on practical data for multi-objective FJSP verifications. Simulation results indicate that the proposed method performs better for the majority of the single-objective scalable benchmark functions in terms of the solution accuracy and convergence rate. In addition, the wide range of Pareto-optimal solutions and more Gantt chart decision-makings can be provided for the multi-objective FJSP combinatorial optimizations

A Keyword, Taxonomy and Cartographic Research Review of Sustainability Concepts for Production Scheduling in Manufacturing Systems

The concept of sustainability is defined as composed of three pillars: social, environmental, and economic. Social sustainability implies a commitment to equity in terms of several “interrelated and mutually supportive” principles of a “sustainable society”; this concept includes attitude change, the Earth’s vitality and diversity conservation, and a global alliance to achieve sustainability. The social and environmental aspects of sustainability are related in the way sustainability indicators are related to “quality of life” and “ecological sustainability”. The increasing interest in green and sustainable products and production has influenced research interests regarding sustainable scheduling problems in manufacturing systems. This study is aimed both at reducing pollutant emissions and increasing production efficiency: this topic is known as Green Scheduling. Existing literature research reviews on Green Scheduling Problems have pointed out both theoretical and practical aspects of this topic. The proposed work is a critical review of the scientific literature with a three-pronged approach based on keywords, taxonomy analysis, and research mapping. Specific research questions have been proposed to highlight the benefits and related objectives of this review: to discover the most widely used methodologies for solving SPGs in manufacturing and identify interesting development models, as well as the least studied domains and algorithms. The literature was analysed in order to define a map of the main research fields on SPG, highlight mainstream SPG research, propose an efficient view of emerging research areas, propose a taxonomy of SPG by collecting multiple keywords into semantic clusters, and analyse the literature according to a semantic knowledge approach. At the same time, GSP researchers are provided with an efficient view of emerging research areas, allowing them to avoid missing key research areas and focus on emerging ones

Comparative Analysis of Metaheuristic Approaches for Makespan Minimization for No Wait Flow Shop Scheduling Problem

This paper provides comparative analysis of various metaheuristic approaches for m-machine no wait flow shop scheduling (NWFSS) problem with makespan as an optimality criterion. NWFSS problem is NP hard and brute force method unable to find the solutions so approximate solutions are found with metaheuristic algorithms. The objective is to find out the scheduling sequence of jobs to minimize total completion time. In order to meet the objective criterion, existing metaheuristic techniques viz. Tabu Search (TS), Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) are implemented for small and large sized problems and effectiveness of these techniques are measured with statistical metric

Lot Streaming in Different Types of Production Processes: A PRISMA Systematic Review

At present, any industry that wanted to be considered a vanguard must be willing to improve itself, developing innovative techniques to generate a competitive advantage against its direct competitors. Hence, many methods are employed to optimize production processes, such as Lot Streaming, which consists of partitioning the productive lots into overlapping small batches to reduce the overall operating times known as Makespan, reducing the delivery time to the final customer. This work proposes carrying out a systematic review following the PRISMA methodology to the existing literature in indexed databases that demonstrates the application of Lot Streaming in the different production systems, giving the scientific community a strong consultation tool, useful to validate the different important elements in the definition of the Makespan reduction objectives and their applicability in the industry. Two hundred papers were identified on the subject of this study. After applying a group of eligibility criteria, 63 articles were analyzed, concluding that Lot Streaming can be applied in different types of industrial processes, always keeping the main objective of reducing Makespan, becoming an excellent improvement tool, thanks to the use of different optimization algorithms, attached to the reality of each industry.This work was supported by the Universidad Tecnica de Ambato (UTA) and their Research and Development Department (DIDE) under project CONIN-P-256-2019, and SENESCYT by grants “Convocatoria Abierta 2011” and “Convocatoria Abierta 2013”