A novel population-based local search for nurse rostering problem

Population-based approaches regularly are better than single based (local search) approaches in exploring the search space. However, the drawback of population-based approaches is in exploiting the search space. Several hybrid approaches have proven their efficiency through different domains of optimization problems by incorporating and integrating the strength of population and local search approaches. Meanwhile, hybrid methods have a drawback of increasing the parameter tuning. Recently, population-based local search was proposed for a university course-timetabling problem with fewer parameters than existing approaches, the proposed approach proves its effectiveness. The proposed approach employs two operators to intensify and diversify the search space. The first operator is applied to a single solution, while the second is applied for all solutions. This paper aims to investigate the performance of population-based local search for the nurse rostering problem. The INRC2010 database with a dataset composed of 69 instances is used to test the performance of PB-LS. A comparison was made between the performance of PB-LS and other existing approaches in the literature. Results show good performances of proposed approach compared to other approaches, where population-based local search provided best results in 55 cases over 69 instances used in experiments

The design and applications of the african buffalo algorithm for general optimization problems

Optimization, basically, is the economics of science. It is concerned with the need to maximize profit and minimize cost in terms of time and resources needed to execute a given project in any field of human endeavor. There have been several scientific investigations in the past several decades on discovering effective and efficient algorithms to providing solutions to the optimization needs of mankind leading to the development of deterministic algorithms that provide exact solutions to optimization problems. In the past five decades, however, the attention of scientists has shifted from the deterministic algorithms to the stochastic ones since the latter have proven to be more robust and efficient, even though they do not guarantee exact solutions. Some of the successfully designed stochastic algorithms include Simulated Annealing, Genetic Algorithm, Ant Colony Optimization, Particle Swarm Optimization, Bee Colony Optimization, Artificial Bee Colony Optimization, Firefly Optimization etc. A critical look at these ‘efficient’ stochastic algorithms reveals the need for improvements in the areas of effectiveness, the number of several parameters used, premature convergence, ability to search diverse landscapes and complex implementation strategies. The African Buffalo Optimization (ABO), which is inspired by the herd management, communication and successful grazing cultures of the African buffalos, is designed to attempt solutions to the observed shortcomings of the existing stochastic optimization algorithms. Through several experimental procedures, the ABO was used to successfully solve benchmark optimization problems in mono-modal and multimodal, constrained and unconstrained, separable and non-separable search landscapes with competitive outcomes. Moreover, the ABO algorithm was applied to solve over 100 out of the 118 benchmark symmetric and all the asymmetric travelling salesman’s problems available in TSPLIB95. Based on the successful experimentation with the novel algorithm, it is safe to conclude that the ABO is a worthy contribution to the scientific literature

Parameter-less Late Acceptance Hill-climbing: Foundations & Applications.

PhD Theses.Stochastic Local Search (SLS) methods have been used to solve complex hard combinatorial problems in a number of elds. Their judicious use of randomization, arguably, simpli es their design to achieve robust algorithm behaviour in domains where little is known. This feature makes them a general purpose approach for tackling complex problems. However, their performance, usually, depends on a number of parameters that should be speci ed by the user. Most of these parameters are search-algorithm related and have little to do with the user's problem. This thesis presents search techniques for combinatorial problems that have fewer parameters while delivering good anytime performance. Their parameters are set automatically by the algorithm itself in an intelligent way, while making sure that they use the entire given time budget to explore the search space with a high probability of avoiding the stagnation in a single basin of attraction. These algorithms are suitable for general practitioners in industry that do not have deep insight into search methodologies and their parameter tuning. Note that, to all intents and purposes, in realworld search problems the aim is to nd a good enough quality solution in a pre-de ned time. In order to achieve this, we use a technique that was originally introduced for automating population sizing in evolutionary algorithms. In an intelligent way, we adapted it to a particular one-point stochastic local search algorithm, namely Late Acceptance Hill-Climbing (LAHC), to eliminate the need to manually specify the value of the sole parameter of this algorithm. We then develop a mathematically sound dynamic cuto time strategy that is able to reliably detect the stagnation point for these search algorithms. We evaluated the suitability and scalability of the proposed methods on a range of classical combinatorial optimization problems as well as a real-world software engineering proble

Selection hyper-heuristics for healthcare scheduling

A variety of approaches have been used to solve a variety of combinatorial optimisation problems. Many of those approaches are tailored to the particular problem being addressed. Recently, there has been a growing number of studies towards providing more general search methodologies than currently exist which are applicable to different problem domains without requiring any algorithmic modification. Hyper-heuristics represent a class of such general methodologies which are capable of automating the design of search process via generating new heuristics and/or mixing existing heuristics to solve hard computational problems. This study focuses on the design of selection hyper-heuristics which attempt to improve an initially created solution iteratively through heuristic selection and move acceptance processes and their application to the real-world healthcare scheduling problems, particularly, nurse rostering and surgery admission planning. One of the top previously proposed general hyper-heuristic methodology was an adaptive hyper-heuristic consisting of many parameters, although their values were either fixed or set during the search process, with a complicated design. This approach ranked the first at an international cross-domain heuristic search challenge among twenty other competitors for solving instances from six different problem domains, including maximum satisfiability, one dimensional bin packing, permutation flow shop, personnel scheduling, travelling salesman, vehicle routing problems. The hyper-heuristics submitted to the competition along with the problem domain implementations can now be considered as the benchmark for hyper-heuristics. This thesis describes two new easy-to-implement selection hyper-heuristics and their variants based on iterated and greedy search strategies. A crucial feature of the proposed hyper-heuristics is that they necessitate setting of less number of parameters when compared to many of the existing approaches. This entails an easier and more efficient implementation, since less time and effort is required for parameter tuning. The empirical results show that our most efficient and effective hyper-heuristic which contains only a single parameter outperforms the top ranking algorithm from the challenge when evaluated across all six problem domains. Moreover, experiments using additional nurse rostering problems which are different than the ones used in the challenge and surgery scheduling problems show that the results found by the proposed hyper-heuristics are very competitive, yielding with the best known solutions in some cases

Window-based multi-objective optimization for dynamic patient scheduling with problem-specific operators

The problem of patient admission scheduling (PAS) is a nondeterministic polynomial time (NP)-hard combinatorial optimization problem with numerous constraints. Researchers have divided the constraints of this problem into hard (i.e., feasible solution) and soft constraints (i.e., quality solution). The majority of research has dealt with PAS using integer linear programming (ILP) and single objective meta-heuristic searching-based approaches. ILP-based approaches carry high computational demand and the risk of non-feasibility for a large dataset. In a single objective optimization, there is a risk of local minima due to the non-convexity of the problem. In this article, we present the first pareto front-based optimization for PAS using set of meta-heuristic approaches. We selected four multi-objective optimization methods. Problem-specific operators were developed for each of them. Next, we compared them with single objective optimization approaches, namely, simulated annealing and particle swarm optimization. In addition, this article also deals with the dynamical aspect of this problem by comparing historical window-based decomposition with day decomposition, as has previously been proposed in the literature. An evaluation of the models proposed in the article and comparison with traditional models reveals the superiority of our proposed multi-objective optimization with window incorporation in terms of optimality

A Computational Approach to Patient Flow Logistics in Hospitals

Scheduling decisions in hospitals are often taken in a decentralized way. This means that different specialized hospital units decide autonomously on e.g. patient admissions and schedules of shared resources. Decision support in such a setting requires methods and techniques that are different from the majority of existing literature in which centralized models are assumed. The design and analysis of such methods and techniques is the focus of this thesis. Specifically, we develop computational models to provide dynamic decision support for hospital resource management, the prediction of future resource occupancy and the application thereof. Hospital resource management targets the efficient deployment of resources like operating rooms and beds. Allocating resources to hospital units is a major managerial issue as the relationship between resources, utilization and patient flow of different patient groups is complex. The issues are further complicated by the fact that patient arrivals are dynamic and treatment processes are stochastic. Our approach to providing decision support combines techniques from multi-agent systems and computational intelligence (CI). This combination of techniques allows to properly consider the dynamics of the problem while reflecting the distributed decision making practice in hospitals. Multi-agent techniques are used to model multiple hospital care units and their decision policies, multiple patient groups with stochastic treatment processes and uncertain resource availability due to overlapping patient treatment processes. The agent-based model closely resembles the real-world situation. Optimization and learning techniques from CI allow for designing and evaluating improved (adaptive) decision policies for the agent-based model, which can then be implemented easily in hospital practice. In order to gain insight into the functioning of this complex and dynamic problem setting, we developed an agent-based model for the hospital care units with their patients. To assess the applicability of this agent-based model, we developed an extensive simulation. Several experiments demonstrate the functionality of the simulation and show that it is an accurate representation of the real world. The simulation is used to study decision support in resource management and patient admission control. To further improve the quality of decision support, we study the prediction of future hospital resource usage. Using prediction, the future impact of taking a certain decision can be taken into account. In the problem setting at hand for instance, predicting the resource utilization resulting from an admission decision is important to prevent future bottlenecks that may cause the blocking of patient flow and increase patient waiting times. The methods we investigate for the task of prediction are forward simulation and supervised learning using neural networks. In an extensive analysis we study the underlying probability distributions of resource occupancy and investigate, by stochastic techniques, how to obtain accurate and precise prediction outcomes. To optimize resource allocation decisions we consider multiple criteria that are important in the hospital problem setting. We use three conflicting objectives in the optimization: maximal patient throughput, minimal resource costs and minimal usage of back-up capacity. All criteria can be taken into account by finding decision policies that have the best trade-off between the criteria. We derived various decision policies that partly allow for adaptive resource allocations. The design of the policies allows the policies to be easily understandable for hospital experts. Moreover, we present a bed exchange mechanism that enables a realistic implementation of these adaptive policies in practice. In our optimization approach, the parameters of the different decision policies are determined using a multiobjective evolutionary algorithm (MOEA). Specifically, the MOEA optimizes the output of the simulation (i.e. the three optimization criteria) as a function of the policy parameters. Our results on resource management show that the benchmark allocations obtained from a case study are considerably improved by the optimized decision policies. Furthermore, our results show that using adaptive policies can lead to better results and that further improvements may be obtained by integrating prediction into a decision policy

Crossover control in selection hyper-heuristics: case studies using MKP and HyFlex

Hyper-heuristics are a class of high-level search methodologies which operate over a search space of heuristics rather than a search space of solutions. Hyper-heuristic research has set out to develop methods which are more general than traditional search and optimisation techniques. In recent years, focus has shifted considerably towards cross-domain heuristic search. The intention is to develop methods which are able to deliver an acceptable level of performance over a variety of different problem domains, given a set of low-level heuristics to work with. This thesis presents a body of work investigating the use of selection hyper-heuristics in a number of different problem domains. Specifically the use of crossover operators, prevalent in many evolutionary algorithms, is explored within the context of single-point search hyper-heuristics. A number of traditional selection hyper-heuristics are applied to instances of a well-known NP-hard combinatorial optimisation problem, the multidimensional knapsack problem. This domain is chosen as a benchmark for the variety of existing problem instances and solution methods available. The results suggest that selection hyper-heuristics are a viable method to solve some instances of this problem domain. Following this, a framework is defined to describe the conceptual level at which crossover low-level heuristics are managed in single-point selection hyper-heuristics. HyFlex is an existing software framework which supports the design of heuristic search methods over multiple problem domains, i.e. cross-domain optimisation. A traditional heuristic selection mechanism is modified in order to improve results in the context of cross-domain optimisation. Finally the effect of crossover use in cross-domain optimisation is explored

Crossover control in selection hyper-heuristics: case studies using MKP and HyFlex

Hyper-heuristics are a class of high-level search methodologies which operate over a search space of heuristics rather than a search space of solutions. Hyper-heuristic research has set out to develop methods which are more general than traditional search and optimisation techniques. In recent years, focus has shifted considerably towards cross-domain heuristic search. The intention is to develop methods which are able to deliver an acceptable level of performance over a variety of different problem domains, given a set of low-level heuristics to work with. This thesis presents a body of work investigating the use of selection hyper-heuristics in a number of different problem domains. Specifically the use of crossover operators, prevalent in many evolutionary algorithms, is explored within the context of single-point search hyper-heuristics. A number of traditional selection hyper-heuristics are applied to instances of a well-known NP-hard combinatorial optimisation problem, the multidimensional knapsack problem. This domain is chosen as a benchmark for the variety of existing problem instances and solution methods available. The results suggest that selection hyper-heuristics are a viable method to solve some instances of this problem domain. Following this, a framework is defined to describe the conceptual level at which crossover low-level heuristics are managed in single-point selection hyper-heuristics. HyFlex is an existing software framework which supports the design of heuristic search methods over multiple problem domains, i.e. cross-domain optimisation. A traditional heuristic selection mechanism is modified in order to improve results in the context of cross-domain optimisation. Finally the effect of crossover use in cross-domain optimisation is explored

Move Acceptance in Local Search Metaheuristics for Cross-domain Heuristic Search

Many real-world combinatorial optimisation problems (COPs) are computationally hard problems and search methods are frequently preferred as solution techniques. Traditionally, an expert with domain knowledge designs, and tailors the search method for solving a particular COP. This process is usually expensive, requiring a lot of effort and time and often results in problem specific algorithms that can not be applied to another COP. Then, the domain expert either needs to design a new search method, or reconfigure an existing search method to solve that COP. This prompted interest into developing more general, problem-domain-independent high-level search methods that can be re-used, capable of solving not just a single problem but multiple COPs. The cross-domain search problem is a relatively new concept and represents a high-level issue that involves designing a single solution method for solving a multitude of COPs preferably with the least or no expert intervention. Cross-domain search methods are algorithms designed to tackle the cross-domain search problem. Such methods are of interest to researchers and practitioners worldwide as they offer a single off-the-shelf go-to approach to problem solving. Furthermore, if a cross-domain search method has a good performance, then it can be expected to solve `any' given COP well and in a reasonable time frame. When a practitioner is tasked with solving a new or unknown COP, they are tasked with a decision-making dilemma. This entails the decision of what algorithm they should use, what parameters should be used for that algorithm, and whether any other algorithm can outperform it. A well designed cross-domain search method that performs well and does not require re-tuning can fulfil this dilemma allowing practitioners to find good-enough solutions to such problems. Researchers on the other hand strive to find high-quality solutions to these problems; however, such a cross-domain search method provides them with a good benchmark to which they can compare their solution methods to, and should ultimately aim to outperform. In this work, move acceptance methods, which are a component of traditional search methods, such as metaheuristics and hyper-heuristics, are explored under a cross-domain search framework. A survey of the existing move acceptance methods as a part of local search metaheuristics is conducted based on the hyper-heuristic literature as solution methods to the cross-domain search problem. Furthermore, a taxonomy is provided for classifying them based on their design characteristics. The cross-domain performance of existing move acceptance methods, covering the taxonomy, is compared across a total of 45 problem instances spanning 9 problem domains, and the effects of parameter tuning versus choice of the move acceptance method are explored. A novel move acceptance method (HAMSTA) is proposed to overcome the shortcomings of the existing methods to improve the cross-domain performance of a local search metaheuristic. HAMSTA is capable of outperforming the cross-domain performances of existing methods that are re-tuned for each domain, despite itself using only a single cross-domain parameter configuration derived from tuning experiments that considers 2 instances each from 4 domains; hence, HAMSTA requires no expert intervention to re-configure it to perform well for solving multiple COPs with 37 problem instances unseen by HAMSTA, 25 of which are from unseen domains. HAMSTA is therefore shown to have the potential to fulfil the aforementioned decision-making dilemma