Fast genetic algorithm approaches to solving discrete-time mixed integer linear programming problems of capacity planning and scheduling of biopharmaceutical manufacture

The previous research work in the literature for capacity planning and scheduling of biopharmaceutical manufacture focused mostly on the use of mixed integer linear programming (MILP). This paper presents fast genetic algorithm (GA) approaches for solving discrete-time MILP problems of capacity planning and scheduling in the biopharmaceutical industry. The proposed approach is validated on two case studies from the literature and compared with MILP models. In case study 1, a medium-term capacity planning problem of a single-site, multi-suite, multi-product biopharmaceutical manufacture is presented. The GA is shown to achieve the global optimum on average 3.6 times faster than a MILP model. In case study 2, a larger long-term planning problem of multi-site, multi-product bio-manufacture is solved. Using the rolling horizon strategy, the GA is demonstrated to achieve near-optimal solutions (1% away from the global optimum) as fast as a MILP model

Multi-objective biopharma capacity planning under uncertainty using a flexible genetic algorithm approach

This paper presents a flexible genetic algorithm optimisation approach for multi-objective biopharmaceutical planning problems under uncertainty. The optimisation approach combines a continuous-time heuristic model of a biopharmaceutical manufacturing process, a variable-length multi-objective genetic algorithm, and Graphics Processing Unit (GPU)-accelerated Monte Carlo simulation. The proposed approach accounts for constraints and features such as rolling product sequence-dependent changeovers, multiple intermediate demand due dates, product QC/QA release times, and pressure to meet uncertain product demand on time. An industrially-relevant case study is used to illustrate the functionality of the approach. The case study focused on optimisation of conflicting objectives, production throughput, and product inventory levels, for a multi-product biopharmaceutical facility over a 3-year period with uncertain product demand. The advantages of the multi-objective GA with the embedded Monte Carlo simulation were demonstrated by comparison with a deterministic GA tested with Monte Carlo simulation post-optimisation

Production planning of biopharmaceutical manufacture.

Multiproduct manufacturing facilities running on a campaign basis are increasingly becoming the norm for biopharmaceuticals, owing to high risks of clinical failure, regulatory pressures and the increasing number of therapeutics in clinical evaluation. The need for such flexible plants and cost-effective manufacture pose significant challenges for planning and scheduling, which are compounded by long production lead times, intermediate product stability issues and the high cost - low volume nature of biopharmaceutical manufacture. Scheduling and planning decisions are often made in the presence of variable product titres, campaign durations, contamination rates and product demands. Hence this thesis applies mathematical programming techniques to the planning of biopharmaceutical manufacture in order to identify more optimal production plans under different manufacturing scenarios. A deterministic mixed integer linear programming (MILP) medium term planning model which explicitly accounts for upstream and downstream processing is presented. A multiscenario MILP model for the medium term planning of biopharmaceutical manufacture under uncertainty is presented and solved using an iterative solution procedure. An alternative stochastic formulation for the medium term planning of biomanufacture under uncertainty based on the principles of chance constrained programming is also presented. To help manage the risks of long term capacity planning in the biopharmaceutical industry, a goal programming extension is presented which accounts for multiple objectives including cost, risk and customer service level satisfaction. The model is applied to long term capacity analysis of a mix of contractors and owned biopharmaceutical manufacturing facilities. In the final sections of this thesis an example of a commercial application of this work is presented, followed by a discussion on related validation issues in the biopharmaceutical industry. The work in this thesis highlighted the benefits of applying mathematical programming techniques for production planning of biopharmaceutical manufacturing facilities, so as to enhance the biopharmaceutical industry's strategic and operational decision-making towards achieving more cost-effective manufacture

Meta-heuristic & hyper-heuristic scheduling tools for biopharmaceutical production

The manufacturing of biopharmaceuticals requires substantial investments and necessitates long-term planning. Complicating the task of determining optimal production plans are large portfolios of products and facilities which limit the tractability of exact solution methods, and uncertainties & stochastic events which often render plans obsolete when reality deviates from the expectation. This thesis therefore describes decisional tools that are able to cope with these complexities. First, a capacity planning problem for a network of facilities and multiple products was tackled. Inspired by meta-heuristic approaches to job shop scheduling, a tailored construction heuristic that builds a production plan based on a sequence — optimised by a genetic algorithm—of product demands was proposed. Comparisons to a mathematical programming model demonstrated its competitiveness on certain scenarios and its applicability to a multi-objective problem. Next, a custom object-oriented model was introduced for a manufacturing scheduling system that utilised a failure-prone perfusion-based bioprocess. With this, process design decisions such as cell culture run time and process configuration, and single-product facility scheduling strategies were evaluated whilst incorporating simulations of stochastic failure events and uncertain demand. This model was then incorporated into a larger hyper-heuristic to determine optimal scheduling policies for a multi-product problem. Various policy representations are tested and a few policies are adapted from the literature to fit this specific problem. In addition, a novel policy utilising a look-ahead heuristic is proposed. The benefit of parameter tuning using evolutionary algorithms is demonstrated and shows that tuned policies perform much better than a policy that estimates parameters based on service level considerations. In addition, the disadvantages of relying on a fixed or rigid production sequence policy in the face of uncertainty is highlighted

Strategic Biopharmaceutical Production Planning for Batch and Perfusion Processes

Capacity planning for multiple biopharmaceutical therapeutics across a large network of manufacturing facilities, including contract manufacturers, is a complex task. Production planning is further complicated by portfolios of products requiring different modes of manufacture: batch and continuous. Capacity planning decisions each have their own costs and risks which must be carefully considered when determining manufacturing schedules. Hence, this work describes a framework which can assimilate various input data and provide intelligent capacity planning solutions. First of all, a mathematical model was created with the objective of minimising total cost. Various challenges surrounding the biomanufacturing of both perfusion and fed-batch products were solved. Sequence-dependent changeover times and full decoupling between upstream and downstream production suites were incorporated into the mixed integer linear program, which was used on an industrial case study to determine optimal manufacturing schedules and capital expenditure requirements. The effect of varying demands and fermentation titres was investigated via scenario analysis. To improve computational performance of the model, a rolling time horizon was introduced, and was shown to not only improve performance but also solution quality. The performance of the model was then improved via appropriate reformulations which consider the state task network (STN) topology of the problem domain. Two industrial case studies were used to demonstrate the merits of using the new formulation, and results showed that the STN improved performance in all test cases, and even performed better than the rolling time horizon approach from the previous model in one test case. Various strategic options regarding capacity expansion were analysed, in addition to an illustration of how the framework could be used to de-bottleneck existing capacity issues. Finally, a multi-objective component is added to the model, enabling the consideration of strategic multi-criteria decision making. The ε-constraint method was shown to be the superior multi-objective technique, and was used to demonstrate how uncertain input parameters could affect the different objectives and capacity plans in question

Expanding the Horizons of Manufacturing: Towards Wide Integration, Smart Systems and Tools

This research topic aims at enterprise-wide modeling and optimization (EWMO) through the development and application of integrated modeling, simulation and optimization methodologies, and computer-aided tools for reliable and sustainable improvement opportunities within the entire manufacturing network (raw materials, production plants, distribution, retailers, and customers) and its components. This integrated approach incorporates information from the local primary control and supervisory modules into the scheduling/planning formulation. That makes it possible to dynamically react to incidents that occur in the network components at the appropriate decision-making level, requiring fewer resources, emitting less waste, and allowing for better responsiveness in changing market requirements and operational variations, reducing cost, waste, energy consumption and environmental impact, and increasing the benefits. More recently, the exploitation of new technology integration, such as through semantic models in formal knowledge models, allows for the capture and utilization of domain knowledge, human knowledge, and expert knowledge toward comprehensive intelligent management. Otherwise, the development of advanced technologies and tools, such as cyber-physical systems, the Internet of Things, the Industrial Internet of Things, Artificial Intelligence, Big Data, Cloud Computing, Blockchain, etc., have captured the attention of manufacturing enterprises toward intelligent manufacturing systems

Developing methodologies for determining operating strategies for bioprocesses.

This thesis examines techniques for analysing bioprocess flowsheet simulations so as to determine operating strategies. Currently approaches cited in the literature for analysing bioprocesses employ visualisation of two-dimensional subsets of the feasible region. However this approach is restricted to two control variables and relies heavily on the engineer's judgement to estimate the potential impact of uncertainties in both the model and the process operation. The objective of this research was to generate methods capable of locating robust operating points for multivariate bioprocesses. Increasingly the biopharmaceutical firms are under economic pressure to speed up process development. This had lead to an increased interested in computer simulation as a tool to develop robust bioprocess. Whilst simulation has been applied extensively in the process industries it has not often been applied to bioprocesses as these tend to be more complex to model and frequently only a partial understanding of behaviour exists. Recent work has led to a capacity to simulate complete bioprocess sequences using models that capture the interactions between the unit operations. However, a major limitation is the interpretation of results from such simulations. In conventional process engineering studies optimisation routines have been used to identify the best operating conditions for a given set of objectives. Such techniques have not been applied effectively to bioprocesses due to limitations in the reliability of the models. These limitations mean that results obtained via such an approach are unlikely be useful as, in practice, the optimal points found are unlikely to be robust. The work in this thesis also looks at defining methodologies that are able to analyse multivariable bioprocesses. It looks at the application of techniques developed in the chemical process industry that can be used to account for the variability in the control variables and process parameters and at the application of statistical techniques for analysing bioprocess robustness. Overall work highlights the nature of the bioprocess insights that can be obtained through simulation and explores the utility of the application of the developed methods of analysis

Optimisation du développement de nouveaux produits dans l'industrie pharmaceutique par algorithme génétique multicritère

Le développement de nouveaux produits constitue une priorité stratégique de l'industrie pharmaceutique, en raison de la présence d'incertitudes, de la lourdeur des investissements mis en jeu, de l'interdépendance entre projets, de la disponibilité limitée des ressources, du nombre très élevé de décisions impliquées dû à la longueur des processus (de l'ordre d'une dizaine d'années) et de la nature combinatoire du problème. Formellement, le problème se pose ainsi : sélectionner des projets de Ret D parmi des projets candidats pour satisfaire plusieurs critères (rentabilité économique, temps de mise sur le marché) tout en considérant leur nature incertaine. Plus précisément, les points clés récurrents sont relatifs à la détermination des projets à développer une fois que les molécules cibles sont identifiées, leur ordre de traitement et le niveau de ressources à affecter. Dans ce contexte, une approche basée sur le couplage entre un simulateur à événements discrets stochastique (approche Monte Carlo) pour représenter la dynamique du système et un algorithme d'optimisation multicritère (de type NSGA II) pour choisir les produits est proposée. Un modèle par objets développé précédemment pour la conception et l'ordonnancement d'ateliers discontinus, de réutilisation aisée tant par les aspects de structure que de logique de fonctionnement, a été étendu pour intégrer le cas de la gestion de nouveaux produits. Deux cas d'étude illustrent et valident l'approche. Les résultats de simulation ont mis en évidence l'intérêt de trois critères d'évaluation de performance pour l'aide à la décision : le bénéfice actualisé d'une séquence, le risque associé et le temps de mise sur le marché. Ils ont été utilisés dans la formulation multiobjectif du problème d'optimisation. Dans ce contexte, des algorithmes génétiques sont particulièrement intéressants en raison de leur capacité à conduire directement au front de Pareto et à traiter l'aspect combinatoire. La variante NSGA II a été adaptée au problème pour prendre en compte à la fois le nombre et l'ordre de lancement des produits dans une séquence. A partir d'une analyse bicritère réalisée pour un cas d'étude représentatif sur différentes paires de critères pour l'optimisation bi- et tri-critère, la stratégie d'optimisation s'avère efficace et particulièrement élitiste pour détecter les séquences à considérer par le décideur. Seules quelques séquences sont détectées. Parmi elles, les portefeuilles à nombre élevé de produits provoquent des attentes et des retards au lancement ; ils sont éliminés par la stratégie d'optimistaion bicritère. Les petits portefeuilles qui réduisent les files d'attente et le temps de lancement sont ainsi préférés. Le temps se révèle un critère important à optimiser simultanément, mettant en évidence tout l'intérêt d'une optimisation tricritère. Enfin, l'ordre de lancement des produits est une variable majeure comme pour les problèmes d'ordonnancement d'atelier. ABSTRACT : New Product Development (NPD) constitutes a challenging problem in the pharmaceutical industry, due to the characteristics of the development pipeline, namely, the presence of uncertainty, the high level of the involved capital costs, the interdependency between projects, the limited availability of resources, the overwhelming number of decisions due to the length of the time horizon (about 10 years) and the combinatorial nature of a portfolio. Formally, the NPD problem can be stated as follows: select a set of R and D projects from a pool of candidate projects in order to satisfy several criteria (economic profitability, time to market) while copying with the uncertain nature of the projects. More precisely, the recurrent key issues are to determine the projects to develop once target molecules have been identified, their order and the level of resources to assign. In this context, the proposed approach combines discrete event stochastic simulation (Monte Carlo approach) with multiobjective genetic algorithms (NSGA II type, Non-Sorted Genetic Algorithm II) to optimize the highly combinatorial portfolio management problem. An object-oriented model previously developed for batch plant scheduling and design is then extended to embed the case of new product management, which is particularly adequate for reuse of both structure and logic. Two case studies illustrate and validate the approach. From this simulation study, three performance evaluation criteria must be considered for decision making: the Net Present Value (NPV) of a sequence, its associated risk defined as the number of positive occurrences of NPV among the samples and the time to market. Theyv have been used in the multiobjective optimization formulation of the problem. In that context, Genetic Algorithms (GAs) are particularly attractive for treating this kind of problem, due to their ability to directly lead to the so-called Pareto front and to account for the combinatorial aspect. NSGA II has been adapted to the treated case for taking into account both the number of products in a sequence and the drug release order. From an analysis performed for a representative case study on the different pairs of criteria both for the bi- and tricriteria optimization, the optimization strategy turns out to be efficient and particularly elitist to detect the sequences which can be considered by the decision makers. Only a few sequences are detected. Among theses sequences, large portfolios cause resource queues and delays time to launch and are eliminated by the bicriteria optimization strategy. Small portfolio reduces queuing and time to launch appear as good candidates. The optimization strategy is interesting to detect the sequence candidates. Time is an important criterion to consider simultaneously with NPV and risk criteria. The order in which drugs are released in the pipeline is of great importance as with scheduling problems

Multiobjective optimization of New Product Development in the pharmaceutical industry

New Product Development (NPD) constitutes a challenging problem in the pharmaceutical industry, due to the characteristics of the development pipeline, namely, the presence of uncertainty, the high level of the involved capital costs, the interdependency between projects, the limited availability of resources, the overwhelming number of decisions due to the length of the time horizon (about 10 years) and the combinatorial nature of a portfolio. Formally, the NPD problem can be stated as follows: select a set of R and D projects from a pool of candidate projects in order to satisfy several criteria (economic profitability, time to market) while copying with the uncertain nature of the projects. More precisely, the recurrent key issues are to determine the projects to develop once target molecules have been identified, their order and the level of resources to assign. In this context, the proposed approach combines discrete event stochastic simulation (Monte Carlo approach) with multiobjective genetic algorithms (NSGA II type, Non-Sorted Genetic Algorithm II) to optimize the highly combinatorial portfolio management problem. An object-oriented model previously developed for batch plant scheduling and design is then extended to embed the case of new product management, which is particularly adequate for reuse of both structure and logic. Two case studies illustrate and validate the approach. From this simulation study, three performance evaluation criteria must be considered for decision making: the Net Present Value (NPV) of a sequence, its associated risk defined as the number of positive occurrences of NPV among the samples and the time to market. Theyv have been used in the multiobjective optimization formulation of the problem. In that context, Genetic Algorithms (GAs) are particularly attractive for treating this kind of problem, due to their ability to directly lead to the so-called Pareto front and to account for the combinatorial aspect. NSGA II has been adapted to the treated case for taking into account both the number of products in a sequence and the drug release order. From an analysis performed for a representative case study on the different pairs of criteria both for the bi- and tricriteria optimization, the optimization strategy turns out to be efficient and particularly elitist to detect the sequences which can be considered by the decision makers. Only a few sequences are detected. Among theses sequences, large portfolios cause resource queues and delays time to launch and are eliminated by the bicriteria optimization strategy. Small portfolio reduces queuing and time to launch appear as good candidates. The optimization strategy is interesting to detect the sequence candidates. Time is an important criterion to consider simultaneously with NPV and risk criteria. The order in which drugs are released in the pipeline is of great importance as with scheduling problems