Applying optimal control theory to complex epidemiological models to inform real-world disease management.

Mathematical models provide a rational basis to inform how, where and when to control disease. Assuming an accurate spatially explicit simulation model can be fitted to spread data, it is straightforward to use it to test the performance of a range of management strategies. However, the typical complexity of simulation models and the vast set of possible controls mean that only a small subset of all possible strategies can ever be tested. An alternative approach-optimal control theory-allows the best control to be identified unambiguously. However, the complexity of the underpinning mathematics means that disease models used to identify this optimum must be very simple. We highlight two frameworks for bridging the gap between detailed epidemic simulations and optimal control theory: open-loop and model predictive control. Both these frameworks approximate a simulation model with a simpler model more amenable to mathematical analysis. Using an illustrative example model, we show the benefits of using feedback control, in which the approximation and control are updated as the epidemic progresses. Our work illustrates a new methodology to allow the insights of optimal control theory to inform practical disease management strategies, with the potential for application to diseases of humans, animals and plants. This article is part of the theme issue 'Modelling infectious disease outbreaks in humans, animals and plants: epidemic forecasting and control'. This theme issue is linked with the earlier issue 'Modelling infectious disease outbreaks in humans, animals and plants: approaches and important themes'

On-line policy learning and adaptation for real-time personalization of an artificial pancreas

The dynamic complexity of the glucose-insulin metabolism in diabetic patients is the main obstacle towards widespread use of an artificial pancreas. The significant level of subject-specific glycemic variability requires continuously adapting the control policy to successfully face daily changes in patient´s metabolism and lifestyle. In this paper, an on-line selective reinforcement learning algorithm that enables real-time adaptation of a control policy based on ongoing interactions with the patient so as to tailor the artificial pancreas is proposed. Adaptation includes two online procedures: on-line sparsification and parameter updating of the Gaussian process used to approximate the control policy. With the proposed sparsification method, the support data dictionary for on-line learning is modified by checking if in the arriving data stream there exists novel information to be added to the dictionary in order to personalize the policy. Results obtained in silico experiments demonstrate that on-line policy learning is both safe and efficient for maintaining blood glucose variability within the normoglycemic range.Fil: de Paula, Mariano. Universidad Nacional del Centro de la Provincia de Buenos Aires. Facultad de Ingeniería Olavarria. Departamento de Electromecánica. Grupo INTELYMEC; Argentina. Universidad Nacional del Centro de la Pcia.de Bs.as.. Centro de Investigaciones En Fisica E Ingenieria del Centro de la Provincia de Buenos Aires. - Consejo Nacional de Investigaciones Cientificas y Tecnicas. Centro Cientifico Tecnologico Conicet - Tandil. Centro de Investigaciones En Fisica E Ingenieria del Centro de la Provincia de Buenos Aires. - Provincia de Buenos Aires. Gobernacion. Comision de Invest.cientificas. Centro de Investigaciones En Fisica E Ingenieria del Centro de la Provincia de Buenos Aires; ArgentinaFil: Acosta, Gerardo Gabriel. Universidad Nacional del Centro de la Provincia de Buenos Aires. Facultad de Ingenieria Olavarria; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas; ArgentinaFil: Martinez, Ernesto Carlos. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Santa Fe. Instituto de Desarrollo y Diseño. Universidad Tecnológica Nacional. Facultad Regional Santa Fe. Instituto de Desarrollo y Diseño; Argentin

Protecting valuable resources using optimal control theory and feedback strategies for plant disease management

Mathematical models of tree diseases often have little to say about how to manage established epidemics. Models often show that it is too late for successful disease eradication, but few study what management could still be beneficial. This study focusses on finding effective control strategies for managing sudden oak death, a tree disease caused by Phytophthora ramorum. Sudden oak death is a devastating disease spreading through forests in California and southwestern Oregon. The disease is well established and eradication is no longer possible. The ongoing spread of sudden oak death is threatening high value tree resources, including national parks, and culturally and ecologically important species like tanoak. In this thesis we show how the allocation of limited resources for controlling sudden oak death can be optimised to protect these valuable trees. We use simple, approximate models of sudden oak death dynamics, to which we apply the mathematical framework of optimal control theory. Applying the optimised controls from the approximate model to a complex, spatial simulation model, we demonstrate that the framework finds effective strategies for protecting tanoak, whilst also conserving biodiversity. When applied to the problem of protecting Redwood National Park, which is under threat from a nearby outbreak of sudden oak death, the framework finds spatial strategies that balance protective barriers with control at the epidemic wavefront. Because of the number of variables in the system, computational and numerical limitations restrict the control optimisation to relatively simple approximate models. We show how a lack of accuracy in the approximate model can be accounted for by using model predictive control, from control systems engineering: an approach coupling feedback with optimal control theory. Continued surveillance of the complex system, and re-optimisation of the control strategy, ensures that the result remains close to optimal, and leads to highly effective disease management. In this thesis we show how the machinery of optimal control theory can inform plant disease management, protecting valuable resources from sudden oak death. Incorporating feedback into the application of the resulting strategies ensures control remains effective over long timescales, and is robust to uncertainties and stochasticity in the system. Local management of sudden oak death is still possible, and our results show how this can be achieved

STOCHASTIC SEASONAL MODELS FOR GLUCOSE PREDICTION IN TYPE 1 DIABETES

[ES] La diabetes es un importante problema de salud mundial, siendo una de las enfermedades no transmisibles más graves después de las enfermedades cardiovasculares, el cáncer y las enfermedades respiratorias crónicas. La prevalencia de la diabetes ha aumentado constantemente en las últimas décadas, especialmente en países de ingresos bajos y medios. Se estima que 425 millones de personas en todo el mundo tenían diabetes en 2017, y para 2045 este número puede aumentar a 629 millones. Alrededor del 10% de las personas con diabetes padecen diabetes tipo 1, caracterizada por una destrucción autoinmune de las células beta en el páncreas, responsables de la secreción de la hormona insulina. Sin insulina, la glucosa plasmática aumenta a niveles nocivos, provocando complicaciones vasculares a largo plazo. Hasta que se encuentre una cura, el manejo de la diabetes depende de los avances tecnológicos para terapias de reemplazo de insulina. Con la llegada de los monitores continuos de glucosa, la tecnología ha evolucionado hacia sistemas automatizados. Acuñados como "páncreas artificial", los dispositivos de control de glucosa en lazo cerrado suponen hoy en día un cambio de juego en el manejo de la diabetes. La investigación en las últimas décadas ha sido intensa, dando lugar al primer sistema comercial a fines de 2017, y muchos más están siendo desarrollados por las principales industrias de dispositivos médicos. Sin embargo, como dispositivo de primera generación, muchos problemas aún permanecen abiertos y nuevos avances tecnológicos conducirán a mejoras del sistema para obtener mejores resultados de control glucémico y reducir la carga del paciente, mejorando significativamente la calidad de vida de las personas con diabetes tipo 1. En el centro de cualquier sistema de páncreas artificial se encuentra la predicción de glucosa, tema abordado en esta tesis. La capacidad de predecir la glucosa a lo largo de un horizonte de predicción dado, y la estimación de las tendencias futuras de glucosa, es la característica más importante de cualquier sistema de páncreas artificial, para poder tomar medidas preventivas que eviten por completo el riesgo para el paciente. La predicción de glucosa puede aparecer como parte del algoritmo de control en sí, como en sistemas basados en técnicas de control predictivo basado en modelo (MPC), o como parte de un sistema de supervisión para evitar episodios de hipoglucemia. Sin embargo, predecir la glucosa es un problema muy desafiante debido a la gran variabilidad inter e intra-sujeto que sufren los pacientes, cuyas fuentes solo se entienden parcialmente. Esto limita las prestaciones predictivas de los modelos, imponiendo horizontes de predicción relativamente cortos, independientemente de la técnica de modelado utilizada (modelos fisiológicos, basados en datos o híbridos). La hipótesis de partida de esta tesis es que la complejidad de la dinámica de la glucosa requiere la capacidad de caracterizar grupos de comportamientos en los datos históricos del paciente que llevan naturalmente al concepto de modelado local. Además, la similitud de las respuestas en un grupo puede aprovecharse aún más para introducir el concepto clásico de estacionalidad en la predicción de glucosa. Como resultado, los modelos locales estacionales están en el centro de esta tesis. Se utilizan varias bases de datos clínicas que incluyen comidas mixtas y ejercicio para demostrar la viabilidad y superioridad de las prestaciones de este enfoque.[CA] La diabetisés un important problema de salut mundial, sent una de les malalties no transmissibles més greus després de les malalties cardiovasculars, el càncer i les malalties respiratòries cròniques. La prevalença de la diabetis ha augmentat constantment en les últimes dècades, especialment en països d'ingressos baixos i mitjans. S'estima que 425 milions de persones a tot el món tenien diabetis en 2017, i per 2045 aquest nombre pot augmentar a 629 milions. Al voltant del 10% de les persones amb diabetis pateixen diabetis tipus 1, caracteritzada per una destrucció autoimmune de les cèl·lules beta en el pàncrees, responsables de la secreció de l'hormona insulina. Sense insulina, la glucosa plasmàtica augmenta a nivells nocius, provocant complicacions vasculars a llarg termini. Fins que es trobi una cura, el maneig de la diabetis depén dels avenços tecnològics per a teràpies de reemplaçament d'insulina. Amb l'arribada dels monitors continus de glucosa, la tecnologia ha evolucionat cap a sistemes automatitzats. Encunyats com "pàncrees artificial", els dispositius de control de glucosa en llaç tancat suposen avui dia un canvi de joc en el maneig de la diabetis. La investigació en les últimes dècades ha estat intensa, donant lloc al primer sistema comercial a finals de 2017, i molts més estan sent desenvolupats per les principals indústries de dispositius mèdics. No obstant això, com a dispositiu de primera generació, molts problemes encara romanen oberts i nous avenços tecnològics conduiran a millores del sistema per obtenir millors resultats de control glucèmic i reduir la càrrega del pacient, millorant significativament la qualitat de vida de les persones amb diabetis tipus 1. Al centre de qualsevol sistema de pàncrees artificial es troba la predicció de glucosa, tema abordat en aquesta tesi. La capacitat de predir la glucosa al llarg d'un horitzó de predicció donat, i l'estimació de les tendències futures de glucosa, és la característica més important de qualsevol sistema de pàncrees artificial, per poder prendre mesures preventives que evitin completament el risc per el pacient. La predicció de glucosa pot aparèixer com a part de l'algoritme de control en si, com en sistemes basats en técniques de control predictiu basat en model (MPC), o com a part d'un sistema de supervisió per evitar episodis d'hipoglucèmia. No obstant això, predir la glucosa és un problema molt desafiant degut a la gran variabilitat inter i intra-subjecte que pateixen els pacients, les fonts només s'entenen parcialment. Això limita les prestacions predictives dels models, imposant horitzons de predicció relativament curts, independentment de la tècnica de modelatge utilitzada (models fisiològics, basats en dades o híbrids). La hipòtesi de partida d'aquesta tesi és que la complexitat de la dinàmica de la glucosa requereix la capacitat de caracteritzar grups de comportaments en les dades històriques del pacient que porten naturalment al concepte de modelatge local. A més, la similitud de les respostes en un grup pot aprofitar-se encara més per introduir el concepte clàssic d'estacionalitat en la predicció de glucosa. Com a resultat, els models locals estacionals estan al centre d'aquesta tesi. S'utilitzen diverses bases de dades clíniques que inclouen menjars mixtes i exercici per demostrar la viabilitat i superioritat de les prestacions d'aquest enfocament.[EN] Diabetes is a significant global health problem, one of the most serious noncommunicable diseases after cardiovascular diseases, cancer and chronic respiratory diseases. Diabetes prevalence has been steadily increasing over the past decades, especially in low- and middle-income countries. It is estimated that 425 million people worldwide had diabetes in 2017, and by 2045 this number may rise to 629 million. About 10% of people with diabetes suffer from type 1 diabetes, characterized by autoimmune destruction of the beta-cells in the pancreas, responsible for the secretion of the hormone insulin. Without insulin, plasma glucose rises to deleterious levels, provoking long-term vascular complications. Until a cure is found, the management of diabetes relies on technological developments for insulin replacement therapies. With the advent of continuous glucose monitors, technology has been evolving towards automated systems. Coined as "artificial pancreas", closed-loop glucose control devices are nowadays a game-changer in diabetes management. Research in the last decades has been intense, yielding a first commercial system in late 2017 and many more are in the pipeline of the main medical devices industry. However, as a first-generation device, many issues still remain open and new technological advancements will lead to system improvements for better glycemic control outputs and reduced patient's burden, improving significantly the quality of life of people with type 1 diabetes. At the core of any artificial pancreas system is glucose prediction, the topic addressed in this thesis. The ability to predict glucose along a given prediction horizon, and estimation of future glucose trends, is the most important feature of any artificial pancreas system, in order to be able to take preventive actions to entirely avoid risk to the patient. Glucose prediction can appear as part of the control algorithm itself, such as in systems based on model predictive control (MPC) techniques, or as part of a monitoring system to avoid hypoglycemic episodes. However, predicting glucose is a very challenging problem due to the large inter- and intra-subject variability that patients suffer, whose sources are only partially understood. These limits models forecasting performance, imposing relatively short prediction horizons, despite the modeling technique used (physiological, data-driven or hybrid approaches). The starting hypothesis of this thesis is that the complexity of glucose dynamics requires the ability to characterize clusters of behaviors in the patient's historical data naturally yielding to the concept of local modeling. Besides, the similarity of responses in a cluster can be further exploited to introduce the classical concept of seasonality into glucose prediction. As a result, seasonal local models are at the core of this thesis. Several clinical databases including mixed meals and exercise are used to demonstrate the feasibility and superiority of the performance of this approach.This work has been supported by the Spanish Ministry of Economy and Competitiveness (MINECO) under the FPI grant BES-2014-069253 and projects DPI2013-46982-C2-1-R and DPI2016-78831-C2-1-R. Moreover, with relation to this grant, a short stay was done at the end of 2017 at the Illinois Institute of Technology, Chicago, United States of America, under the supervision of Prof. Ali Cinar, for four months from 01/09/2017 to 29/12/2017.Montaser Roushdi Ali, E. (2020). STOCHASTIC SEASONAL MODELS FOR GLUCOSE PREDICTION IN TYPE 1 DIABETES [Tesis doctoral]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/136574TESI

Modeling and Optimization of Dynamical Systems in Epidemiology using Sparse Grid Interpolation

Infectious diseases pose a perpetual threat across the globe, devastating communities, and straining public health resources to their limit. The ease and speed of modern communications and transportation networks means policy makers are often playing catch-up to nascent epidemics, formulating critical, yet hasty, responses with insufficient, possibly inaccurate, information. In light of these difficulties, it is crucial to first understand the causes of a disease, then to predict its course, and finally to develop ways of controlling it. Mathematical modeling provides a methodical, in silico solution to all of these challenges, as we explore in this work. We accomplish these tasks with the aid of a surrogate modeling technique known as sparse grid interpolation, which approximates dynamical systems using a compact polynomial representation. Our contributions to the disease modeling community are encapsulated in the following endeavors. We first explore transmission and recovery mechanisms for disease eradication, identifying a relationship between the reproductive potential of a disease and the maximum allowable disease burden. We then conduct a comparative computational study to improve simulation fits to existing case data by exploiting the approximation properties of sparse grid interpolants both on the global and local levels. Finally, we solve a joint optimization problem of periodically selecting field sensors and deploying public health interventions to progressively enhance the understanding of a metapopulation-based infectious disease system using a robust model predictive control scheme

Optimal control of diabetes

This thesis considers optimal control problems related to one of the major global health problems, Diabetes. We adopt a comprehensive dynamic model of the blood glucose regulatory system and show how it can be readily fitted to individuals. Based on this, we develop a composite dynamic model for simulating the effects of exercise and subcutaneous insulin injections on the blood glucose regulatory system. We then determine that optimal treatment regimens on the basis of the composite model

Modelling, optimisation and model predictive control of insulin delivery systems in Type 1 Diabetes Mellitus

Type 1 Diabetes Mellitus is a metabolic disease requiring lifelong treatment with exogenous insulin which significantly affects patient’s lifestyle. Therefore, it is of paramount importance to develop novel drug delivery techniques that achieve therapeutic efficacy and ensure patient safety with a minimum impact on their quality of life. Motivated by the challenge to improve the living standard of a diabetic patient, the idea of an artificial pancreas that mimics the endocrine function of a healthy pancreas has been developed in the scientific society. Towards this direction, model predictive control has been established as a very promising control strategy for blood glucose regulation in a system that is dominated by high intra- and inter-patient variability, long time delays, and presence of unknown disturbances such as diet, physical activity and stress levels. This thesis presents a framework for blood glucose regulation with optimal insulin infusion which consists of the following steps: 1. Development of a novel physiologically based compartmental model analysed up to organ level that describes glucose-insulin interactions in type 1 diabetes, 2. Derivation of an approximate model suitable for control applications, 3. Design of an appropriate control strategy and 4. In-silico validation of the closed loop control performance. The developed model’s accuracy and prediction ability is evaluated with data obtained from the literature and the UVa/Padova Simulator model, the model parameters are individually estimated and their effect on the model’s measured output, the blood glucose concentration, is identified. The model is then linearised and reduced to derive low-order linear approximations of the underlying system suitable for control applications. The proposed control design aims towards an individualised optimal insulin delivery that consists of a patient-specific model predictive controller, a state estimator, a personalised scheduling level and an open loop optimisation problem subjected to patient specific process model and constraints. This control design is modifiable to address the case of limited patient data availability resulting in an “approximation” control strategy. Both designs are validated in-silico in the presence of predefined, measured and unknown meal disturbances using both the proposed model and the UVa/Padova Simulator model as a virtual patient. The robustness of the control performance is evaluated in several conditions such as skipped meals, variability in the meal content, time and metabolic uncertainty. The simulation results of the closed loop validation studies indicate that the proposed control strategies can achieve promising glycaemic control as demonstrated by the study data. However, further prospective validation of the closed loop control strategy with real patient data is required.Open Acces