rDLB: A Novel Approach for Robust Dynamic Load Balancing of Scientific Applications with Parallel Independent Tasks

Scientific applications often contain large and computationally intensive parallel loops. Dynamic loop self scheduling (DLS) is used to achieve a balanced load execution of such applications on high performance computing (HPC) systems. Large HPC systems are vulnerable to processors or node failures and perturbations in the availability of resources. Most self-scheduling approaches do not consider fault-tolerant scheduling or depend on failure or perturbation detection and react by rescheduling failed tasks. In this work, a robust dynamic load balancing (rDLB) approach is proposed for the robust self scheduling of independent tasks. The proposed approach is proactive and does not depend on failure or perturbation detection. The theoretical analysis of the proposed approach shows that it is linearly scalable and its cost decrease quadratically by increasing the system size. rDLB is integrated into an MPI DLS library to evaluate its performance experimentally with two computationally intensive scientific applications. Results show that rDLB enables the tolerance of up to (P minus one) processor failures, where P is the number of processors executing an application. In the presence of perturbations, rDLB boosted the robustness of DLS techniques up to 30 times and decreased application execution time up to 7 times compared to their counterparts without rDLB

Probabilistic Hybrid Action Models for Predicting Concurrent Percept-driven Robot Behavior

This article develops Probabilistic Hybrid Action Models (PHAMs), a realistic causal model for predicting the behavior generated by modern percept-driven robot plans. PHAMs represent aspects of robot behavior that cannot be represented by most action models used in AI planning: the temporal structure of continuous control processes, their non-deterministic effects, several modes of their interferences, and the achievement of triggering conditions in closed-loop robot plans. The main contributions of this article are: (1) PHAMs, a model of concurrent percept-driven behavior, its formalization, and proofs that the model generates probably, qualitatively accurate predictions; and (2) a resource-efficient inference method for PHAMs based on sampling projections from probabilistic action models and state descriptions. We show how PHAMs can be applied to planning the course of action of an autonomous robot office courier based on analytical and experimental results

Chance-Constrained Probabilistic Simple Temporal Problems

Scheduling under uncertainty is essential to many autonomous systems and logistics tasks. Probabilistic methods for solving temporal problems exist which quantify and attempt to minimize the probability of schedule failure. These methods are overly conservative, resulting in a loss in schedule utility. Chance constrained formalism address over-conservatism by imposing bounds on risk, while maximizing utility subject to these risk bounds. In this paper we present the probabilistic Simple Temporal Network (pSTN), a probabilistic formalism for representing temporal problems with bounded risk and a utility over event timing. We introduce a constrained optimisation algorithm for pSTNs that achieves compactness and efficiency through a problem encoding in terms of a parameterised STNU and its reformulation as a parameterised STN. We demonstrate through a car sharing application that our chance-constrained approach runs in the same time as the previous probabilistic approach, yields solutions with utility improvements of at least 5% over previous arts, while guaranteeing operation within the specified risk bound.National Science Foundation (U.S.) (Grant No. IIS-1017992

A general framework integrating techniques for scheduling under uncertainty

Ces dernières années, de nombreux travaux de recherche ont porté sur la planification de tâches et l'ordonnancement sous incertitudes. Ce domaine de recherche comprend un large choix de modèles, techniques de résolution et systèmes, et il est difficile de les comparer car les terminologies existantes sont incomplètes. Nous avons cependant identifié des familles d'approches générales qui peuvent être utilisées pour structurer la littérature suivant trois axes perpendiculaires. Cette nouvelle structuration de l'état de l'art est basée sur la façon dont les décisions sont prises. De plus, nous proposons un modèle de génération et d'exécution pour ordonnancer sous incertitudes qui met en oeuvre ces trois familles d'approches. Ce modèle est un automate qui se développe lorsque l'ordonnancement courant n'est plus exécutable ou lorsque des conditions particulières sont vérifiées. Le troisième volet de cette thèse concerne l'étude expérimentale que nous avons menée. Au-dessus de ILOG Solver et Scheduler nous avons implémenté un prototype logiciel en C++, directement instancié de notre modèle de génération et d'exécution. Nous présentons de nouveaux problèmes d'ordonnancement probabilistes et une approche par satisfaction de contraintes combinée avec de la simulation pour les résoudre. ABSTRACT : For last years, a number of research investigations on task planning and scheduling under uncertainty have been conducted. This research domain comprises a large number of models, resolution techniques, and systems, and it is difficult to compare them since the existing terminologies are incomplete. However, we identified general families of approaches that can be used to structure the literature given three perpendicular axes. This new classification of the state of the art is based on the way decisions are taken. In addition, we propose a generation and execution model for scheduling under uncertainty that combines these three families of approaches. This model is an automaton that develops when the current schedule is no longer executable or when some particular conditions are met. The third part of this thesis concerns our experimental study. On top of ILOG Solver and Scheduler, we implemented a software prototype in C++ directly instantiated from our generation and execution model. We present new probabilistic scheduling problems and a constraintbased approach combined with simulation to solve some instances thereof

Proactive management of uncertainty to improve scheduling robustness in proces industries

Dinamisme, capacitat de resposta i flexibilitat són característiques essencials en el desenvolupament de la societat actual. Les noves tendències de globalització i els avenços en tecnologies de la informació i comunicació fan que s'evolucioni en un entorn altament dinàmic i incert. La incertesa present en tot procés esdevé un factor crític a l'hora de prendre decisions, així com un repte altament reconegut en l'àrea d'Enginyeria de Sistemes de Procés (PSE). En el context de programació de les operacions, els models de suport a la decisió proposats fins ara, així com també software comercial de planificació i programació d'operacions avançada, es basen generalment en dades estimades, assumint implícitament que el programa d'operacions s'executarà sense desviacions. La reacció davant els efectes de la incertesa en temps d'execució és una pràctica habitual, però no sempre resulta efectiva o factible. L'alternativa és considerar la incertesa de forma proactiva, és a dir, en el moment de prendre decisions, explotant el coneixement disponible en el propi sistema de modelització.Davant aquesta situació es plantegen les següents preguntes: què s'entén per incertesa? Com es pot considerar la incertesa en el problema de programació d'operacions? Què s'entén per robustesa i flexibilitat d'un programa d'operacions? Com es pot millorar aquesta robustesa? Quins beneficis comporta? Aquesta tesi respon a aquestes preguntes en el marc d'anàlisis operacionals en l'àrea de PSE. La incertesa es considera no de la forma reactiva tradicional, sinó amb el desenvolupament de sistemes proactius de suport a la decisió amb l'objectiu d'identificar programes d'operació robustos que serveixin com a referència pel nivell inferior de control de planta, així com també per altres centres en un entorn de cadenes de subministrament. Aquest treball de recerca estableix les bases per formalitzar el concepte de robustesa d'un programa d'operacions de forma sistemàtica. Segons aquest formalisme, els temps d'operació i les ruptures d'equip són considerats inicialment com a principals fonts d'incertesa presents a nivell de programació de la producció. El problema es modelitza mitjançant programació estocàstica, desenvolupant-se finalment un entorn d'optimització basat en simulació que captura les múltiples fonts d'incertesa, així com també estratègies de programació d'operacions reactiva, de forma proactiva. La metodologia desenvolupada en el context de programació de la producció s'estén posteriorment per incloure les operacions de transport en sistemes de múltiples entitats i incertesa en els temps de distribució. Amb aquesta perspectiva més àmplia del nivell d'operació s'estudia la coordinació de les activitats de producció i transport, fins ara centrada en nivells estratègic o tàctic. L'estudi final considera l'efecte de la incertesa en la demanda en les decisions de programació de la producció a curt termini. El problema s'analitza des del punt de vista de gestió del risc, i s'avaluen diferents mesures per controlar l'eficiència del sistema en un entorn incert.En general, la tesi posa de manifest els avantatges en reconèixer i modelitzar la incertesa, amb la identificació de programes d'operació robustos capaços d'adaptar-se a un ampli rang de situacions possibles, enlloc de programes d'operació òptims per un escenari hipotètic. La metodologia proposada a nivell d'operació es pot considerar com un pas inicial per estendre's a nivells de decisió estratègics i tàctics. Alhora, la visió proactiva del problema permet reduir el buit existent entre la teoria i la pràctica industrial, i resulta en un major coneixement del procés, visibilitat per planificar activitats futures, així com també millora l'efectivitat de les tècniques reactives i de tot el sistema en general, característiques altament desitjables per mantenir-se actiu davant la globalitat, competitivitat i dinàmica que envolten un procés.Dynamism, responsiveness, and flexibility are essential features in the development of the current society. Globalization trends and fast advances in communication and information technologies make all evolve in a highly dynamic and uncertain environment. The uncertainty involved in a process system becomes a critical problem in decision making, as well as a recognized challenge in the area of Process Systems Engineering (PSE). In the context of scheduling, decision-support models developed up to this point, as well as commercial advanced planning and scheduling systems, rely generally on estimated input information, implicitly assuming that a schedule will be executed without deviations. The reaction to the effects of the uncertainty at execution time becomes a common practice, but it is not always effective or even possible. The alternative is to address the uncertainty proactively, i.e., at the time of reasoning, exploiting the available knowledge in the modeling procedure itself. In view of this situation, the following questions arise: what do we understand for uncertainty? How can uncertainty be considered within scheduling modeling systems? What is understood for schedule robustness and flexibility? How can schedule robustness be improved? What are the benefits? This thesis answers these questions in the context of operational analysis in PSE. Uncertainty is managed not from the traditional reactive viewpoint, but with the development of proactive decision-support systems aimed at identifying robust schedules that serve as a useful guidance for the lower control level, as well as for dependent entities in a supply chain environment. A basis to formalize the concept of schedule robustness is established. Based on this formalism, variable operation times and equipment breakdowns are first considered as the main uncertainties in short-term production scheduling. The problem is initially modeled using stochastic programming, and a simulation-based stochastic optimization framework is finally developed, which captures the multiple sources of uncertainty, as well as rescheduling strategies, proactively. The procedure-oriented system developed in the context of production scheduling is next extended to involve transport scheduling in multi-site systems with uncertain travel times. With this broader operational perspective, the coordination of production and transport activities, considered so far mainly in strategic and tactical analysis, is assessed. The final research point focuses on the effect of demands uncertainty in short-term scheduling decisions. The problem is analyzed from a risk management viewpoint, and alternative measures are assessed and compared to control the performance of the system in the uncertain environment.Overall, this research work reveals the advantages of recognizing and modeling uncertainty, with the identification of more robust schedules able to adapt to a wide range of possible situations, rather than optimal schedules for a hypothetical scenario. The management of uncertainty proposed from an operational perspective can be considered as a first step towards its extension to tactical and strategic levels of decision. The proactive perspective of the problem results in a more realistic view of the process system, and it is a promising way to reduce the gap between theory and industrial practices. Besides, it provides valuable insight on the process, visibility for future activities, as well as it improves the efficiency of reactive techniques and of the overall system, all highly desirable features to remain alive in the global, competitive, and dynamic process environment