Exploiting Bounds in Operations Research and Artificial Intelligence

Combinatorial optimization problems are ubiquitous in scientific research, engineering, and even our daily lives. A major research focus in developing combinatorial search algorithms has been on the attainment of efficient methods for deriving tight lower and upper bounds. These bounds restrict the search space of combinatorial optimization problems and facilitate the computa-tion of what might otherwise be intractable problems. In this paper, we survey the history of the use of bounds in both AI and OR. While research has been extensive in both domains, until very recently it has been too narrowly focused and has overlooked great opportunities to exploit bounds. In the past, the focus has been on the relaxations of constraints. We present methods for deriving bounds by tightening constraints, adding or deleting decision variables, and modifying the objective function. Then a formalization of the use of bounds as a two-step procedure is introduced. Finally, we discuss recent developments demonstrating how the use of this framework is conducive for eliciting methods that go beyond search-tree pruning

An instance data repository for the round-robin sports timetabling problem

The sports timetabling problem is a combinatorial optimization problem that consists of creating a timetable that defines against whom, when and where teams play games. This is a complex matter, since real-life sports timetabling applications are typically highly constrained. The vast amount and variety of constraints and the lack of generally accepted benchmark problem instances make that timetable algorithms proposed in the literature are often tested on just one or two specific seasons of the competition under consideration. This is problematic since only a few algorithmic insights are gained. To mitigate this issue, this article provides a problem instance repository containing over 40 different types of instances covering artificial and real-life problem instances. The construction of such a repository is not trivial, since there are dozens of constraints that need to be expressed in a standardized format. For this, our repository relies on RobinX, an XML-supported classification framework. The resulting repository provides a (non-exhaustive) overview of most real-life sports timetabling applications published over the last five decades. For every problem, a short description highlights the most distinguishing characteristics of the problem. The repository is publicly available and will be continuously updated as new instances or better solutions become available

Competent Program Evolution, Doctoral Dissertation, December 2006

Heuristic optimization methods are adaptive when they sample problem solutions based on knowledge of the search space gathered from past sampling. Recently, competent evolutionary optimization methods have been developed that adapt via probabilistic modeling of the search space. However, their effectiveness requires the existence of a compact problem decomposition in terms of prespecified solution parameters. How can we use these techniques to effectively and reliably solve program learning problems, given that program spaces will rarely have compact decompositions? One method is to manually build a problem-specific representation that is more tractable than the general space. But can this process be automated? My thesis is that the properties of programs and program spaces can be leveraged as inductive bias to reduce the burden of manual representation-building, leading to competent program evolution. The central contributions of this dissertation are a synthesis of the requirements for competent program evolution, and the design of a procedure, meta-optimizing semantic evolutionary search (MOSES), that meets these requirements. In support of my thesis, experimental results are provided to analyze and verify the effectiveness of MOSES, demonstrating scalability and real-world applicability

Mathematical Modeling and Optimization Approaches for Scheduling the Regular-Season Games of the National Hockey League

RÉSUMÉ : La Ligue nationale de hockey (LNH) est une association sportive professionnelle de hockey sur glace regroupant des équipes du Canada et des États-Unis. Chaque année, la LNH dois compter sur un calendrier de haute qualité concernant des questions économiques et d'équité pour les 1230 matchs de sa saison régulière. Dans cette thèse, nous proposons le premier modèle de programmation linéaire en nombres entiers (PLNE) pour le problème de la planification de ces matchs. Basé sur la littérature scientifique en planification des horaires sportifs, et aussi sur un raisonnement pratique, nous identifions et soulignons des exigences essentielles et des préférences qui doivent être satisfaites par des calendriers de haute qualité pour la LNH. La construction de tels calendriers, tout comme la planification des horaires sportifs en général, s'avère une tâche très difficile qui doit prendre en compte des intérêts concurrents et, dans plusieurs cas, subjectifs. En particulier, les expérimentations numériques que nous décrivons dans cette étude fournissent des évidences solides suggérant qu'une approche basée sur la PLNE est actuellement incapable de résoudre des instances de taille réaliste pour le problème. Pour surmonter cet inconvénient, nous proposons ensuite un algorithme de recherche adaptative à voisinage large (ALNS) qui intègre à la fois des nouvelles stratégies et des heuristiques spécialisées provenant de la littérature scientifique. Afin de tester cette approche, nous générons plusieurs instances du problème. Toutes les instances sont basées sur les calendriers officiels de la LNH et, en particulier, utilisent les dates de matchs à domicile de chaque équipe comme des dates de disponibilité de son aréna. Dans les situations les plus difficiles, la disponibilité des arénas est rare ou est à son minimum. Dans tous les cas, en ce qui concerne les indicateurs de qualité soulevés, l'algorithme ALNS a été capable de générer des calendriers clairement meilleur que leur correspondants adoptés par la LNH. Les résultats obtenus suggèrent que notre approche pourrait certainement permettre aux gestionnaires de la LNH de trouver des calendriers de meilleur qualité par rapport à une variété de nouvelles préférences.----------ABSTRACT : The National Hockey League (NHL) is a major professional ice hockey league composed of 30 teams located throughout the United States and Canada. Every year, the NHL must rely on a high-quality schedule regarding both economic and fairness issues for the 1230 games of its regular season. In this thesis, we propose the first integer linear programming (IP) model for the problem of scheduling those games. Based both on the pertinent sports scheduling literature and on practical reasoning, we identify and point out essential requirements and preferences that should be satisfied by good NHL schedules. Finding such schedules, as many other sports scheduling problems, is a very difficult task that involves several stakeholders with many conflicting, and often subjective, interests. In fact, computational experiments that we describe in this study, provide compelling evidence that an IP approach is currently unable to solve instances of realistic size for the problem. To overcome such drawback, we propose then an Adaptive Large Neighborhood Search (ALNS) algorithm that integrates both novel strategies and specialized heuristics from the scientific literature. To test the approach, we generate instances based on past NHL schedules and on a given number of arena-available dates that are suitable for the home games of each team. In the most challenging instances, availability of arenas is scarce or at its minimum. In all cases, regarding the identified concerns, the ALNS algorithm was able to generate much better schedules than those implemented by the NHL. Results obtained suggest that our approach could certainly identify unnecessary weakness in NHL schedules, makes the NHL managers aware of better schedules with respect to different requirements, and even lead them to consider other desired features they might not have previously taken into account

A Survey of Monte Carlo Tree Search Methods

Monte Carlo tree search (MCTS) is a recently proposed search method that combines the precision of tree search with the generality of random sampling. It has received considerable interest due to its spectacular success in the difficult problem of computer Go, but has also proved beneficial in a range of other domains. This paper is a survey of the literature to date, intended to provide a snapshot of the state of the art after the first five years of MCTS research. We outline the core algorithm's derivation, impart some structure on the many variations and enhancements that have been proposed, and summarize the results from the key game and nongame domains to which MCTS methods have been applied. A number of open research questions indicate that the field is ripe for future work

A Polyhedral Study of Mixed 0-1 Set

We consider a variant of the well-known single node fixed charge network flow set with constant capacities. This set arises from the relaxation of more general mixed integer sets such as lot-sizing problems with multiple suppliers. We provide a complete polyhedral characterization of the convex hull of the given set

Advances in Artificial Intelligence: Models, Optimization, and Machine Learning

The present book contains all the articles accepted and published in the Special Issue “Advances in Artificial Intelligence: Models, Optimization, and Machine Learning” of the MDPI Mathematics journal, which covers a wide range of topics connected to the theory and applications of artificial intelligence and its subfields. These topics include, among others, deep learning and classic machine learning algorithms, neural modelling, architectures and learning algorithms, biologically inspired optimization algorithms, algorithms for autonomous driving, probabilistic models and Bayesian reasoning, intelligent agents and multiagent systems. We hope that the scientific results presented in this book will serve as valuable sources of documentation and inspiration for anyone willing to pursue research in artificial intelligence, machine learning and their widespread applications

Proceedings of the 18th Irish Conference on Artificial Intelligence and Cognitive Science

These proceedings contain the papers that were accepted for publication at AICS-2007, the 18th Annual Conference on Artificial Intelligence and Cognitive Science, which was held in the Technological University Dublin; Dublin, Ireland; on the 29th to the 31st August 2007. AICS is the annual conference of the Artificial Intelligence Association of Ireland (AIAI)