An Efficient Local Search for Partial Latin Square Extension Problem

A partial Latin square (PLS) is a partial assignment of n symbols to an nxn grid such that, in each row and in each column, each symbol appears at most once. The partial Latin square extension problem is an NP-hard problem that asks for a largest extension of a given PLS. In this paper we propose an efficient local search for this problem. We focus on the local search such that the neighborhood is defined by (p,q)-swap, i.e., removing exactly p symbols and then assigning symbols to at most q empty cells. For p in {1,2,3}, our neighborhood search algorithm finds an improved solution or concludes that no such solution exists in O(n^{p+1}) time. We also propose a novel swap operation, Trellis-swap, which is a generalization of (1,q)-swap and (2,q)-swap. Our Trellis-neighborhood search algorithm takes O(n^{3.5}) time to do the same thing. Using these neighborhood search algorithms, we design a prototype iterated local search algorithm and show its effectiveness in comparison with state-of-the-art optimization solvers such as IBM ILOG CPLEX and LocalSolver.Comment: 17 pages, 2 figure

On the completability of mutually orthogonal Latin rectangles

This thesis examines the completability of an incomplete set of m-row orthogonal Latin rectangles (MOLRm) from a set theoretical viewpoint. We focus on the case of two rows, i.e. MOLR2, and define its independence system (IS) and the associated clutter of bases, which is the collection of all MOLR2. Any such clutter gives rise to a unique clutter of circuits which is the collection of all minimal dependent sets. To decide whether an incomplete set of MOLR2 is completable, it suffices to show that it does not contain a circuit therefore full knowledge of the clutter of circuits is needed. For the IS associated with 2-row orthogonal Latin rectangles (OLR2) we establish a methodology based on the notion of an availability matrix to fully characterise the corresponding clutter of circuits. We prove that..

Integer and Constraint programming methods for mutually Orthogonal Latin Squares.

This thesis examines the Orthogonal Latin Squares (OLS) problem from the viewpoint of Integer and Constraint programming. An Integer Programming (IP) model is proposed and the associated polytope is analysed. We identify several families of strong valid inequalities, namely inequalities arising from cliques, odd holes, antiwebs and wheels of the associated intersection graph. The dimension of the OLS polytope is established and it is proved that certain valid inequalities are facet-inducing. This analysis reveals also a new family of facet-defining inequalities for the polytope associated with the Latin square problem. Separation algorithms of the lowest complexity are presented for particular families of valid inequalities. We illustrate a method for reducing problem's symmetry, which extends previously known results. This allows us to devise an alternative proof for the non-existence of an OLS structure for n = 6, based solely on Linear Programming. Moreover, we present a more general Branch & Cut algorithm for the OLS problem. The algorithm exploits problem structure via integer preprocessing and a specialised branching mechanism. It also incorporates families of strong valid inequalities. Computational analysis is conducted in order to illustrate the significant improvements over simple Branch & Bound. Next, the Constraint Programming (CP) paradigm is examined. Important aspects of designing an efficient CP solver, such as branching strategies and constraint propagation procedures, are evaluated by comprehensive, problem-specific, experiments. The CP algorithms lead to computationally favourable results. In particular, the infeasible case of n = 6, which requires enumerating the entire solution space, is solved in a few seconds. A broader aim of our research is to successfully integrate IP and CP. Hence, we present ideas concerning the unification of IP and CP methods in the form of hybrid algorithms. Two such algorithms are presented and their behaviour is analysed via experimentation. The main finding is that hybrid algorithms are clearly more efficient, as problem size grows, and exhibit a more robust performance than traditional IP and CP algorithms. A hybrid algorithm is also designed for the problem of finding triples of Mutually Orthogonal Latin Squares (MOLS). Given that the OLS problem is a special form of an assignment problem, the last part of the thesis considers multidimensional assignment problems. It introduces a model encompassing all assignment structures, including the case of MOLS. A necessary condition for the existence of an assignment structure is revealed. Relations among assignment problems are also examined, leading to a proposed hierarchy. Further, the polyhedral analysis presented unifies and generalises previous results

On local search and LP and SDP relaxations for k-Set Packing

Set packing is a fundamental problem that generalises some well-known combinatorial optimization problems and knows a lot of applications. It is equivalent to hypergraph matching and it is strongly related to the maximum independent set problem. In this thesis we study the k-set packing problem where given a universe U and a collection C of subsets over U, each of cardinality k, one needs to find the maximum collection of mutually disjoint subsets. Local search techniques have proved to be successful in the search for approximation algorithms, both for the unweighted and the weighted version of the problem where every subset in C is associated with a weight and the objective is to maximise the sum of the weights. We make a survey of these approaches and give some background and intuition behind them. In particular, we simplify the algebraic proof of the main lemma for the currently best weighted approximation algorithm of Berman ([Ber00]) into a proof that reveals more intuition on what is really happening behind the math. The main result is a new bound of k/3 + 1 + epsilon on the integrality gap for a polynomially sized LP relaxation for k-set packing by Chan and Lau ([CL10]) and the natural SDP relaxation [NOTE: see page iii]. We provide detailed proofs of lemmas needed to prove this new bound and treat some background on related topics like semidefinite programming and the Lovasz Theta function. Finally we have an extended discussion in which we suggest some possibilities for future research. We discuss how the current results from the weighted approximation algorithms and the LP and SDP relaxations might be improved, the strong relation between set packing and the independent set problem and the difference between the weighted and the unweighted version of the problem.Comment: There is a mistake in the following line of Theorem 17: "As an induced subgraph of H with more edges than vertices constitutes an improving set". Therefore, the proofs of Theorem 17, and hence Theorems 19, 23 and 24, are false. It is still open whether these theorems are tru

Design of Experiments for Screening

The aim of this paper is to review methods of designing screening experiments, ranging from designs originally developed for physical experiments to those especially tailored to experiments on numerical models. The strengths and weaknesses of the various designs for screening variables in numerical models are discussed. First, classes of factorial designs for experiments to estimate main effects and interactions through a linear statistical model are described, specifically regular and nonregular fractional factorial designs, supersaturated designs and systematic fractional replicate designs. Generic issues of aliasing, bias and cancellation of factorial effects are discussed. Second, group screening experiments are considered including factorial group screening and sequential bifurcation. Third, random sampling plans are discussed including Latin hypercube sampling and sampling plans to estimate elementary effects. Fourth, a variety of modelling methods commonly employed with screening designs are briefly described. Finally, a novel study demonstrates six screening methods on two frequently-used exemplars, and their performances are compared

Different Formulations of the Orthogonal Array Problem and Their Symmetries

Modern statistical experiments routinely feature a large number of input variables that can each be set to a variety of different levels. In these experiments, output response changes as a result of changes in the individual factor level settings. Often, an individual experimental run can be costly in time, money or both. Therefore, experimenters generally want to gain the desired information on factor effects from the smallest possible number of experimental runs. Orthogonal arrays provide the most desirable designs. However, finding orthogonal arrays is a very challenging problem. There are numerous integer linear programming formulations (ILP) in the literature whose solutions are orthogonal arrays. Because of the nature of orthogonal arrays, these ILP formulations contain symmetries where some portion of the variables in the formulation can be swapped without changing the ILP. These symmetries make it possible to eliminate large numbers of infeasible or equivalent solutions quickly, thereby greatly reducing the time required to find all non-equivalent solutions to the ILPs. In this dissertation, a new method for identifying symmetries is developed and tested using several existing and new ILP formulations for enumerating orthogonal arrays

A Tutorial on Clique Problems in Communications and Signal Processing

Since its first use by Euler on the problem of the seven bridges of K\"onigsberg, graph theory has shown excellent abilities in solving and unveiling the properties of multiple discrete optimization problems. The study of the structure of some integer programs reveals equivalence with graph theory problems making a large body of the literature readily available for solving and characterizing the complexity of these problems. This tutorial presents a framework for utilizing a particular graph theory problem, known as the clique problem, for solving communications and signal processing problems. In particular, the paper aims to illustrate the structural properties of integer programs that can be formulated as clique problems through multiple examples in communications and signal processing. To that end, the first part of the tutorial provides various optimal and heuristic solutions for the maximum clique, maximum weight clique, and $k$-clique problems. The tutorial, further, illustrates the use of the clique formulation through numerous contemporary examples in communications and signal processing, mainly in maximum access for non-orthogonal multiple access networks, throughput maximization using index and instantly decodable network coding, collision-free radio frequency identification networks, and resource allocation in cloud-radio access networks. Finally, the tutorial sheds light on the recent advances of such applications, and provides technical insights on ways of dealing with mixed discrete-continuous optimization problems