A Tutorial on Clique Problems in Communications and Signal Processing

Since its first use by Euler on the problem of the seven bridges of K\"onigsberg, graph theory has shown excellent abilities in solving and unveiling the properties of multiple discrete optimization problems. The study of the structure of some integer programs reveals equivalence with graph theory problems making a large body of the literature readily available for solving and characterizing the complexity of these problems. This tutorial presents a framework for utilizing a particular graph theory problem, known as the clique problem, for solving communications and signal processing problems. In particular, the paper aims to illustrate the structural properties of integer programs that can be formulated as clique problems through multiple examples in communications and signal processing. To that end, the first part of the tutorial provides various optimal and heuristic solutions for the maximum clique, maximum weight clique, and $k$-clique problems. The tutorial, further, illustrates the use of the clique formulation through numerous contemporary examples in communications and signal processing, mainly in maximum access for non-orthogonal multiple access networks, throughput maximization using index and instantly decodable network coding, collision-free radio frequency identification networks, and resource allocation in cloud-radio access networks. Finally, the tutorial sheds light on the recent advances of such applications, and provides technical insights on ways of dealing with mixed discrete-continuous optimization problems

A Comparison of Algorithms for Learning Hidden Variables in Normal Graphs

A Bayesian factor graph reduced to normal form consists in the interconnection of diverter units (or equal constraint units) and Single-Input/Single-Output (SISO) blocks. In this framework localized adaptation rules are explicitly derived from a constrained maximum likelihood (ML) formulation and from a minimum KL-divergence criterion using KKT conditions. The learning algorithms are compared with two other updating equations based on a Viterbi-like and on a variational approximation respectively. The performance of the various algorithm is verified on synthetic data sets for various architectures. The objective of this paper is to provide the programmer with explicit algorithms for rapid deployment of Bayesian graphs in the applications.Comment: Submitted for journal publicatio

Polyhedra and algorithms for problems bridging notions of connectivity and independence

I denne avhandlinga interesserer vi oss for å finne delgrafer som svarer til utvalgte modeller for begrepene sammenheng og uavhengighet. I korthet betyr dette stabile (også kalt uavhengige) mengder med gitt kardinalitet, stabile (også kalt konfliktfrie) spenntrær og pardannelser (eller uavhengige kantmengder) som induserer en sammenhengende delgraf. Dette er kombinatoriske strukturer som kan generaliseres til ulike modeller for nettverksdesign innen telekommunikasjon og forsyningsvirksomhet, plassering av anlegg, fylogenetikk, og mange andre applikasjoner innen operasjonsanalyse og optimering. Vi argumenterer for at de valgte strukturene reiser interessante forskningsspørsmål, og vi bidrar med forbedret matematisk forståelse av selve strukturene, samt forbedrede algoritmer for å takle de tilhørende kombinatoriske optimeringsproblemene. Med det mener vi metoder for å identifisere en optimal struktur, forutsatt at elementene som danner dem (hjørner eller kanter i en gitt graf) er tildelt verdier. Forskninga vår omfatter ulike områder innenfor algoritmer, kombinatorikk og optimering. De fleste resultatene omhandler det å finne bedre beskrivelser av de geometriske strukturene (nemlig 0/1-polytoper) som representerer alle mulige løsninger for hvert av problemene. Slike forbedrede beskrivelser oversettes til lineære ulikheter i heltallsprogrammeringsmodeller, noe som igjen gir mer effektive beregningsresultater når man løser referanseinstanser av hvert problem. Vi påpeker gjentatte ganger betydninga av å dele kildekoden til implementasjonen av alle utviklede algoritmer og verktøy når det foreslås nye modeller og løsningsmetoder for heltallsprogrammering og kombinatorisk optimering. Kodearkivene våre inkluderer fullstendige implementasjoner, utformet med effektivitet og modulær design i tankene, og fremmer dermed gjenbruk, videre forskning og nye anvendelser innen forskning og utvikling.We are interested in finding subgraphs that capture selected models of connectivity and independence. In short: fixed cardinality stable (or independent) sets, stable (or conflict-free) spanning trees, and matchings (or independent edge sets) inducing a connected subgraph. These are combinatorial structures that can be generalized to a number of models across network design in telecommunication and utilities, facility location, phylogenetics, among many other application domains of operations research and optimization. We argue that the selected structures raise appealing research questions, and seek to contribute with improved mathematical understanding of the structures themselves, as well as improved algorithms to face the corresponding combinatorial optimization problems. That is, methods to identify an optimal structure, assuming the elements that form them (vertices or edges in a given graph) have a weight. Our research spans different lines within algorithmics, combinatorics and optimization. Most of the results concern finding better descriptions of the geometric structures (namely, 0/1-polytopes) that represent all feasible solutions to each of the problems. Such improved descriptions translate to linear inequalities in integer programming formulations which, in turn, provide stronger computational results when solving benchmark instances of each problem. We repeatedly remark the importance of sharing an open-source implementation of all algorithms and tools developed when proposing new models and solution methods in integer programming and combinatorial optimization. Our code repositories include full implementations, crafted with efficiency and modular design in mind, thus fostering reuse, further research and new applications in research and development.Doktorgradsavhandlin