Module detection in complex networks using integer optimisation

Background: The detection of modules or community structure is widely used to reveal the underlying properties of complex networks in biology, as well as physical and social sciences. Since the adoption of modularity as a measure of network topological properties, several methodologies for the discovery of community structure based on modularity maximisation have been developed. However, satisfactory partitions of large graphs with modest computational resources are particularly challenging due to the NP-hard nature of the related optimisation problem. Furthermore, it has been suggested that optimising the modularity metric can reach a resolution limit whereby the algorithm fails to detect smaller communities than a specific size in large networks. Results: We present a novel solution approach to identify community structure in large complex networks and address resolution limitations in module detection. The proposed algorithm employs modularity to express network community structure and it is based on mixed integer optimisation models. The solution procedure is extended through an iterative procedure to diminish effects that tend to agglomerate smaller modules ( resolution limitations). Conclusions: A comprehensive comparative analysis of methodologies for module detection based on modularity maximisation shows that our approach outperforms previously reported methods. Furthermore, in contrast to previous reports, we propose a strategy to handle resolution limitations in modularity maximisation. Overall, we illustrate ways to improve existing methodologies for community structure identification so as to increase its efficiency and applicability

Optimisation as a Tool for Gaining Insight: An Application to the Built Environment

The design of heating systems for dwellings using new technologies, or new versions of old technologies, requires the ability to predict the temperatures in a dwelling. The temperature behaviour can be modelled, typically by differential equations which incorporate thermal driving forces and the thermal inertia of a dwelling. The development and characterisation of these models is usually based on fitting data accumulated over sufficient time to capture the behaviour of the dwelling under different conditions (summer, winter, etc.). Model fitting relies on assumptions about the behaviour of the system. Optimisation can be used to examine these assumptions and gain insight into this behaviour. This paper describes the application of a nature inspired algorithm, known as the Plant Propagation Algorithm, a variant of a Variable Neighbourhood Search algorithm, to the problem of modelling a dwelling heated by an air source heat pump. The algorithm is evaluated using different population evolution strategies and implemented using a simple parallel computing paradigm on a multi-core desktop system. The results are used to identify potential sources of missing data which could explain the observed behaviour of the dwelling. </jats:p

Data-driven scenario generation for two-stage stochastic programming

Optimisation under uncertainty has always been a focal point within the Process Systems Engineering (PSE) research agenda. In particular, the efficient manipulation of large amount of data for the uncertain parameters constitutes a crucial condition for effectively tackling stochastic programming problems. In this context, this work proposes a new data-driven Mixed-Integer Linear Programming (MILP) model for the Distribution & Moment Matching Problem (DMP). For cases with multiple uncertain parameters a copula-based simulation of initial scenarios is employed as preliminary step. Moreover, the integration of clustering methods and DMP in the proposed model is shown to enhance computational performance. Finally, we compare the proposed approach with state-of-the-art scenario generation methodologies. Through a number of case studies we highlight the benefits regarding the quality of the generated scenario trees by evaluating the corresponding obtained stochastic solutions

Stable optimisation-based scenario generation via game theoretic approach

Systematic scenario generation (SG) methods have emerged as an invaluable tool to handle uncertainty towards the efficient solution of stochastic programming (SP) problems. The quality of SG methods depends on their consistency to generate scenario sets which guarantee stability on solving SPs and lead to stochastic solutions of good quality. In this context, we delve into the optimisation-based Distribution and Moment Matching Problem (DMP) for scenario generation and propose a game-theoretic approach which is formulated as a Mixed-Integer Linear Programming (MILP) model. Nash bargaining approach is employed and the terms of the objective function regarding the statistical matching of the DMP are considered as players. Results from a capacity planning case study highlight the quality of the stochastic solutions obtained using MILP DMP models for scenario generation. Furthermore, the proposed game-theoretic extension of DMP enhances in-sample and out-of-sample stability with respect to the challenging problem of user-defined parameters variability

A regression tree approach using mathematical programming

Regression analysis is a machine learning approach that aims to accurately predict the value of continuous output variables from certain independent input variables, via automatic estimation of their latent relationship from data. Tree-based regression models are popular in literature due to their flexibility to model higher order non-linearity and great interpretability. Conventionally, regression tree models are trained in a two-stage procedure, i.e. recursive binary partitioning is employed to produce a tree structure, followed by a pruning process of removing insignificant leaves, with the possibility of assigning multivariate functions to terminal leaves to improve generalisation. This work introduces a novel methodology of node partitioning which, in a single optimisation model, simultaneously performs the two tasks of identifying the break-point of a binary split and assignment of multivariate functions to either leaf, thus leading to an efficient regression tree model. Using six real world benchmark problems, we demonstrate that the proposed method consistently outperforms a number of state-of-the-art regression tree models and methods based on other techniques, with an average improvement of 7–60% on the mean absolute errors (MAE) of the predictions

Sample re-weighting hyper box classifier for multi-class data classification

Abstract In this work, we propose two novel classifiers for multi-class classification problems using mathematical programming optimisation techniques. A hyper box-based classifier (Xu &amp; Papageorgiou, 2009) that iteratively constructs hyper boxes to enclose samples of different classes has been adopted. We firstly propose a new solution procedure that updates the sample weights during each iteration, which tweaks the model to favour those difficult samples in the next iteration and therefore achieves a better final solution. Through a number of real world data classification problems, we demonstrate that the proposed refined classifier results in consistently good classification performance, outperforming the original hyper box classifier and a number of other state-of-the-art classifiers. Furthermore, we introduce a simple data space partition method to reduce the computational cost of the proposed sample re-weighting hyper box classifier. The partition method partitions the original dataset into two disjoint regions, followed by training sample re-weighting hyper box classifier for each region respectively. Through some real world datasets, we demonstrate the data space partition method considerably reduces the computational cost while maintaining the level of prediction accuracies.</p

Optimal hydrogen infrastructure planning for heat decarbonisation

Energy decarbonisation is essential to achieve Net-Zero emissions goal by 2050. Consequently, investments in alternative low-carbon pathways and energy carriers for the heat sector are required. In this study, we propose an optimisation framework for the transition of heat sector in Great Britain focusing on hydrogen infrastructure decisions. A spatially-explicit mixed-integer linear programming (MILP) evolution model is developed to minimise the total system’s cost considering investment and operational decisions. The optimisation framework incorporates both long-term planning horizon of 5-year steps from 2035 to 2050 and typical days with hourly resolution. Aiming to alleviate the computational effort of such multiscale model, two hierarchical solution approaches are suggested that result in computational time reduction. From the optimisation results, it is shown that the installation of gas reforming hydrogen production technologies with CCS and biomass gasification with CCS can provide a cost-effective strategy achieving decarbonisation goal. What-if analysis is conducted to demonstrate further insights for future hydrogen infrastructure investments. Results indicate that, as cost is highly dependent on natural gas price, Water Electrolysis capacity increases significantly when gas price rises. Moreover, the introduction of carbon tax policy can lead to lower CO2 net emissions

Stable optimisation-based scenario generation via game theoretic approach

Systematic scenario generation (SG) methods have emerged as an invaluable tool to handle uncertainty towards the efficient solution of stochastic programming (SP) problems. The quality of SG methods depends on their consistency to generate scenario sets which guarantee stability on solving SPs and lead to stochastic solutions of good quality. In this context, we delve into the optimisation-based Distribution and Moment Matching Problem (DMP) for scenario generation and propose a game theoretic approach which is formulated as a Mixed-Integer Linear Programming (MILP) model. Nash bargaining approach is employed and the terms of the objective function regarding the statistical matching of the DMP are considered as players. Results from a capacity planning case study highlight the quality of the stochastic solutions obtained using MILP DMP models for scenario generation. Furthermore, the proposed game theoretic extension of DMP enhances in-sample and out-of-sample stability with respect to the challenging problem of user-defined parameters variability

A rolling horizon approach for optimal management of microgrids under stochastic uncertainty

This work presents a Mixed Integer Linear Programming (MILP) approach based on a combination of a rolling horizon and stochastic programming formulation. The objective of the proposed formulation is the optimal management of the supply and demand of energy and heat in microgrids under uncertainty, in order to minimise the operational cost. Delays in the starting time of energy demands are allowed within a predefined time windows to tackle flexible demand profiles. This approach uses a scenario-based stochastic programming formulation. These scenarios consider uncertainty in the wind speed forecast, the processing time of the energy tasks and the overall heat demand, to take into account all possible scenarios related to the generation and demand of energy and heat. Nevertheless, embracing all external scenarios associated with wind speed prediction makes their consideration computationally intractable. Thus, updating input information (e.g., wind speed forecast) is required to guarantee good quality and practical solutions. Hence, the two-stage stochastic MILP formulation is introduced into a rolling horizon approach that periodically updates input information

An integrated platform for intuitive mathematical programming modeling using LaTeX

This paper presents a novel prototype platform that uses the same LaTeX mark-up language, commonly used to typeset mathematical content, as an input language for modeling optimization problems of various classes. The platform converts the LaTeX model into a formal Algebraic Modeling Language (AML) representation based on Pyomo through a parsing engine written in Python and solves by either via NEOS server or locally installed solvers, using a friendly Graphical User Interface (GUI). The distinct advantages of our approach can be summarized in (i) simplification and speed-up of the model design and development process (ii) non-commercial character (iii) cross-platform support (iv) easier typo and logic error detection in the description of the models and (v) minimization of working knowledge of programming and AMLs to perform mathematical programming modeling. Overall, this is a presentation of a complete workable scheme on using LaTeX for mathematical programming modeling which assists in furthering our ability to reproduce and replicate scientific work