A Riemannian low-rank method for optimization over semidefinite matrices with block-diagonal constraints

We propose a new algorithm to solve optimization problems of the form $\min f(X)$ for a smooth function $f$ under the constraints that $X$ is positive semidefinite and the diagonal blocks of $X$ are small identity matrices. Such problems often arise as the result of relaxing a rank constraint (lifting). In particular, many estimation tasks involving phases, rotations, orthonormal bases or permutations fit in this framework, and so do certain relaxations of combinatorial problems such as Max-Cut. The proposed algorithm exploits the facts that (1) such formulations admit low-rank solutions, and (2) their rank-restricted versions are smooth optimization problems on a Riemannian manifold. Combining insights from both the Riemannian and the convex geometries of the problem, we characterize when second-order critical points of the smooth problem reveal KKT points of the semidefinite problem. We compare against state of the art, mature software and find that, on certain interesting problem instances, what we call the staircase method is orders of magnitude faster, is more accurate and scales better. Code is available.Comment: 37 pages, 3 figure

Stochastic Dominance Efficiency Tests under Diversification

This paper focuses on Stochastic Dominance (SD) efficiency in a finite empirical panel data. We analytically characterize the sets of unsorted time series that dominate a given evaluated distribution by the First, Second, and Third order SD. Using these insights, we develop simple Linear Programming and 0-1 Mixed Integer Linear Programming tests of SD efficiency. The advantage to the earlier efficiency tests is that the proposed approach explicitly accounts for diversification. Allowing for diversification can both improve the power of the empirical SD tests, and enable SD based portfolio optimization. A simple numerical example illustrates the SD efficiency tests. Discussion on the application potential and the future research directions concludes.Stochastic Dominance, Protfolio Choice, Efficiency, Diversification, Mathematical Programming

Second best toll and capacity optimisation in network: solution algorithm and policy implications

This paper looks at the first and second-best jointly optimal toll and road capacity investment problems from both policy and technical oriented perspectives. On the technical side, the paper investigates the applicability of the constraint cutting algorithm for solving the second-best problem under elastic demand which is formulated as a bilevel programming problem. The approach is shown to perform well despite several problems encountered by our previous work in Shepherd and Sumalee (2004). The paper then applies the algorithm to a small sized network to investigate the policy implications of the first and second-best cases. This policy analysis demonstrates that the joint first best structure is to invest in the most direct routes while reducing capacities elsewhere. Whilst unrealistic this acts as a useful benchmark. The results also show that certain second best policies can achieve a high proportion of the first best benefits while in general generating a revenue surplus. We also show that unless costs of capacity are known to be low then second best tolls will be affected and so should be analysed in conjunction with investments in the network

Intermediate integer programming representations using value disjunctions

We introduce a general technique to create an extended formulation of a mixed-integer program. We classify the integer variables into blocks, each of which generates a finite set of vector values. The extended formulation is constructed by creating a new binary variable for each generated value. Initial experiments show that the extended formulation can have a more compact complete description than the original formulation. We prove that, using this reformulation technique, the facet description decomposes into one ``linking polyhedron'' per block and the ``aggregated polyhedron''. Each of these polyhedra can be analyzed separately. For the case of identical coefficients in a block, we provide a complete description of the linking polyhedron and a polynomial-time separation algorithm. Applied to the knapsack with a fixed number of distinct coefficients, this theorem provides a complete description in an extended space with a polynomial number of variables.Comment: 26 pages, 5 figure

A simplified MOLP algorithm: The MOLP-S procedure

Linear Programming;Algorithm;computer science