161 research outputs found

    Fast interior point solution of quadratic programming problems arising from PDE-constrained optimization

    Get PDF
    Interior point methods provide an attractive class of approaches for solving linear, quadratic and nonlinear programming problems, due to their excellent efficiency and wide applicability. In this paper, we consider PDE-constrained optimization problems with bound constraints on the state and control variables, and their representation on the discrete level as quadratic programming problems. To tackle complex problems and achieve high accuracy in the solution, one is required to solve matrix systems of huge scale resulting from Newton iteration, and hence fast and robust methods for these systems are required. We present preconditioned iterative techniques for solving a number of these problems using Krylov subspace methods, considering in what circumstances one may predict rapid convergence of the solvers in theory, as well as the solutions observed from practical computations

    Interior Point Methods and Preconditioning for PDE-Constrained Optimization Problems Involving Sparsity Terms

    Get PDF
    PDE-constrained optimization problems with control or state constraints are challenging from an analytical as well as numerical perspective. The combination of these constraints with a sparsity-promoting L1\rm L^1 term within the objective function requires sophisticated optimization methods. We propose the use of an Interior Point scheme applied to a smoothed reformulation of the discretized problem, and illustrate that such a scheme exhibits robust performance with respect to parameter changes. To increase the potency of this method we introduce fast and efficient preconditioners which enable us to solve problems from a number of PDE applications in low iteration numbers and CPU times, even when the parameters involved are altered dramatically

    Fast iterative solvers for PDE-constrained optimization problems

    Get PDF
    In this thesis, we develop preconditioned iterative methods for the solution of matrix systems arising from PDE-constrained optimization problems. In order to do this, we exploit saddle point theory, as this is the form of the matrix systems we wish to solve. We utilize well-known results on saddle point systems to motivate preconditioners based on effective approximations of the (1,1)-block and Schur complement of the matrices involved. These preconditioners are used in conjunction with suitable iterative solvers, which include MINRES, non-standard Conjugate Gradients, GMRES and BiCG. The solvers we use are selected based on the particular problem and preconditioning strategy employed. We consider the numerical solution of a range of PDE-constrained optimization problems, namely the distributed control, Neumann boundary control and subdomain control of Poisson's equation, convection-diffusion control, Stokes and Navier-Stokes control, the optimal control of the heat equation, and the optimal control of reaction-diffusion problems arising in chemical processes. Each of these problems has a special structure which we make use of when developing our preconditioners, and specific techniques and approximations are required for each problem. In each case, we motivate and derive our preconditioners, obtain eigenvalue bounds for the preconditioners where relevant, and demonstrate the effectiveness of our strategies through numerical experiments. The goal throughout this work is for our iterative solvers to be feasible and reliable, but also robust with respect to the parameters involved in the problems we consider

    Low-Rank Eigenvector Compression of Posterior Covariance Matrices for Linear Gaussian Inverse Problems

    Get PDF
    We consider the problem of estimating the uncertainty in statistical inverse problems using Bayesian inference. When the probability density of the noise and the prior are Gaussian, the solution of such a statistical inverse problem is also Gaussian. Therefore, the underlying solution is characterized by the mean and covariance matrix of the posterior probability density. However, the covariance matrix of the posterior probability density is full and large. Hence, the computation of such a matrix is impossible for large dimensional parameter spaces. It is shown that for many ill-posed problems, the Hessian matrix of the data misfit part has low numerical rank and it is therefore possible to perform a low-rank approach to approximate the posterior covariance matrix. For such a low-rank approximation, one needs to solve a forward partial differential equation (PDE) and the adjoint PDE in both space and time. This in turn gives O(nxnt)\mathcal{O}(n_x n_t) complexity for both, computation and storage, where nxn_x is the dimension of the spatial domain and ntn_t is the dimension of the time domain. Such computations and storage demand are infeasible for large problems. To overcome this obstacle, we develop a new approach that utilizes a recently developed low-rank in time algorithm together with the low-rank Hessian method. We reduce both the computational complexity and storage requirement from O(nxnt)\mathcal{O}(n_x n_t) to O(nx+nt)\mathcal{O}(n_x + n_t). We use numerical experiments to illustrate the advantages of our approach

    Matching Schur complement approximations for certain saddle-point systems

    Get PDF
    The solution of many practical problems described by mathematical models requires approximation methods that give rise to linear(ized) systems of equations, solving which will determine the desired approximation. This short contribution describes a particularly effective solution approach for a certain class of so-called saddle-point linear systems which arises in different contexts

    A Multigrid Method for the Efficient Numerical Solution of Optimization Problems Constrained by Partial Differential Equations

    Get PDF
    We study the minimization of a quadratic functional subject to constraints given by a linear or semilinear elliptic partial differential equation with distributed control. Further, pointwise inequality constraints on the control are accounted for. In the linear-quadratic case, the discretized optimality conditions yield a large, sparse, and indefinite system with saddle point structure. One main contribution of this thesis consists in devising a coupled multigrid solver which avoids full constraint elimination. To this end, we define a smoothing iteration incorporating elements from constraint preconditioning. A local mode analysis shows that for discrete optimality systems, we can expect smoothing rates close to those obtained with respect to the underlying constraint PDE. Our numerical experiments include problems with constraints where standard pointwise smoothing is known to fail for the underlying PDE. In particular, we consider anisotropic diffusion and convection-diffusion problems. The framework of our method allows to include line smoothers or ILU-factorizations, which are suitable for such problems. In all cases, numerical experiments show that convergence rates do not depend on the mesh size of the finest level and discrete optimality systems can be solved with a small multiple of the computational cost which is required to solve the underlying constraint PDE. Employing the full multigrid approach, the computational cost is proportional to the number of unknowns on the finest grid level. We discuss the role of the regularization parameter in the cost functional and show that the convergence rates are robust with respect to both the fine grid mesh size and the regularization parameter under a mild restriction on the next to coarsest mesh size. Incorporating spectral filtering for the reduced Hessian in the control smoothing step allows us to weaken the mesh size restriction. As a result, problems with near-vanishing regularization parameter can be treated efficiently with a negligible amount of additional computational work. For fine discretizations, robust convergence is obtained with rates which are independent of the regularization parameter, the coarsest mesh size, and the number of levels. In order to treat linear-quadratic problems with pointwise inequality constraints on the control, the multigrid approach is modified to solve subproblems generated by a primal-dual active set strategy (PDAS). Numerical experiments demonstrate the high efficiency of this approach due to mesh-independent convergence of both the outer PDAS method and the inner multigrid solver. The PDAS-multigrid method is incorporated in the sequential quadratic programming (SQP) framework. Inexact Newton techniques further enhance the computational efficiency. Globalization is implemented with a line search based on the augmented Lagrangian merit function. Numerical experiments highlight the efficiency of the resulting SQP-multigrid approach. In all cases, locally superlinear convergence of the SQP method is observed. In combination with the mesh-independent convergence rate of the inner solver, a solution method with optimal efficiency is obtained

    Preconditioned iterative methods for optimal control problems with time-dependent PDEs as constraints

    Get PDF
    In this work, we study fast and robust solvers for optimal control problems with Partial Differential Equations (PDEs) as constraints. Speci cally, we devise preconditioned iterative methods for time-dependent PDE-constrained optimization problems, usually when a higher-order discretization method in time is employed as opposed to most previous solvers. We also consider the control of stationary problems arising in uid dynamics, as well as that of unsteady Fractional Differential Equations (FDEs). The preconditioners we derive are employed within an appropriate Krylov subspace method. The fi rst key contribution of this thesis involves the study of fast and robust preconditioned iterative solution strategies for the all-at-once solution of optimal control problems with time-dependent PDEs as constraints, when a higher-order discretization method in time is employed. In fact, as opposed to most work in preconditioning this class of problems, where a ( first-order accurate) backward Euler method is used for the discretization of the time derivative, we employ a (second-order accurate) Crank-Nicolson method in time. By applying a carefully tailored invertible transformation, we symmetrize the system obtained, and then derive a preconditioner for the resulting matrix. We prove optimality of the preconditioner through bounds on the eigenvalues, and test our solver against a widely-used preconditioner for the linear system arising from a backward Euler discretization. These theoretical and numerical results demonstrate the effectiveness and robustness of our solver with respect to mesh-sizes and regularization parameter. Then, the optimal preconditioner so derived is generalized from the heat control problem to time-dependent convection{diffusion control with Crank- Nicolson discretization in time. Again, we prove optimality of the approximations of the main blocks of the preconditioner through bounds on the eigenvalues, and, through a range of numerical experiments, show the effectiveness and robustness of our approach with respect to all the parameters involved in the problem. For the next substantial contribution of this work, we focus our attention on the control of problems arising in fluid dynamics, speci fically, the Stokes and the Navier-Stokes equations. We fi rstly derive fast and effective preconditioned iterative methods for the stationary and time-dependent Stokes control problems, then generalize those methods to the case of the corresponding Navier-Stokes control problems when employing an Oseen approximation to the non-linear term. The key ingredients of the solvers are a saddle-point type approximation for the linear systems, an inner iteration for the (1,1)-block accelerated by a preconditioner for convection-diffusion control problems, and an approximation to the Schur complement based on a potent commutator argument applied to an appropriate block matrix. Through a range of numerical experiments, we show the effectiveness of our approximations, and observe their considerable parameter-robustness. The fi nal chapter of this work is devoted to the derivation of efficient and robust solvers for convex quadratic FDE-constrained optimization problems, with box constraints on the state and/or control variables. By employing an Alternating Direction Method of Multipliers for solving the non-linear problem, one can separate the equality from the inequality constraints, solving the equality constraints and then updating the current approximation of the solutions. In order to solve the equality constraints, a preconditioner based on multilevel circulant matrices is derived, and then employed within an appropriate preconditioned Krylov subspace method. Numerical results show the e ciency and scalability of the strategy, with the cost of the overall process being proportional to N log N, where N is the dimension of the problem under examination. Moreover, the strategy presented allows the storage of a highly dense system, due to the memory required being proportional to N
    corecore