A Branch-and-Bound Algorithm for Quadratically-Constrained Sparse Filter Design

This paper presents an exact algorithm for sparse filter design under a quadratic constraint on filter performance. The algorithm is based on branch-and-bound, a combinatorial optimization procedure that can either guarantee an optimal solution or produce a sparse solution with a bound on its deviation from optimality. To reduce the complexity of branch-and-bound, several methods are developed for bounding the optimal filter cost. Bounds based on infeasibility yield incrementally accumulating improvements with minimal computation, while two convex relaxations, referred to as linear and diagonal relaxations, are derived to provide stronger bounds. The approximation properties of the two relaxations are characterized analytically as well as numerically. Design examples involving wireless channel equalization and minimum-variance distortionless-response beamforming show that the complexity of obtaining certifiably optimal solutions can often be significantly reduced by incorporating diagonal relaxations, especially in more difficult instances. In the case of early termination due to computational constraints, diagonal relaxations strengthen the bound on the proximity of the final solution to the optimum.Texas Instruments Leadership University Consortium Progra

Sparse Filter Design Under a Quadratic Constraint: Low-Complexity Algorithms

This paper considers three problems in sparse filter design, the first involving a weighted least-squares constraint on the frequency response, the second a constraint on mean squared error in estimation, and the third a constraint on signal-to-noise ratio in detection. The three problems are unified under a single framework based on sparsity maximization under a quadratic performance constraint. Efficient and exact solutions are developed for specific cases in which the matrix in the quadratic constraint is diagonal, block-diagonal, banded, or has low condition number. For the more difficult general case, a low-complexity algorithm based on backward greedy selection is described with emphasis on its efficient implementation. Examples in wireless channel equalization and minimum-variance distortionless-response beamforming show that the backward selection algorithm yields optimally sparse designs in many instances while also highlighting the benefits of sparse design.Texas Instruments Leadership University Consortium Progra

Optimal control and robust estimation for ocean wave energy converters

This thesis deals with the optimal control of wave energy converters and some associated observer design problems. The first part of the thesis will investigate model predictive control of an ocean wave energy converter to maximize extracted power. A generic heaving converter that can have both linear dampers and active elements as a power take-off system is considered and an efficient optimal control algorithm is developed for use within a receding horizon control framework. The optimal control is also characterized analytically. A direct transcription of the optimal control problem is also considered as a general nonlinear program. A variation of the projected gradient optimization scheme is formulated and shown to be feasible and computationally inexpensive compared to a standard nonlinear program solver. Since the system model is bilinear and the cost function is not convex quadratic, the resulting optimization problem is shown not to be a quadratic program. Results are compared with other methods like optimal latching to demonstrate the improvement in absorbed power under irregular sea condition simulations. In the second part, robust estimation of the radiation forces and states inherent in the optimal control of wave energy converters is considered. Motivated by this, low order H∞ observer design for bilinear systems with input constraints is investigated and numerically tractable methods for design are developed. A bilinear Luenberger type observer is formulated and the resulting synthesis problem reformulated as that for a linear parameter varying system. A bilinear matrix inequality problem is then solved to find nominal and robust quadratically stable observers. The performance of these observers is compared with that of an extended Kalman filter. The robustness of the observers to parameter uncertainty and to variation in the radiation subsystem model order is also investigated. This thesis also explores the numerical integration of bilinear control systems with zero-order hold on the control inputs. Making use of exponential integrators, exact to high accuracy integration is proposed for such systems. New a priori bounds are derived on the computational complexity of integrating bilinear systems with a given error tolerance. Employing our new bounds on computational complexity, we propose a direct exponential integrator to solve bilinear ODEs via the solution of sparse linear systems of equations. Based on this, a novel sparse direct collocation of bilinear systems for optimal control is proposed. These integration schemes are also used within the indirect optimal control method discussed in the first part.Open Acces

Design of discrete-time filters for efficient implementation

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 325-333).The cost of implementation of discrete-time filters is often strongly dependent on the number of non-zero filter coefficients or the precision with which the coefficients are represented. This thesis addresses the design of sparse and bit-efficient filters under different constraints on filter performance in the context of frequency response approximation, signal estimation, and signal detection. The results have applications in several areas, including the equalization of communication channels, frequency-selective and frequency-shaping filtering, and minimum-variance distortionless-response beamforming. The design problems considered admit efficient and exact solutions in special cases. For the more difficult general case, two approaches are pursued. The first develops low-complexity algorithms that are shown to yield optimal or near-optimal designs in many instances, but without guarantees. The second focuses on optimal algorithms based on the branch-and-bound procedure. The complexity of branch-and-bound is reduced through the use of bounds that are good approximations to the true optimal cost. Several bounding methods are developed, many involving relaxations of the original problem. The approximation quality of the bounds is characterized and efficient computational methods are discussed. Numerical experiments show that the bounds can result in substantial reductions in computational complexity.by Dennis Wei.Ph.D