9,978 research outputs found
Designing structured tight frames via an alternating projection method
Tight frames, also known as general Welch-bound- equality sequences, generalize orthonormal systems. Numerous applications - including communications, coding, and sparse approximation- require finite-dimensional tight frames that possess additional structural properties. This paper proposes an alternating projection method that is versatile enough to solve a huge class of inverse eigenvalue problems (IEPs), which includes the frame design problem. To apply this method, one needs only to solve a matrix nearness problem that arises naturally from the design specifications. Therefore, it is the fast and easy to develop versions of the algorithm that target new design problems. Alternating projection will often succeed even if algebraic constructions are unavailable. To demonstrate that alternating projection is an effective tool for frame design, the paper studies some important structural properties in detail. First, it addresses the most basic design problem: constructing tight frames with prescribed vector norms. Then, it discusses equiangular tight frames, which are natural dictionaries for sparse approximation. Finally, it examines tight frames whose individual vectors have low peak-to-average-power ratio (PAR), which is a valuable property for code-division multiple-access (CDMA) applications. Numerical experiments show that the proposed algorithm succeeds in each of these three cases. The appendices investigate the convergence properties of the algorithm
Globally Optimal Energy-Efficient Power Control and Receiver Design in Wireless Networks
The characterization of the global maximum of energy efficiency (EE) problems
in wireless networks is a challenging problem due to the non-convex nature of
investigated problems in interference channels. The aim of this work is to
develop a new and general framework to achieve globally optimal solutions.
First, the hidden monotonic structure of the most common EE maximization
problems is exploited jointly with fractional programming theory to obtain
globally optimal solutions with exponential complexity in the number of network
links. To overcome this issue, we also propose a framework to compute
suboptimal power control strategies characterized by affordable complexity.
This is achieved by merging fractional programming and sequential optimization.
The proposed monotonic framework is used to shed light on the ultimate
performance of wireless networks in terms of EE and also to benchmark the
performance of the lower-complexity framework based on sequential programming.
Numerical evidence is provided to show that the sequential fractional
programming framework achieves global optimality in several practical
communication scenarios.Comment: Accepted for publication in the IEEE Transactions on Signal
Processin
Problem-driven scenario generation: an analytical approach for stochastic programs with tail risk measure
Scenario generation is the construction of a discrete random vector to
represent parameters of uncertain values in a stochastic program. Most
approaches to scenario generation are distribution-driven, that is, they
attempt to construct a random vector which captures well in a probabilistic
sense the uncertainty. On the other hand, a problem-driven approach may be able
to exploit the structure of a problem to provide a more concise representation
of the uncertainty.
In this paper we propose an analytic approach to problem-driven scenario
generation. This approach applies to stochastic programs where a tail risk
measure, such as conditional value-at-risk, is applied to a loss function.
Since tail risk measures only depend on the upper tail of a distribution,
standard methods of scenario generation, which typically spread their scenarios
evenly across the support of the random vector, struggle to adequately
represent tail risk. Our scenario generation approach works by targeting the
construction of scenarios in areas of the distribution corresponding to the
tails of the loss distributions. We provide conditions under which our approach
is consistent with sampling, and as proof-of-concept demonstrate how our
approach could be applied to two classes of problem, namely network design and
portfolio selection. Numerical tests on the portfolio selection problem
demonstrate that our approach yields better and more stable solutions compared
to standard Monte Carlo sampling
Convex optimization over intersection of simple sets: improved convergence rate guarantees via an exact penalty approach
We consider the problem of minimizing a convex function over the intersection
of finitely many simple sets which are easy to project onto. This is an
important problem arising in various domains such as machine learning. The main
difficulty lies in finding the projection of a point in the intersection of
many sets. Existing approaches yield an infeasible point with an
iteration-complexity of for nonsmooth problems with no
guarantees on the in-feasibility. By reformulating the problem through exact
penalty functions, we derive first-order algorithms which not only guarantees
that the distance to the intersection is small but also improve the complexity
to and for smooth functions. For
composite and smooth problems, this is achieved through a saddle-point
reformulation where the proximal operators required by the primal-dual
algorithms can be computed in closed form. We illustrate the benefits of our
approach on a graph transduction problem and on graph matching
Conservative Signal Processing Architectures For Asynchronous, Distributed Optimization Part II: Example Systems
This paper provides examples of various synchronous and asynchronous signal
processing systems for performing optimization, utilizing the framework and
elements developed in a preceding paper. The general strategy in that paper was
to perform a linear transformation of stationarity conditions applicable to a
class of convex and nonconvex optimization problems, resulting in algorithms
that operate on a linear superposition of the associated primal and dual
decision variables. The examples in this paper address various specific
optimization problems including the LASSO problem, minimax-optimal filter
design, the decentralized training of a support vector machine classifier, and
sparse filter design for acoustic equalization. Where appropriate, multiple
algorithms for solving the same optimization problem are presented,
illustrating the use of the underlying framework in designing a variety of
distinct classes of algorithms. The examples are accompanied by numerical
simulation and a discussion of convergence
- …