The role of the discrete-time Kalman-Yakubovitch-Popov lemma in designing statistically optimum FIR orthonormal filter banks

We introduce a new approach to design FIR energy compaction filters of arbitrary order N. The optimization of such filters is important due to their close connection to the design of an M-channel orthonormal filter bank adapted to the input signal statistics. The novel procedure finds the optimum product filter Fopt(Z)=H opt(Z)Hopt(Z^-1) corresponding to the compaction filter Hopt(z). The idea is to express F(z) as D(z)+D(z^-1) and reformulate the compaction problem in terms of the state space realization of the causal function D(z). For a fixed input power spectrum, the resulting filter Fopt(z) is guaranteed to be a global optimum due to the convexity of the new formulation. The new design method can be solved quite efficiently and with great accuracy using recently developed interior point methods and is extremely general in the sense that it works for any chosen M and any arbitrary filter length N. Finally, obtaining Hopt(z) from F opt(z) does not require an additional spectral factorization step. The minimum phase spectral factor can be obtained automatically by relating the state space realization of Dopt(z) to that of H opt(z)

On the spectral factor ambiguity of FIR energy compaction filter banks

This paper focuses on the design of signal-adapted finite-impulse response (FIR) paraunitary (PU) filter banks optimized for energy compaction (EC). The design of such filter banks has been shown in the literature to consist of the design of an optimal FIR compaction filter followed by an appropriate Karhunen-Loe/spl grave/ve transform (KLT). Despite this elegant construction, EC optimal filter banks have been shown to perform worse than common nonadapted filter banks for coding gain, contrary to intuition. Here, it is shown that this phenomenon is most likely due to the nonuniqueness of the compaction filter in terms of its spectral factors. This nonuniqueness results in a finite set of EC optimal filter banks. By choosing the spectral factor yielding the largest coding gain, it is shown that the resulting filter bank behaves more and more like the infinite-order principal components filter bank (PCFB) in terms of numerous objectives such as coding gain, multiresolution, noise reduction with zeroth-order Wiener filters in the subbands, and power minimization for discrete multitone (DMT)-type nonredundant transmultiplexers

Efficient algorithm for solving semi-infinite programming problems and their applications to nonuniform filter bank designs

An efficient algorithm for solving semi-infinite programming problems is proposed in this paper. The index set is constructed by adding only one of the most violated points in a refined set of grid points. By applying this algorithm for solving the optimum nonuniform symmetric/antisymmetric linear phase finite-impulse-response (FIR) filter bank design problems, the time required to obtain a globally optimal solution is much reduced compared with that of the previous proposed algorith

Iterative greedy algorithm for solving the FIR paraunitary approximation problem

In this paper, a method for approximating a multi-input multi-output (MIMO) transfer function by a causal finite-impulse response (FIR) paraunitary (PU) system in a weighted least-squares sense is presented. Using a complete parameterization of FIR PU systems in terms of Householder-like building blocks, an iterative algorithm is proposed that is greedy in the sense that the observed mean-squared error at each iteration is guaranteed to not increase. For certain design problems in which there is a phase-type ambiguity in the desired response, which is formally defined in the paper, a phase feedback modification is proposed in which the phase of the FIR approximant is fed back to the desired response. With this modification in effect, it is shown that the resulting iterative algorithm not only still remains greedy, but also offers a better magnitude-type fit to the desired response. Simulation results show the usefulness and versatility of the proposed algorithm with respect to the design of principal component filter bank (PCFB)-like filter banks and the FIR PU interpolation problem. Concerning the PCFB design problem, it is shown that as the McMillan degree of the FIR PU approximant increases, the resulting filter bank behaves more and more like the infinite-order PCFB, consistent with intuition. In particular, this PCFB-like behavior is shown in terms of filter response shape, multiresolution, coding gain, noise reduction with zeroth-order Wiener filtering in the subbands, and power minimization for discrete multitone (DMT)-type transmultiplexers

A state space approach to the design of globally optimal FIR energy compaction filters

We introduce a new approach for the least squared optimization of a weighted FIR filter of arbitrary order N under the constraint that its magnitude squared response be Nyquist(M). Although the new formulation is general enough to cover a wide variety of applications, the focus of the paper is on optimal energy compaction filters. The optimization of such filters has received considerable attention in the past due to the fact that they are the main building blocks in the design of principal component filter banks (PCFBs). The newly proposed method finds the optimum product filter Fopt(z)=Hopt(Z)Hopt (z^-1) corresponding to the compaction filter Hopt (z). By expressing F(z) in the form D(z)+D(z^-1), we show that the compaction problem can be completely parameterized in terms of the state-space realization of the causal function D(z). For a given input power spectrum, the resulting filter Fopt(z) is guaranteed to be a global optimum solution due to the convexity of the new formulation. The new algorithm is universal in the sense that it works for any M, arbitrary filter length N, and any given input power spectrum. Furthermore, additional linear constraints such as wavelets regularity constraints can be incorporated into the design problem. Finally, obtaining Hopt(z) from Fopt(z) does not require an additional spectral factorization step. The minimum-phase spectral factor Hmin(z) can be obtained automatically by relating the state space realization of Dopt(z) to that of H opt(z

A 2D DWT architecture suitable for the Embedded Zerotree Wavelet Algorithm

Digital Imaging has had an enormous impact on industrial applications such as the Internet and video-phone systems. However, demand for industrial applications is growing enormously. In particular, internet application users are, growing at a near exponential rate. The sharp increase in applications using digital images has caused much emphasis on the fields of image coding, storage, processing and communications. New techniques are continuously developed with the main aim of increasing efficiency. Image coding is in particular a field of great commercial interest. A digital image requires a large amount of data to be created. This large amount of data causes many problems when storing, transmitting or processing the image. Reducing the amount of data that can be used to represent an image is the main objective of image coding. Since the main objective is to reduce the amount of data that represents an image, various techniques have been developed and are continuously developed to increase efficiency. The JPEG image coding standard has enjoyed widespread acceptance, and the industry continues to explore its various implementation issues. However, recent research indicates multiresolution based image coding is a far superior alternative. A recent development in the field of image coding is the use of Embedded Zerotree Wavelet (EZW) as the technique to achieve image compression. One of The aims of this theses is to explain how this technique is superior to other current coding standards. It will be seen that an essential part orthis method of image coding is the use of multi resolution analysis, a subband system whereby the subbands arc logarithmically spaced in frequency and represent an octave band decomposition. The block structure that implements this function is termed the two dimensional Discrete Wavelet Transform (2D-DWT). The 20 DWT is achieved by several architectures and these are analysed in order to choose the best suitable architecture for the EZW coder. Finally, this architecture is implemented and verified using the Synopsys Behavioural Compiler and recommendations are made based on experimental findings

Linear Matrix Inequality Formulation of Spectral Mask Constraints With Applications to FIR Filter Design

Abstract-The design of a finite impulse response (FIR) filter often involves a spectral "mask" that the magnitude spectrum must satisfy. The mask specifies upper and lower bounds at each frequency and, hence, yields an infinite number of constraints. In current practice, spectral masks are often approximated by discretization, but in this paper, we will derive a result that allows us to precisely enforce piecewise constant and piecewise trigonometric polynomial masks in a finite and convex manner via linear matrix inequalities. While this result is theoretically satisfying in that it allows us to avoid the heuristic approximations involved in discretization techniques, it is also of practical interest because it generates competitive design algorithms (based on interior point methods) for a diverse class of FIR filtering and narrowband beamforming problems. The examples we provide include the design of standard linear and nonlinear phase FIR filters, robust "chip" waveforms for wireless communications, and narrowband beamformers for linear antenna arrays. Our main result also provides a contribution to system theory, as it is an extension of the wellknown Positive-Real and Bounded-Real Lemmas

Discrete Wavelet Transforms

The discrete wavelet transform (DWT) algorithms have a firm position in processing of signals in several areas of research and industry. As DWT provides both octave-scale frequency and spatial timing of the analyzed signal, it is constantly used to solve and treat more and more advanced problems. The present book: Discrete Wavelet Transforms: Algorithms and Applications reviews the recent progress in discrete wavelet transform algorithms and applications. The book covers a wide range of methods (e.g. lifting, shift invariance, multi-scale analysis) for constructing DWTs. The book chapters are organized into four major parts. Part I describes the progress in hardware implementations of the DWT algorithms. Applications include multitone modulation for ADSL and equalization techniques, a scalable architecture for FPGA-implementation, lifting based algorithm for VLSI implementation, comparison between DWT and FFT based OFDM and modified SPIHT codec. Part II addresses image processing algorithms such as multiresolution approach for edge detection, low bit rate image compression, low complexity implementation of CQF wavelets and compression of multi-component images. Part III focuses watermaking DWT algorithms. Finally, Part IV describes shift invariant DWTs, DC lossless property, DWT based analysis and estimation of colored noise and an application of the wavelet Galerkin method. The chapters of the present book consist of both tutorial and highly advanced material. Therefore, the book is intended to be a reference text for graduate students and researchers to obtain state-of-the-art knowledge on specific applications

Perceptual models in speech quality assessment and coding

The ever-increasing demand for good communications/toll quality speech has created a renewed interest into the perceptual impact of rate compression. Two general areas are investigated in this work, namely speech quality assessment and speech coding. In the field of speech quality assessment, a model is developed which simulates the processing stages of the peripheral auditory system. At the output of the model a "running" auditory spectrum is obtained. This represents the auditory (spectral) equivalent of any acoustic sound such as speech. Auditory spectra from coded speech segments serve as inputs to a second model. This model simulates the information centre in the brain which performs the speech quality assessment. [Continues.