Orthonormal and biorthonormal filter banks as convolvers, and convolutional coding gain

Convolution theorems for filter bank transformers are introduced. Both uniform and nonuniform decimation ratios are considered, and orthonormal as well as biorthonormal cases are addressed. All the theorems are such that the original convolution reduces to a sum of shorter, decoupled convolutions in the subbands. That is, there is no need to have cross convolution between subbands. For the orthonormal case, expressions for optimal bit allocation and the optimized coding gain are derived. The contribution to coding gain comes partly from the nonuniformity of the signal spectrum and partly from nonuniformity of the filter spectrum. With one of the convolved sequences taken to be the unit pulse function,,e coding gain expressions reduce to those for traditional subband and transform coding. The filter-bank convolver has about the same computational complexity as a traditional convolver, if the analysis bank has small complexity compared to the convolution itself

Cyclic LTI systems in digital signal processing

Cyclic signal processing refers to situations where all the time indices are interpreted modulo some integer L. In such cases, the frequency domain is defined as a uniform discrete grid (as in L-point DFT). This offers more freedom in theoretical as well as design aspects. While circular convolution has been the centerpiece of many algorithms in signal processing for decades, such freedom, especially from the viewpoint of linear system theory, has not been studied in the past. In this paper, we introduce the fundamentals of cyclic multirate systems and filter banks, presenting several important differences between the cyclic and noncyclic cases. Cyclic systems with allpass and paraunitary properties are studied. The paraunitary interpolation problem is introduced, and it is shown that the interpolation does not always succeed. State-space descriptions of cyclic LTI systems are introduced, and the notions of reachability and observability of state equations are revisited. It is shown that unlike in traditional linear systems, these two notions are not related to the system minimality in a simple way. Throughout the paper, a number of open problems are pointed out from the perspective of the signal processor as well as the system theorist

Orthogonal Wavelets via Filter Banks: Theory and Applications

Wavelets are used in many applications, including image processing, signal analysis and seismology. The critical problem is the representation of a signal using a small number of computable functions, such that it is represented in a concise and computationally efficient form. It is shown that wavelets are closely related to filter banks (sub band filtering) and that there is a direct analogy between multiresolution analysis in continuous time and a filter bank in discrete time. This provides a clear physical interpretation of the approximation and detail spaces of multiresolution analysis in terms of the frequency bands of a signal. Only orthogonal wavelets, which are derived from orthogonal filter banks, are discussed. Several examples and applications are considered

Theory of optimal orthonormal subband coders

The theory of the orthogonal transform coder and methods for its optimal design have been known for a long time. We derive a set of necessary and sufficient conditions for the coding-gain optimality of an orthonormal subband coder for given input statistics. We also show how these conditions can be satisfied by the construction of a sequence of optimal compaction filters one at a time. Several theoretical properties of optimal compaction filters and optimal subband coders are then derived, especially pertaining to behavior as the number of subbands increases. Significant theoretical differences between optimum subband coders, transform coders, and predictive coders are summarized. Finally, conditions are presented under which optimal orthonormal subband coders yield as much coding gain as biorthogonal ones for a fixed number of subbands

Symmetric extension methods for M-channel linear-phase perfect-reconstruction filter banks

The symmetric extension method has recently been shown to be an efficient way for subband processing of finite-length sequences. This paper presents an extension of this method to general linear-phase perfect-reconstruction filter banks. We derive constraints on the length and symmetry polarity of the permissible filter banks and propose a new design algorithm. In the algorithm, different symmetric sequences are formulated in a unified form based on the circular-symmetry framework. The length constraints in symmetrically extending the input sequence and windowing the subband sequences are investigated. The effect of shifting the input sequence is included. When the algorithm is applied to equal-length filter banks, we explicitly show that symmetric extension methods can always be constructed to replace the circular convolution approach.published_or_final_versio

Oversampling PCM techniques and optimum noise shapers for quantizing a class of nonbandlimited signals

We consider the efficient quantization of a class of nonbandlimited signals, namely, the class of discrete-time signals that can be recovered from their decimated version. The signals are modeled as the output of a single FIR interpolation filter (single band model) or, more generally, as the sum of the outputs of L FIR interpolation filters (multiband model). These nonbandlimited signals are oversampled, and it is therefore reasonable to expect that we can reap the same benefits of well-known efficient A/D techniques that apply only to bandlimited signals. We first show that we can obtain a great reduction in the quantization noise variance due to the oversampled nature of the signals. We can achieve a substantial decrease in bit rate by appropriately decimating the signals and then quantizing them. To further increase the effective quantizer resolution, noise shaping is introduced by optimizing prefilters and postfilters around the quantizer. We start with a scalar time-invariant quantizer and study two important cases of linear time invariant (LTI) filters, namely, the case where the postfilter is the inverse of the prefilter and the more general case where the postfilter is independent from the prefilter. Closed form expressions for the optimum filters and average minimum mean square error are derived in each case for both the single band and multiband models. The class of noise shaping filters and quantizers is then enlarged to include linear periodically time varying (LPTV)M filters and periodically time-varying quantizers of period M. We study two special cases in great detail

Lattice structures for optimal design and robust implementation of two-channel perfect-reconstruction QMF banks

A lattice structure and an algorithm are presented for the design of two-channel QMF (quadrature mirror filter) banks, satisfying a sufficient condition for perfect reconstruction. The structure inherently has the perfect-reconstruction property, while the algorithm ensures a good stopband attenuation for each of the analysis filters. Implementations of such lattice structures are robust in the sense that the perfect-reconstruction property is preserved in spite of coefficient quantization. The lattice structure has the hierarchical property that a higher order perfect-reconstruction QMF bank can be obtained from a lower order perfect-reconstruction QMF bank, simply by adding more lattice sections. Several numerical examples are provided in the form of design tables

On H^∞ optimal signal reconstruction in noisy filter banks

We study the design of synthesis filters in noisy filter bank systems using an H^∞ point of view. For unitary analysis polyphase matrices we obtain an explicit expression for the minimum achievable disturbance attenuation. Numerical examples and comparisons with existing methods are also included