Algebraic Signal Processing Theory: Cooley-Tukey Type Algorithms for Polynomial Transforms Based on Induction

A polynomial transform is the multiplication of an input vector x\in\C^n by a matrix \PT_{b,\alpha}\in\C^{n\times n}, whose $(k,\ell)$-th element is defined as $p_\ell(\alpha_k)$ for polynomials p_\ell(x)\in\C[x] from a list $b=\{p_0(x),\dots,p_{n-1}(x)\}$ and sample points \alpha_k\in\C from a list $\alpha=\{\alpha_0,\dots,\alpha_{n-1}\}$. Such transforms find applications in the areas of signal processing, data compression, and function interpolation. Important examples include the discrete Fourier and cosine transforms. In this paper we introduce a novel technique to derive fast algorithms for polynomial transforms. The technique uses the relationship between polynomial transforms and the representation theory of polynomial algebras. Specifically, we derive algorithms by decomposing the regular modules of these algebras as a stepwise induction. As an application, we derive novel $O(n\log{n})$ general-radix algorithms for the discrete Fourier transform and the discrete cosine transform of type 4.Comment: 19 pages. Submitted to SIAM Journal on Matrix Analysis and Application

On algebras related to the discrete cosine transform

AbstractAn algebraic theory for the discrete cosine transform (DCT) is developed, which is analogous to the well-known theory of the discrete Fourier transform (DFT). Whereas the latter diagonalizes a convolution algebra, which is a polynomial algebra modulo a product of various cyclotomic polynomials, the former diagonalizes a polynomial algebra modulo a product of various polynomials related to the Chebyshev types. When the dimension of the algebra is a power of 2, the DCT diagonalizes a polynomial algebra modulo a product of Chebyshev polynomials of the first type. In both DFT and DCT cases, the Chinese remainder theorem plays a key role in the design of fast algorithms

Algebraic Signal Processing Theory: Cooley-Tukey Type Algorithms for DCTs and DSTs

This paper presents a systematic methodology based on the algebraic theory of signal processing to classify and derive fast algorithms for linear transforms. Instead of manipulating the entries of transform matrices, our approach derives the algorithms by stepwise decomposition of the associated signal models, or polynomial algebras. This decomposition is based on two generic methods or algebraic principles that generalize the well-known Cooley-Tukey FFT and make the algorithms' derivations concise and transparent. Application to the 16 discrete cosine and sine transforms yields a large class of fast algorithms, many of which have not been found before.Comment: 31 pages, more information at http://www.ece.cmu.edu/~smar

Symmetry-based matrix factorization

AbstractWe present a method for factoring a given matrix M into a short product of sparse matrices, provided that M has a suitable “symmetry”. This sparse factorization represents a fast algorithm for the matrix–vector multiplication with M. The factorization method consists of two essential steps. First, a combinatorial search is used to compute a suitable symmetry of M in the form of a pair of group representations. Second, the group representations are decomposed stepwise, which yields factorized decomposition matrices and determines a sparse factorization of M. The focus of this article is the first step, finding the symmetries. All algorithms described have been implemented in the library AREP. We present examples for automatically generated sparse factorizations—and hence fast algorithms—for a class of matrices corresponding to digital signal processing transforms including the discrete Fourier, cosine, Hartley, and Haar transforms

Finding central decompositions of p-groups

Polynomial-time algorithms are given to find a central decomposition of maximum size for a finite p-group of class 2 and for a nilpotent Lie ring of class 2. The algorithms use Las Vegas probabilistic routines to compute the structure of finite *-rings and also the Las Vegas C-MeatAxe. When p is small, the probabilistic methods can be replaced by deterministic polynomial-time algorithms. The methods introduce new group isomorphism invariants including new characteristic subgroups.Comment: 28 page

Qualitative Reasoning about Relative Directions : Computational Complexity and Practical Algorithm

Qualitative spatial reasoning (QSR) enables cognitive agents to reason about space using abstract symbols. Among several aspects of space (e.g., topology, direction, distance) directional information is useful for agents navigating in space. Observers typically describe their environment by specifying the relative directions in which they see other objects or other people from their point of view. As such, qualitative reasoning about relative directions, i.e., determining whether a given statement involving relative directions is true, can be advantageously used for applications, for example, robot navigation, computer-aided design and geographical information systems. Unfortunately, despite the apparent importance of reasoning about relative directions, QSR-research so far could not provide efficient decision procedures for qualitative reasoning about relative directions. Accordingly, the question about how to devise an efficient decision procedure for qualitative reasoning about relative directions has meanwhile turned to the question about whether an efficient decision procedure exists at all. Answering the latter existential question, which requires a formal analysis of relative directions from a computational complexity point of view, has remained an open problem in the field of QSR. The present thesis solves the open problem by proving that there is no efficient decision procedure for qualitative reasoning about relative directions, even if only left or right relations are involved. This is surprising as it contradicts the early premise of QSR believed by many researchers in and outside the field, that is, abstracting from an infinite domain to a finite set of relations naturally leads to efficient reasoning. As a consequence of this rather negative result, efficient reasoning with any of the well-known relative direction calculi (OPRAm, DCC, DRA, LR) is impossible. Indeed, the present thesis shows that all the relative direction calculi belong to one and the same class of ∃R-complete problems, which are the problems that can be reduced to the NP-hard decision problem of the existential theory of the reals, and vice versa. Nevertheless, in practice, many interesting computationally hard AI problems can be tackled by means of approximative algorithms and heuristics. In the same vein, the present thesis shows that qualitative reasoning about relative directions can also be tackled with approximative algorithms. In the thesis we develop the qualitative calculus SVm which allows for a practical algorithm for qualitative reasoning about relative directions. SVm also provides an effective semi-decision procedure for the OPRAm calculus, the most versatile one among the relative direction calculi. In this thesis we substantiate the usefulness of SVm by applying it in the marine navigation domain

A Qualitative Representation of Spatial Scenes in R2 with Regions and Lines

Regions and lines are common geographic abstractions for geographic objects. Collections of regions, lines, and other representations of spatial objects form a spatial scene, along with their relations. For instance, the states of Maine and New Hampshire can be represented by a pair of regions and related based on their topological properties. These two states are adjacent (i.e., they meet along their shared boundary), whereas Maine and Florida are not adjacent (i.e., they are disjoint). A detailed model for qualitatively describing spatial scenes should capture the essential properties of a configuration such that a description of the represented objects and their relations can be generated. Such a description should then be able to reproduce a scene in a way that preserves all topological relationships, but without regards to metric details. Coarse approaches to qualitative spatial reasoning may underspecify certain relations. For example, if two objects meet, it is unclear if they meet along an edge, at a single point, or multiple times along their boundaries. Where the boundaries of spatial objects converge, this is called a spatial intersection. This thesis develops a model for spatial scene descriptions primarily through sequences of detailed spatial intersections and object containment, capturing how complex spatial objects relate. With a theory of complex spatial scenes developed, a tool that will automatically generate a formal description of a spatial scene is prototyped, enabling the described objects to be analyzed. The strengths and weaknesses of the provided model will be discussed relative to other models of spatial scene description, along with further refinements

Relation algebras and their application in temporal and spatial reasoning

Abstract Qualitative temporal and spatial reasoning is in many cases based on binary relations such as before, after, starts, contains, contact, part of, and others derived from these by relational operators. The calculus of relation algebras is an equational formalism; it tells us which relations must exist, given several basic operations, such as Boolean operations on relations, relational composition and converse. Each equation in the calculus corresponds to a theorem, and, for a situation where there are only nitely many relations, one can construct a composition table which can serve as a look up table for the relations involved. Since the calculus handles relations, no knowledge about the concrete geometrical objects is necessary. In this sense, relational calculus is pointless. Relation algebras were introduced into temporal reasoning by Allen [1] and into spatial reasoning by Egenhofer and Sharm