Modulation Domain Image Processing

The classical Fourier transform is the cornerstone of traditional linearsignal and image processing. The discrete Fourier transform (DFT) and thefast Fourier transform (FFT) in particular led toprofound changes during the later decades of the last century in howwe analyze and process 1D and multi-dimensional signals.The Fourier transform represents a signal as an infinite superpositionof stationary sinusoids each of which has constant amplitude and constantfrequency. However, many important practical signals such as radar returnsand seismic waves are inherently nonstationary. Hence, more complextechniques such as the windowed Fourier transform and the wavelet transformwere invented to better capture nonstationary properties of these signals.In this dissertation, I studied an alternative nonstationary representationfor images, the 2D AM-FM model. In contrast to thestationary nature of the classical Fourier representation, the AM-FM modelrepresents an image as a finite sum of smoothly varying amplitudesand smoothly varying frequencies. The model has been applied successfullyin image processing applications such as image segmentation, texture analysis,and target tracking. However, these applications are limitedto \emph{analysis}, meaning that the computed AM and FM functionsare used as features for signal processing tasks such as classificationand recognition. For synthesis applications, few attempts have been madeto synthesize the original image from the AM and FM components. Nevertheless,these attempts were unstable and the synthesized results contained artifacts.The main reason is that the perfect reconstruction AM-FM image model waseither unavailable or unstable. Here, I constructed the first functionalperfect reconstruction AM-FM image transform that paves the way for AM-FMimage synthesis applications. The transform enables intuitive nonlinearimage filter designs in the modulation domain. I showed that these filtersprovide important advantages relative to traditional linear translation invariant filters.This dissertation addresses image processing operations in the nonlinearnonstationary modulation domain. In the modulation domain, an image is modeledas a sum of nonstationary amplitude modulation (AM) functions andnonstationary frequency modulation (FM) functions. I developeda theoretical framework for high fidelity signal and image modeling in themodulation domain, constructed an invertible multi-dimensional AM-FMtransform (xAMFM), and investigated practical signal processing applicationsof the transform. After developing the xAMFM, I investigated new imageprocessing operations that apply directly to the transformed AM and FMfunctions in the modulation domain. In addition, I introduced twoclasses of modulation domain image filters. These filters produceperceptually motivated signal processing results that are difficult orimpossible to obtain with traditional linear processing or spatial domainnonlinear approaches. Finally, I proposed three extensions of the AM-FMtransform and applied them in image analysis applications.The main original contributions of this dissertation include the following.- I proposed a perfect reconstruction FM algorithm. I used aleast-squares approach to recover the phase signal from itsgradient. In order to allow perfect reconstruction of the phase function, Ienforced an initial condition on the reconstructed phase. The perfectreconstruction FM algorithm plays a critical role in theoverall AM-FM transform.- I constructed a perfect reconstruction multi-dimensional filterbankby modifying the classical steerable pyramid. This modified filterbankensures a true multi-scale multi-orientation signal decomposition. Such adecomposition is required for a perceptually meaningful AM-FM imagerepresentation.- I rotated the partial Hilbert transform to alleviate ripplingartifacts in the computed AM and FM functions. This adjustment results inartifact free filtering results in the modulation domain.- I proposed the modulation domain image filtering framework. Iconstructed two classes of modulation domain filters. I showed that themodulation domain filters outperform traditional linear shiftinvariant (LSI) filters qualitatively and quantitatively in applicationssuch as selective orientation filtering, selective frequency filtering,and fundamental geometric image transformations.- I provided extensions of the AM-FM transform for image decompositionproblems. I illustrated that the AM-FM approach can successfullydecompose an image into coherent components such as textureand structural components.- I investigated the relationship between the two prominentAM-FM computational models, namely the partial Hilbert transformapproach (pHT) and the monogenic signal. The established relationshiphelps unify these two AM-FM algorithms.This dissertation lays a theoretical foundation for future nonlinearmodulation domain image processing applications. For the first time, onecan apply modulation domain filters to images to obtain predictableresults. The design of modulation domain filters is intuitive and simple,yet these filters produce superior results compared to those of pixeldomain LSI filters. Moreover, this dissertation opens up other research problems.For instance, classical image applications such as image segmentation andedge detection can be re-formulated in the modulation domain setting.Modulation domain based perceptual image and video quality assessment andimage compression are important future application areas for the fundamentalrepresentation results developed in this dissertation

An FPGA architecture design of a high performance adaptive notch filter

The occurrence of narrowband interference near frequencies carrying information is a common problem in modern control and signal processing applications. A very narrow notch filter is required in order to remove the unwanted signal while not compromising the integrity of the carrier signal. In many practical situations, the interference may wander within a frequency band, in which case a wider notch filter would be needed to guarantee its removal, which may also allow for the degradation of information being carried in nearby frequencies. If the interference frequency could be autonomously tracked, a narrow bandwidth notch filter could be successfully implemented for the particular frequency. Adaptive signal processing is a powerful technique that can be used in the tracking and elimination of such a signal. An application where an adaptive notch filter becomes necessary is in biomedical instrumentation, such as the electrocardiogram recorder. The recordings can become useless when in the presence of electromagnetic fields generated by power lines. Research was conducted to fully characterize the interference. Research on notch filter structures and adaptive filter algorithms has been carried out. The lattice form filter structure was chosen for its inherent stability and performance benefits. A new adaptive filter algorithm was developed targeting a hardware implementation. The algorithm used techniques from several other algorithms that were found to be beneficial. This work developed the hardware implementation of a lattice form adaptive notch filter to be used for the removal of power line interference from electrocardiogram signals. The various design tradeo s encountered were documented. The final design was targeted toward multiple field programmable gate arrays using multiple optimization efforts. Those results were then compared. The adaptive notch filter was able to successfully track and remove the interfering signal. The lattice form structure utilized by the proposed filter was verified to exhibit an inherently stable realization. The filter was subjected to various environments that modeled the different power line disturbances that could be present. The final filter design resulted in a 3 dB bandwidth of 15.8908 Hz, and a null depth of 54 dB. For the baseline test case, the algorithm achieved convergence after 270 iterations. The final hardware implementation was successfully verified against the MATLAB simulation results. A speedup of 3.8 was seen between the Xilinx Virtex-5 and Spartan-II device technologies. The final design used a small fraction of the available resources for each of the two devices that were characterized. This would allow the component to be more readily available to be added to existing projects, or further optimized by utilizing additional logic

Behavior of the Partial Correlation Coefficients of a Least Squares Lattice Filter in the presence of a Nonstationary Chirp Input

This paper studies the performance of the aposteriori recursive least squares lattice filter in the presence of a nonstationary chirp signal. The forward and backward partial correlation (PARCOR) coefficients for a Wiener-Hopf optimal filter are shown to be complex conjugates for the general case of a nonstationary input with constant power. Such an optimal filter is compared to a minimum mean square error based least squares lattice adaptive filter. Expressions are found for the behavior of the first stage of the adaptive filter based on the least squares algorithm. For the general n th stage, the PARCOR coefficients of the previous stages are assumed to have attained Wiener-Hopf optimal steady state. The PARCOR coefficients of such a least squares adaptive filter are compared with the optimal coefficients for such a nonstationary input. The optimal lattice filter is seen to track a chirp input without any error, and the tracking lag in such an adaptive filter is due to the least sq..

States and sequences of paired subspace ideals and their relationship to patterned brain function

It is found here that the state of a network of coupled ordinary differential equations is partially localizable through a pair of contractive ideal subspaces, chosen from dual complete lattices related to the synchrony and synchronization of cells within the network. The first lattice is comprised of polydiagonal subspaces, corresponding to synchronous activity patterns that arise from functional equivalences of cell receptive fields. This lattice is dual to a transdiagonal subspace lattice ordering subspaces transverse to these network-compatible synchronies. Combinatorial consideration of contracting polydiagonal and transdiagonal subspace pairs yields a rich array of dynamical possibilities for structured networks. After proving that contraction commutes with the lattice ordering, it is shown that subpopulations of cells are left at fixed potentials when pairs of contracting subspaces span the cells' local coordinates - a phenomenon named glyph formation here. Treatment of mappings between paired states then leads to a theory of network-compatible sequence generation. The theory's utility is illustrated with examples ranging from the construction of a minimal circuit for encoding a simple phoneme to a model of the primary visual cortex including high-dimensional environmental inputs, laminar speficicity, spiking discontinuities, and time delays. In this model, glyph formation and dissolution provide one account for an unexplained anomaly in electroencephalographic recordings under periodic flicker, where stimulus frequencies differing by as little as 1 Hz generate responses varying by an order of magnitude in alpha-band spectral power. Further links between coupled-cell systems and neural dynamics are drawn through a review of synchronization in the brain and its relationship to aggregate observables, focusing again on electroencephalography. Given previous theoretical work relating the geometry of visual hallucinations to symmetries in visual cortex, periodic perturbation of the visual system along a putative symmetry axis is hypothesized to lead to a greater concentration of harmonic spectral energy than asymmetric perturbations; preliminary experimental evidence affirms this hypothesis. To conclude, connections drawn between dynamics, sensation, and behavior are distilled to seven hypotheses, and the potential medical uses of the theory are illustrated with a lattice depiction of ketamine xylazine anaesthesia and a reinterpretation of hemifield neglect

Modeling spatial and temporal textures

Thesis (Ph. D.)--Massachusetts Institute of Technology, Program in Media Arts & Sciences, 1997.Includes bibliographical references (leaves 155-161).by Fang Liu.Ph.D

Unconditionally convergent time domain adaptive and time-frequency techniques for epicyclic gearbox vibration

Condition monitoring of epicyclic gearboxes through vibration signature analysis, with particular focus on time domain methods and the use of adaptive filtering techniques for the purpose of signal enhancement, is the central theme of this work. Time domain filtering methods for the purpose of removal of random noise components from periodic, but not necessarily stationary or cyclostationary, signals are developed. Damage identification is accomplished through vibration signature analysis by nonstationary timefrequency methods, belonging to Cohen’s general class of time-frequency distributions, strictly based in the time domain. Although a powerful and commonly used noise reduction technique, synchronous averaging requires alternate sensors in addition to the vibration pickup. For this reason the use of time domain techniques that employ only the vibration data is investigated. Adaptive filters may be used to remove random noise from the nonstationary signals considered. The well-known Least Mean Squares algorithm is employed in an adaptive line enhancer configuration. To counter the much discussed convergence difficulties that are often experienced when the least mean squares algorithm is applied, a new unconditionally convergent algorithm based on the spherical quadratic steepest descent method is presented. The spherical quadratic steepest descent method has been shown to be unconditionally convergent when applied to a quadratic objective function. Time-frequency methods are succinctly employed to analyse the vibration signals simultaneously in the time and frequency domains. Transients covering a wide frequency range are a clear and definite indication of impacting events as gear teeth mate, and observation of such events on a timefrequency distribution are used to indicate damage to the transmission. The pseudo Wigner-Ville distribution and the Spectrogram, both belonging to Cohen’s general class of time-frequency distributions are comparatively used to the end of damage identification. It is shown that an unconditionally convergent adaptive filtering technique used in conjunction with time-frequency methods can indicate a damaged condition in an epicyclic gearbox, where the non-adaptively filtered data did not present clear indications of damage.Dissertation (MEng (Mechanical Engineering))--University of Pretoria, 2007.Mechanical and Aeronautical EngineeringMEngMEngunrestricte