A Framework for Analyzing Online Cross-correlators using Price's Theorem and Piecewise-Linear Decomposition

Precise estimation of cross-correlation or similarity between two random variables lies at the heart of signal detection, hyperdimensional computing, associative memories, and neural networks. Although a vast literature exists on different methods for estimating cross-correlations, the question what is the best and simplest method to estimate cross-correlations using finite samples ? is still not clear. In this paper, we first argue that the standard empirical approach might not be the optimal method even though the estimator exhibits uniform convergence to the true cross-correlation. Instead, we show that there exists a large class of simple non-linear functions that can be used to construct cross-correlators with a higher signal-to-noise ratio (SNR). To demonstrate this, we first present a general mathematical framework using Price's Theorem that allows us to analyze cross-correlators constructed using a mixture of piece-wise linear functions. Using this framework and high-dimensional embedding, we show that some of the most promising cross-correlators are based on Huber's loss functions, margin-propagation (MP) functions, and the log-sum-exp functions.Comment: 9 figure, 13 page

Generalized discrete Fourier transform with non-linear phase : theory and design

Constant modulus transforms like discrete Fourier transform (DFT), Walsh transform, and Gold codes have been successfully used over several decades in various engineering applications, including discrete multi-tone (DMT), orthogonal frequency division multiplexing (OFDM) and code division multiple access (CDMA) communications systems. Among these popular transforms, DFT is a linear phase transform and widely used in multicarrier communications due to its performance and fast algorithms. In this thesis, a theoretical framework for Generalized DFT (GDFT) with nonlinear phase exploiting the phase space is developed. It is shown that GDFT offers sizable correlation improvements over DFT, Walsh, and Gold codes. Brute force search algorithm is employed to obtain orthogonal GDFT code sets with improved correlations. Design examples and simulation results on several channel types presented in the thesis show that the proposed GDFT codes, with better auto and cross-correlation properties than DFT, lead to better bit-error-rate performance in all multi-carrier and multi-user communications scenarios investigated. It is also highlighted how known constant modulus code families such as Walsh, Walsh-like and other codes are special solutions of the GDFT framework. In addition to theoretical framework, practical design methods with computationally efficient implementations of GDFT as enhancements to DFT are presented in the thesis. The main advantage of the proposed method is its ability to design a wide selection of constant modulus orthogonal code sets based on the desired performance metrics mimicking the engineering .specs of interest. Orthogonal Frequency Division Multiplexing (OFDM) is a leading candidate to be adopted for high speed 4G wireless communications standards due to its high spectral efficiency, strong resistance to multipath fading and ease of implementation with Fast Fourier Transform (FFT) algorithms. However, the main disadvantage of an OFDM based communications technique is of its high PAPR at the RF stage of a transmitter. PAPR dominates the power (battery) efficiency of the radio transceiver. Among the PAPR reduction methods proposed in the literature, Selected Mapping (SLM) method has been successfully used in OFDM communications. In this thesis, an SLM method employing GDFT with closed form phase functions rather than fixed DFT for PAPR reduction is introduced. The performance improvements of GDFT based SLM PAPR reduction for various OFDM communications scenarios including the WiMAX standard based system are evaluated by simulations. Moreover, an efficient implementation of GDFT based SLM method reducing computational cost of multiple transform operations is forwarded. Performance simulation results show that power efficiency of non-linear RF amplifier in an OFDM system employing proposed method significantly improved

Automatic Detection and Compression for Passive Acoustic Monitoring of the African Forest Elephant

In this work, we consider applying machine learning to the analysis and compression of audio signals in the context of monitoring elephants in sub-Saharan Africa. Earth's biodiversity is increasingly under threat by sources of anthropogenic change (e.g. resource extraction, land use change, and climate change) and surveying animal populations is critical for developing conservation strategies. However, manually monitoring tropical forests or deep oceans is intractable. For species that communicate acoustically, researchers have argued for placing audio recorders in the habitats as a cost-effective and non-invasive method, a strategy known as passive acoustic monitoring (PAM). In collaboration with conservation efforts, we construct a large labeled dataset of passive acoustic recordings of the African Forest Elephant via crowdsourcing, compromising thousands of hours of recordings in the wild. Using state-of-the-art techniques in artificial intelligence we improve upon previously proposed methods for passive acoustic monitoring for classification and segmentation. In real-time detection of elephant calls, network bandwidth quickly becomes a bottleneck and efficient ways to compress the data are needed. Most audio compression schemes are aimed at human listeners and are unsuitable for low-frequency elephant calls. To remedy this, we provide a novel end-to-end differentiable method for compression of audio signals that can be adapted to acoustic monitoring of any species and dramatically improves over naive coding strategies

Roadmap on optical rogue waves and extreme events

The pioneering paper 'Optical rogue waves' by Solli et al (2007 Nature 450 1054) started the new subfield in optics. This work launched a great deal of activity on this novel subject. As a result, the initial concept has expanded and has been enriched by new ideas. Various approaches have been suggested since then. A fresh look at the older results and new discoveries has been undertaken, stimulated by the concept of 'optical rogue waves'. Presently, there may not by a unique view on how this new scientific term should be used and developed. There is nothing surprising when the opinion of the experts diverge in any new field of research. After all, rogue waves may appear for a multiplicity of reasons and not necessarily only in optical fibers and not only in the process of supercontinuum generation. We know by now that rogue waves may be generated by lasers, appear in wide aperture cavities, in plasmas and in a variety of other optical systems. Theorists, in turn, have suggested many other situations when rogue waves may be observed. The strict definition of a rogue wave is still an open question. For example, it has been suggested that it is defined as 'an optical pulse whose amplitude or intensity is much higher than that of the surrounding pulses'. This definition (as suggested by a peer reviewer) is clear at the intuitive level and can be easily extended to the case of spatial beams although additional clarifications are still needed. An extended definition has been presented earlier by N Akhmediev and E Pelinovsky (2010 Eur. Phys. J. Spec. Top. 185 1-4). Discussions along these lines are always useful and all new approaches stimulate research and encourage discoveries of new phenomena. Despite the potentially existing disagreements, the scientific terms 'optical rogue waves' and 'extreme events' do exist. Therefore coordination of our efforts in either unifying the concept or in introducing alternative definitions must be continued. From this point of view, a number of the scientists who work in this area of research have come together to present their research in a single review article that will greatly benefit all interested parties of this research direction. Whether the authors of this 'roadmap' have similar views or different from the original concept, the potential reader of the review will enrich their knowledge by encountering most of the existing views on the subject. Previously, a special issue on optical rogue waves (2013 J. Opt. 15 060201) was successful in achieving this goal but over two years have passed and more material has been published in this quickly emerging subject. Thus, it is time for a roadmap that may stimulate and encourage further research.Peer ReviewedPostprint (author's final draft

Tracking system study

A digital computer program was generated which mathematically describes an optimal estimator-controller technique as applied to the control of antenna tracking systems used by NASA. Simulation studies utilizing this program were conducted using the IBM 360/91 computer. The basic ideas of applying optimal estimator-controller techniques to antenna tracking systems are discussed. A survey of existing tracking methods is given along with shortcomings and inherent errors. It is explained how these errors can be considerably reduced if optimal estimation and control are used. The modified programs generated in this project are described and the simulation results are summarized. The new algorithms for direct synthesis and stabilization of the systems including nonlinearities, are presented