Numerical algebraic geometry approach to polynomial optimization, The

2017 Summer.Includes bibliographical references.Numerical algebraic geometry (NAG) consists of a collection of numerical algorithms, based on homotopy continuation, to approximate the solution sets of systems of polynomial equations arising from applications in science and engineering. This research focused on finding global solutions to constrained polynomial optimization problems of moderate size using NAG methods. The benefit of employing a NAG approach to nonlinear optimization problems is that every critical point of the objective function is obtained with probability-one. The NAG approach to global optimization aims to reduce computational complexity during path tracking by exploiting structure that arises from the corresponding polynomial systems. This thesis will consider applications to systems biology and life sciences where polynomials solve problems in model compatibility, model selection, and parameter estimation. Furthermore, these techniques produce mathematical models of large data sets on non-euclidean manifolds such as a disjoint union of Grassmannians. These methods will also play a role in analyzing the performance of existing local methods for solving polynomial optimization problems

Data analysis of gravitational-wave signals from spinning neutron stars. IV. An all-sky search

We develop a set of data analysis tools for a realistic all-sky search for continuous gravitational-wave signals. The methods that we present apply to data from both the resonant bar detectors that are currently in operation and the laser interferometric detectors that are in the final stages of construction and commissioning. We show that with our techniques we shall be able to perform an all-sky 2-day long coherent search of the narrow-band data from the resonant bar EXPLORER with no loss of signals with the dimensionless amplitude greater than $2.8\times10^{-23}$.Comment: REVTeX, 26 pages, 1 figure, submitted to Phys. Rev.

Dynamic non-linear system modelling using wavelet-based soft computing techniques

The enormous number of complex systems results in the necessity of high-level and cost-efficient modelling structures for the operators and system designers. Model-based approaches offer a very challenging way to integrate a priori knowledge into the procedure. Soft computing based models in particular, can successfully be applied in cases of highly nonlinear problems. A further reason for dealing with so called soft computational model based techniques is that in real-world cases, many times only partial, uncertain and/or inaccurate data is available. Wavelet-Based soft computing techniques are considered, as one of the latest trends in system identification/modelling. This thesis provides a comprehensive synopsis of the main wavelet-based approaches to model the non-linear dynamical systems in real world problems in conjunction with possible twists and novelties aiming for more accurate and less complex modelling structure. Initially, an on-line structure and parameter design has been considered in an adaptive Neuro- Fuzzy (NF) scheme. The problem of redundant membership functions and consequently fuzzy rules is circumvented by applying an adaptive structure. The growth of a special type of Fungus (Monascus ruber van Tieghem) is examined against several other approaches for further justification of the proposed methodology. By extending the line of research, two Morlet Wavelet Neural Network (WNN) structures have been introduced. Increasing the accuracy and decreasing the computational cost are both the primary targets of proposed novelties. Modifying the synoptic weights by replacing them with Linear Combination Weights (LCW) and also imposing a Hybrid Learning Algorithm (HLA) comprising of Gradient Descent (GD) and Recursive Least Square (RLS), are the tools utilised for the above challenges. These two models differ from the point of view of structure while they share the same HLA scheme. The second approach contains an additional Multiplication layer, plus its hidden layer contains several sub-WNNs for each input dimension. The practical superiority of these extensions is demonstrated by simulation and experimental results on real non-linear dynamic system; Listeria Monocytogenes survival curves in Ultra-High Temperature (UHT) whole milk, and consolidated with comprehensive comparison with other suggested schemes. At the next stage, the extended clustering-based fuzzy version of the proposed WNN schemes, is presented as the ultimate structure in this thesis. The proposed Fuzzy Wavelet Neural network (FWNN) benefitted from Gaussian Mixture Models (GMMs) clustering feature, updated by a modified Expectation-Maximization (EM) algorithm. One of the main aims of this thesis is to illustrate how the GMM-EM scheme could be used not only for detecting useful knowledge from the data by building accurate regression, but also for the identification of complex systems. The structure of FWNN is based on the basis of fuzzy rules including wavelet functions in the consequent parts of rules. In order to improve the function approximation accuracy and general capability of the FWNN system, an efficient hybrid learning approach is used to adjust the parameters of dilation, translation, weights, and membership. Extended Kalman Filter (EKF) is employed for wavelet parameters adjustment together with Weighted Least Square (WLS) which is dedicated for the Linear Combination Weights fine-tuning. The results of a real-world application of Short Time Load Forecasting (STLF) further re-enforced the plausibility of the above technique

Intelligent joint channel parameter estimation techniques for mobile wireless positioning applications

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Mobile wireless positioning has recently received great attention. For mobile wireless communication networks, an inherently suitable approach is to obtain the parameters that are used for positioning estimates from the radio signal measurements between a mobile device and one or more xed base stations. However, obtaining accurate estimates of these location-dependent channel parameters is a challenging task. The focus of this thesis is on the estimation of these channel parameters for mobile wireless positioning applications. In particular, we investigate novel estimators that jointly estimate more than one type of channel parameters. We rst perform a comprehensive critical review on the most recent and popular joint channel parameter estimation techniques. Secondly, we improve a state-of-the-art technique, namely the Space Alternating Generalised Expectation maximisation (SAGE) algorithm by employing adaptive interference cancellation to improve the estimation accuracy of weaker paths. Thirdly, a novel intelligent channel parameter estimation technique using Evolution Strategy (ES) is proposed to overcome the drawbacks of the existing iterative maximum likelihood methods. Furthermore, given that in reality it is di cult to obtain the number of multipath in advance, we propose a two tier Hierarchically Organised ES to jointly estimate the number of multipath as well as the channel parameters. Finally, we extend the proposed ES method to further estimate the Doppler shift in mobile environments. Our proposed intelligent joint channel estimation techniques are shown to exhibit excellent performance even with low Signal to Noise Ratio (SNR) channel conditions as well as robust against uncertainties in initialisations.EPSRC and Cambridge Silicon Radi

Research in the general area of non-linear dynamical systems Final report, 8 Jun. 1965 - 8 Jun. 1967

Nonlinear dynamical systems research on systems stability, invariance principles, Liapunov functions, and Volterra and functional integral equation

Multi-resolution methods for high fidelity modeling and control allocation in large-scale dynamical systems

This dissertation introduces novel methods for solving highly challenging model- ing and control problems, motivated by advanced aerospace systems. Adaptable, ro- bust and computationally effcient, multi-resolution approximation algorithms based on Radial Basis Function Network and Global-Local Orthogonal Mapping approaches are developed to address various problems associated with the design of large scale dynamical systems. The main feature of the Radial Basis Function Network approach is the unique direction dependent scaling and rotation of the radial basis function via a novel Directed Connectivity Graph approach. The learning of shaping and rota- tion parameters for the Radial Basis Functions led to a broadly useful approximation approach that leads to global approximations capable of good local approximation for many moderate dimensioned applications. However, even with these refinements, many applications with many high frequency local input/output variations and a high dimensional input space remain a challenge and motivate us to investigate an entirely new approach. The Global-Local Orthogonal Mapping method is based upon a novel averaging process that allows construction of a piecewise continuous global family of local least-squares approximations, while retaining the freedom to vary in a general way the resolution (e.g., degrees of freedom) of the local approximations. These approximation methodologies are compatible with a wide variety of disciplines such as continuous function approximation, dynamic system modeling, nonlinear sig-nal processing and time series prediction. Further, related methods are developed for the modeling of dynamical systems nominally described by nonlinear differential equations and to solve for static and dynamic response of Distributed Parameter Sys- tems in an effcient manner. Finally, a hierarchical control allocation algorithm is presented to solve the control allocation problem for highly over-actuated systems that might arise with the development of embedded systems. The control allocation algorithm makes use of the concept of distribution functions to keep in check the "curse of dimensionality". The studies in the dissertation focus on demonstrating, through analysis, simulation, and design, the applicability and feasibility of these ap- proximation algorithms to a variety of examples. The results from these studies are of direct utility in addressing the "curse of dimensionality" and frequent redundancy of neural network approximation

Statistical Modeling of High-Dimensional Nonlinear Systems: A Projection Pursuit Solution

Despite recent advances in statistics, artificial neural network theory, and machine learning, nonlinear function estimation in high-dimensional space remains a nontrivial problem. As the response surface becomes more complicated and the dimensions of the input data increase, the dreaded "curse of dimensionality" takes hold, rendering the best of function approximation methods ineffective. This thesis takes a novel approach to solving the high-dimensional function estimation problem. In this work, we propose and develop two distinct parametric projection pursuit learning networks with wide-ranging applicability. Included in this work is a discussion of the choice of basis functions used as well as a description of the optimization schemes utilized to find the parameters that enable each network to best approximate a response surface. The essence of these new modeling methodologies is to approximate functions via the superposition of a series of piecewise one-dimensional models that are fit to specific directions, called projection directions. The key to the effectiveness of each model lies in its ability to find efficient projections for reducing the dimensionality of the input space to best fit an underlying response surface. Moreover, each method is capable of effectively selecting appropriate projections from the input data in the presence of relatively high levels of noise. This is accomplished by rigorously examining the theoretical conditions for approximating each solution space and taking full advantage of the principles of optimization to construct a pair of algorithms, each capable of effectively modeling high-dimensional nonlinear response surfaces to a higher degree of accuracy than previously possible.Ph.D.Committee Chair: Sadegh, Nader; Committee Member: Liang, Steven; Committee Member: Shapiro, Alexander; Committee Member: Ume, Charles; Committee Member: Vidakovic, Bran