The widely linear quaternion recursive total least squares

This is the author accepted manuscript. The final version is available from IEEE via http://dx.doi.org/10.1109/ICASSP.2015.7178593A widely linear quaternion recursive total least squares (WLQRTLS) algorithm is introduced for the processing of Q- improper processes contaminated by noise. The total least squares for quaternions (QTLS) is a generalisation of the real-valued total least squares and is introduced rigorously, starting from the existence condition for low-rank approximation of quaternion matrices. Then, a quaternion Rayleigh quotient (QRQ) is defined to establish the link between the QTLS solution and the minimisation of the QRQ. Finally, the rank-one update formula is employed to allow for fast iterative solution based on the QRQ. Through simulations, the WL-QRTLS was shown to exhibit superior performance, under perturbations on both input and output signals, to other adaptive filtering of the same class - the widely linear quaternion least mean squares (WL-QLMS) and the widely linear quaternion recursive least squares (WL-QRLS). The experiments on both synthetic and real-world Q-improper processes supported the analysis

Employing data fusion & diversity in the applications of adaptive signal processing

The paradigm of adaptive signal processing is a simple yet powerful method for the class of system identification problems. The classical approaches consider standard one-dimensional signals whereby the model can be formulated by flat-view matrix/vector framework. Nevertheless, the rapidly increasing availability of large-scale multisensor/multinode measurement technology has render no longer sufficient the traditional way of representing the data. To this end, the author, who from this point onward shall be referred to as `we', `us', and `our' to signify the author myself and other supporting contributors i.e. my supervisor, my colleagues and other overseas academics specializing in the specific pieces of research endeavor throughout this thesis, has applied the adaptive filtering framework to problems that employ the techniques of data diversity and fusion which includes quaternions, tensors and graphs. At the first glance, all these structures share one common important feature: invertible isomorphism. In other words, they are algebraically one-to-one related in real vector space. Furthermore, it is our continual course of research that affords a segue of all these three data types. Firstly, we proposed novel quaternion-valued adaptive algorithms named the n-moment widely linear quaternion least mean squares (WL-QLMS) and c-moment WL-LMS. Both are as fast as the recursive-least-squares method but more numerically robust thanks to the lack of matrix inversion. Secondly, the adaptive filtering method is applied to a more complex task: the online tensor dictionary learning named online multilinear dictionary learning (OMDL). The OMDL is partly inspired by the derivation of the c-moment WL-LMS due to its parsimonious formulae. In addition, the sequential higher-order compressed sensing (HO-CS) is also developed to couple with the OMDL to maximally utilize the learned dictionary for the best possible compression. Lastly, we consider graph random processes which actually are multivariate random processes with spatiotemporal (or vertex-time) relationship. Similar to tensor dictionary, one of the main challenges in graph signal processing is sparsity constraint in the graph topology, a challenging issue for online methods. We introduced a novel splitting gradient projection into this adaptive graph filtering to successfully achieve sparse topology. Extensive experiments were conducted to support the analysis of all the algorithms proposed in this thesis, as well as pointing out potentials, limitations and as-yet-unaddressed issues in these research endeavor.Open Acces

On the recursive joint position and attitude determination in multi-antenna GNSS platforms

Global Navigation Satellite Systems’ (GNSS) carrier phase observations are fundamental in the provision of precise navigation for modern applications in intelligent transport systems. Differential precise positioning requires the use of a base station nearby the vehicle location, while attitude determination requires the vehicle to be equipped with a setup of multiple GNSS antennas. In the GNSS context, positioning and attitude determination have been traditionally tackled in a separate manner, thus losing valuable correlated information, and for the latter only in batch form. The main goal of this contribution is to shed some light on the recursive joint estimation of position and attitude in multi-antenna GNSS platforms. We propose a new formulation for the joint positioning and attitude (JPA) determination using quaternion rotations. A Bayesian recursive formulation for JPA is proposed, for which we derive a Kalman filter-like solution. To support the discussion and assess the performance of the new JPA, the proposed methodology is compared to standard approaches with actual data collected from a dynamic scenario under the influence of severe multipath effects

On data-selective learning

Adaptive filters are applied in several electronic and communication devices like smartphones, advanced headphones, DSP chips, smart antenna, and teleconference systems. Also, they have application in many areas such as system identification, channel equalization, noise reduction, echo cancellation, interference cancellation, signal prediction, and stock market. Therefore, reducing the energy consumption of the adaptive filtering algorithms has great importance, particularly in green technologies and in devices using battery. In this thesis, data-selective adaptive filters, in particular the set-membership (SM) adaptive filters, are the tools to reach the goal. There are well known SM adaptive filters in literature. This work introduces new algorithms based on the classical ones in order to improve their performances and reduce the number of required arithmetic operations at the same time. Therefore, firstly, we analyze the robustness of the classical SM adaptive filtering algorithms. Secondly, we extend the SM technique to trinion and quaternion systems. Thirdly, by combining SM filtering and partialupdating, we introduce a new improved set-membership affine projection algorithm with constrained step size to improve its stability behavior. Fourthly, we propose some new least-mean-square (LMS) based and recursive least-squares based adaptive filtering algorithms with low computational complexity for sparse systems. Finally, we derive some feature LMS algorithms to exploit the hidden sparsity in the parameters.Filtros adaptativos são aplicados em diversos aparelhos eletrônicos e de comunicação, como smartphones, fone de ouvido avançados, DSP chips, antenas inteligentes e sistemas de teleconferência. Eles também têm aplicação em várias áreas como identificação de sistemas, equalização de canal, cancelamento de eco, cancelamento de interferência, previsão de sinal e mercado de ações. Desse modo, reduzir o consumo de energia de algoritmos adaptativos tem importância significativa, especialmente em tecnologias verdes e aparelhos que usam bateria. Nesta tese, filtros adaptativos com seleção de dados, em particular filtros adaptativos da família set-membership (SM), são apresentados para cumprir essa missão. No presente trabalho objetivamos apresentar novos algoritmos, baseados nos clássicos, a fim de aperfeiçoar seus desempenhos e, ao mesmo tempo, reduzir o número de operações aritméticas exigidas. Dessa forma, primeiro analisamos a robustez dos filtros adaptativos SM clássicos. Segundo, estendemos o SM aos números trinions e quaternions. Terceiro, foram utilizadas também duas famílias de algoritmos, SM filtering e partial-updating, de uma maneira elegante, visando reduzir energia ao máximo possível e obter um desempenho competitivo em termos de estabilidade. Quarto, a tese propõe novos filtros adaptativos baseado em algoritmos least-mean-square (LMS) e mínimos quadrados recursivos com complexidade computacional baixa para espaços esparsos. Finalmente, derivamos alguns algoritmos feature LMS para explorar a esparsidade escondida nos parâmetros

Adaptive filtering algorithms for quaternion-valued signals

Advances in sensor technology have made possible the recoding of three and four-dimensional signals which afford a better representation of our actual three-dimensional world than the ``flat view'' one and two-dimensional approaches. Although it is straightforward to model such signals as real-valued vectors, many applications require unambiguous modeling of orientation and rotation, where the division algebra of quaternions provides crucial advantages over real-valued vector approaches. The focus of this thesis is on the use of recent advances in quaternion-valued signal processing, such as the quaternion augmented statistics, widely-linear modeling, and the HR-calculus, in order to develop practical adaptive signal processing algorithms in the quaternion domain which deal with the notion of phase and frequency in a compact and physically meaningful way. To this end, first a real-time tracker of quaternion impropriety is developed, which allows for choosing between strictly linear and widely-linear quaternion-valued signal processing algorithms in real-time, in order to reduce computational complexity where appropriate. This is followed by the strictly linear and widely-linear quaternion least mean phase algorithms that are developed for phase-only estimation in the quaternion domain, which is accompanied by both quantitative performance assessment and physical interpretation of operations. Next, the practical application of state space modeling of three-phase power signals in smart grid management and control systems is considered, and a robust complex-valued state space model for frequency estimation in three-phase systems is presented. Its advantages over other available estimators are demonstrated both in an analytical sense and through simulations. The concept is then expanded to the quaternion setting in order to make possible the simultaneous estimation of the system frequency and its voltage phasors. Furthermore, a distributed quaternion Kalman filtering algorithm is developed for frequency estimation over power distribution networks and collaborative target tracking. Finally, statistics of stable quaternion-valued random variables, that include quaternion-valued Gaussian random variables as a special case, is investigated in order to develop a framework for the modeling and processing of heavy-tailed quaternion-valued signals.Open Acces

Dynamics of Serial Manipulators using Dual Quaternion Algebra

This paper presents two approaches to obtain the dynamical equations of serial manipulators using dual quaternion algebra. The first one is based on the recursive Newton-Euler formulation and uses twists and wrenches instead of 3D vectors, which simplifies the classic procedure by removing the necessity of exhaustive geometrical analyses since wrenches and twists are propagated through high-level algebraic operations. Furthermore, the proposed formulation works for arbitrary types of joints and does not impose any particular convention for the propagation of twists. The second approach, based on Gauss's Principle of Least Constraint (GPLC), takes into account elements of the dual quaternion algebra and provides a linear relationship between twists derivatives and joint accelerations, which can be particularly useful in robot control. Differently from other approaches based on the GPLC, which have representational singularities or require constraints, our method does not have those drawbacks. We present a thorough methodology to obtain the computational cost of both algorithms and compared them with their classic counterparts. Although our current formulations are more computationally expensive, they are more general than their counterparts in the state of the art. Simulation results showed that both methods are as accurate as the classic recursive Newton-Euler algorithm.Comment: Submitted for publication (currently under review

Latent variable regression and applications to planetary seismic instrumentation

The work presented in this thesis is framed by the concept of latent variables, a modern data analytics approach. A latent variable represents an extracted component from a dataset which is not directly measured. The concept is first applied to combat the problem of ill-posed regression through the promising method of partial least squares (PLS). In this context the latent variables within a data matrix are extracted through an iterative algorithm based on cross-covariance as an optimisation criterion. This work first extends the PLS algorithm, using adaptive and recursive techniques, for online, non-stationary data applications. The standard PLS algorithm is further generalised for complex-, quaternion- and tensor-valued data. In doing so it is shown that the multidimensional algebras facilitate physically meaningful representations, demonstrated through smart-grid frequency estimation and image-classification tasks. The second part of the thesis uses this knowledge to inform a performance analysis of the MEMS microseismometer implemented for the InSight mission to Mars. This is given in terms of the sensor's intrinsic self-noise, the estimation of which is achieved from experimental data with a colocated instrument. The standard coherence and proposed delta noise estimators are analysed with respect to practical issues. The implementation of algorithms for the alignment, calibration and post-processing of the data then enabled a definitive self-noise estimate, validated from data acquired in ultra-quiet, deep-space environment. A method for the decorrelation of the microseismometer's output from its thermal response is proposed. To do so a novel sensor fusion approach based on the Kalman filter is developed for a full-band transfer-function correction, in contrast to the traditional ill-posed frequency division method. This algorithm was applied to experimental data which determined the thermal model coefficients while validating the sensor's performance at tidal frequencies 1E-5Hz and in extreme environments at -65C. This thesis, therefore, provides a definitive view of the latent variables perspective. This is achieved through the general algorithms developed for regression with multidimensional data and the bespoke application to seismic instrumentation.Open Acces

Robust GNSS Carrier Phase-based Position and Attitude Estimation Theory and Applications

Mención Internacional en el título de doctorNavigation information is an essential element for the functioning of robotic platforms and intelligent transportation systems. Among the existing technologies, Global Navigation Satellite Systems (GNSS) have established as the cornerstone for outdoor navigation, allowing for all-weather, all-time positioning and timing at a worldwide scale. GNSS is the generic term for referring to a constellation of satellites which transmit radio signals used primarily for ranging information. Therefore, the successful operation and deployment of prospective autonomous systems is subject to our capabilities to support GNSS in the provision of robust and precise navigational estimates. GNSS signals enable two types of ranging observations: –code pseudorange, which is a measure of the time difference between the signal’s emission and reception at the satellite and receiver, respectively, scaled by the speed of light; –carrier phase pseudorange, which measures the beat of the carrier signal and the number of accumulated full carrier cycles. While code pseudoranges provides an unambiguous measure of the distance between satellites and receiver, with a dm-level precision when disregarding atmospheric delays and clock offsets, carrier phase measurements present a much higher precision, at the cost of being ambiguous by an unknown number of integer cycles, commonly denoted as ambiguities. Thus, the maximum potential of GNSS, in terms of navigational precision, can be reach by the use of carrier phase observations which, in turn, lead to complicated estimation problems. This thesis deals with the estimation theory behind the provision of carrier phase-based precise navigation for vehicles traversing scenarios with harsh signal propagation conditions. Contributions to such a broad topic are made in three directions. First, the ultimate positioning performance is addressed, by proposing lower bounds on the signal processing realized at the receiver level and for the mixed real- and integer-valued problem related to carrier phase-based positioning. Second, multi-antenna configurations are considered for the computation of a vehicle’s orientation, introducing a new model for the joint position and attitude estimation problems and proposing new deterministic and recursive estimators based on Lie Theory. Finally, the framework of robust statistics is explored to propose new solutions to code- and carrier phase-based navigation, able to deal with outlying impulsive noises.La información de navegación es un elemental fundamental para el funcionamiento de sistemas de transporte inteligentes y plataformas robóticas. Entre las tecnologías existentes, los Sistemas Globales de Navegación por Satélite (GNSS) se han consolidado como la piedra angular para la navegación en exteriores, dando acceso a localización y sincronización temporal a una escala global, irrespectivamente de la condición meteorológica. GNSS es el término genérico que define una constelación de satélites que transmiten señales de radio, usadas primordinalmente para proporcionar información de distancia. Por lo tanto, la operatibilidad y funcionamiento de los futuros sistemas autónomos pende de nuestra capacidad para explotar GNSS y estimar soluciones de navegación robustas y precisas. Las señales GNSS permiten dos tipos de observaciones de alcance: –pseudorangos de código, que miden el tiempo transcurrido entre la emisión de las señales en los satélites y su acquisición en la tierra por parte de un receptor; –pseudorangos de fase de portadora, que miden la fase de la onda sinusoide que portan dichas señales y el número acumulado de ciclos completos. Los pseudorangos de código proporcionan una medida inequívoca de la distancia entre los satélites y el receptor, con una precisión de decímetros cuando no se tienen en cuenta los retrasos atmosféricos y los desfases del reloj. En contraposición, las observaciones de la portadora son super precisas, alcanzando el milímetro de exactidud, a expensas de ser ambiguas por un número entero y desconocido de ciclos. Por ende, el alcanzar la máxima precisión con GNSS queda condicionado al uso de las medidas de fase de la portadora, lo cual implica unos problemas de estimación de elevada complejidad. Esta tesis versa sobre la teoría de estimación relacionada con la provisión de navegación precisa basada en la fase de la portadora, especialmente para vehículos que transitan escenarios donde las señales no se propagan fácilmente, como es el caso de las ciudades. Para ello, primero se aborda la máxima efectividad del problema de localización, proponiendo cotas inferiores para el procesamiento de la señal en el receptor y para el problema de estimación mixto (es decir, cuando las incógnitas pertenecen al espacio de números reales y enteros). En segundo lugar, se consideran las configuraciones multiantena para el cálculo de la orientación de un vehículo, presentando un nuevo modelo para la estimación conjunta de posición y rumbo, y proponiendo estimadores deterministas y recursivos basados en la teoría de Lie. Por último, se explora el marco de la estadística robusta para proporcionar nuevas soluciones de navegación precisa, capaces de hacer frente a los ruidos atípicos.Programa de Doctorado en Ciencia y Tecnología Informática por la Universidad Carlos III de MadridPresidente: José Manuel Molina López.- Secretario: Giorgi Gabriele.- Vocal: Fabio Dovi