Sparseness-controlled adaptive algorithms for supervised and unsupervised system identification

In single-channel hands-free telephony, the acoustic coupling between the loudspeaker and the microphone can be strong and this generates echoes that can degrade user experience. Therefore, effective acoustic echo cancellation (AEC) is necessary to maintain a stable system and hence improve the perceived voice quality of a call. Traditionally, adaptive filters have been deployed in acoustic echo cancellers to estimate the acoustic impulse responses (AIRs) using adaptive algorithms. The performances of a range of well-known algorithms are studied in the context of both AEC and network echo cancellation (NEC). It presents insights into their tracking performances under both time-invariant and time-varying system conditions. In the context of AEC, the level of sparseness in AIRs can vary greatly in a mobile environment. When the response is strongly sparse, convergence of conventional approaches is poor. Drawing on techniques originally developed for NEC, a class of time-domain and a frequency-domain AEC algorithms are proposed that can not only work well in both sparse and dispersive circumstances, but also adapt dynamically to the level of sparseness using a new sparseness-controlled approach. As it will be shown later that the early part of the acoustic echo path is sparse while the late reverberant part of the acoustic path is dispersive, a novel approach to an adaptive filter structure that consists of two time-domain partition blocks is proposed such that different adaptive algorithms can be used for each part. By properly controlling the mixing parameter for the partitioned blocks separately, where the block lengths are controlled adaptively, the proposed partitioned block algorithm works well in both sparse and dispersive time-varying circumstances. A new insight into an analysis on the tracking performance of improved proportionate NLMS (IPNLMS) is presented by deriving the expression for the mean-square error. By employing the framework for both sparse and dispersive time-varying echo paths, this work validates the analytic results in practical simulations for AEC. The time-domain second-order statistic based blind SIMO identification algorithms, which exploit the cross relation method, are investigated and then a technique with proportionate step-size control for both sparse and dispersive system identification is also developed

Minimax Concave Penalty Regularized Adaptive System Identification

We develop a recursive least square (RLS) type algorithm with a minimax concave penalty (MCP) for adaptive identification of a sparse tap-weight vector that represents a communication channel. The proposed algorithm recursively yields its estimate of the tap-vector, from noisy streaming observations of a received signal, using expectation-maximization (EM) update. We prove the convergence of our algorithm to a local optimum and provide bounds for the steady state error. Using simulation studies of Rayleigh fading channel, Volterra system and multivariate time series model, we demonstrate that our algorithm outperforms, in the mean-squared error (MSE) sense, the standard RLS and the $\ell_1$-regularized RLS

Engine thermal management with model predictive control

The global greenhouse gas CO2 emission from the transportation sector is very significant.To reduce this gas emission, EU has set an average target of not more than 95 CO2/km for new passenger cars by the year 2020. A great reduction is still required to achieve the CO2 emission target in 2020, and many different approaches are being considered. This thesis focuses on the thermal management of the engine as an area that promise significant improvement of fuel efficiency with relatively small changes. The review of the literature shows that thermal management can improve engine efficiency through the friction reduction, improved air-fuel mixing, reduced heat loss, increased engine volumetric efficiency, suppressed knock, reduce radiator fan speed and reduction of other toxic emissions such as CO, HC and NOx. Like heat loss and friction, most emissions can be reduced in high temperature condition, but this may lead to poor volumetric efficiency and make the engine more prone to knock. The temperature trade-off study is conducted in simulation using a GT-SUITE engine model coupled with the FE in-cylinder wall structure and cooling system. The result is a map of the best operating temperature over engine speed and load. To quantify the benefit of this map, eight driving styles from the legislative and research test cycles are being compared using an immediate application of the optimal temperature, and significant improvements are found for urban style driving, while operation at higher load (motorway style driving) shows only small efficiency gains. The fuel consumption saving predicted in the urban style of driving is more than 4%. This assess the chance of following the temperature set point over a cycle, the temperature reference is analysed for all eight types of drive cycles using autocorrelation, lag plot and power spectral density. The analysis consistently shows that the highest volatility is recorded in the Artemis Urban Drive Cycle: the autocorrelation disappears after only 5.4 seconds, while the power spectral density shows a drop off around 0.09Hz. This means fast control action is required to implement the optimal temperature before it changes again. Model Predictive Control (MPC) is an optimal controller with a receding horizon, and it is well known for its ability to handle multivariable control problems for linear systems with input and state limits. The MPC controller can anticipate future events and can take control actions accordingly, especially if disturbances are known in advance. The main difficulty when applying MPC to thermal management is the non-linearity caused by changes in flow rate. Manipulating both the water pump and valve improves the control authority, but it also amplifies the nonlinearity of the system. Common linearization approaches like Jacobian Linearization around one or several operating points are tested, by found to be only moderately successful. Instead, a novel approach is pursued using feedback linearization of the plant model. This uses an algebraic transformation of the plant inputs to turn the nonlinear systems dynamics into a fully or predominantly linear system. The MPC controller can work with the linear model, while the actual control inputs are found using an inverse transformation. The Feedback Linearization MPC of the cooling system model is implemented and testing using MathWork Simulink®. The process includes the model transformation approach, model fitting, the transformation of the constraints and the tuning of the MPC controller. The simulation shows good temperature tracking performance, and this demonstrates that a MPC controller with feedback linearization is a suitable approach to thermal management. The controller strategy is then validated in a test rig replicating an actual engine cooling system. The new MPC controller is again evaluated over the eight driving cycles. The average water pump speed is reduced by 9.1% compared to the conventional cooling system, while maintaining good temperature tracking. The controller performance further improves with future disturbance anticipation by 20.5% for the temperature tracking (calculated by RMSE), 6.8% reduction of the average water pump speed, 47.3% reduction of the average valve movement and 34.0% reduction of the average radiator fan speed

Sparse Nonlinear MIMO Filtering and Identification

In this chapter system identification algorithms for sparse nonlinear multi input multi output (MIMO) systems are developed. These algorithms are potentially useful in a variety of application areas including digital transmission systems incorporating power amplifier(s) along with multiple antennas, cognitive processing, adaptive control of nonlinear multivariable systems, and multivariable biological systems. Sparsity is a key constraint imposed on the model. The presence of sparsity is often dictated by physical considerations as in wireless fading channel-estimation. In other cases it appears as a pragmatic modelling approach that seeks to cope with the curse of dimensionality, particularly acute in nonlinear systems like Volterra type series. Three dentification approaches are discussed: conventional identification based on both input and output samples, semi–blind identification placing emphasis on minimal input resources and blind identification whereby only output samples are available plus a–priori information on input characteristics. Based on this taxonomy a variety of algorithms, existing and new, are studied and evaluated by simulation

Combinations of adaptive filters

Adaptive filters are at the core of many signal processing applications, ranging from acoustic noise supression to echo cancelation [1], array beamforming [2], channel equalization [3], to more recent sensor network applications in surveillance, target localization, and tracking. A trending approach in this direction is to recur to in-network distributed processing in which individual nodes implement adaptation rules and diffuse their estimation to the network [4], [5].The work of Jerónimo Arenas-García and Luis Azpicueta-Ruiz was partially supported by the Spanish Ministry of Economy and Competitiveness (under projects TEC2011-22480 and PRI-PIBIN-2011-1266. The work of Magno M.T. Silva was partially supported by CNPq under Grant 304275/2014-0 and by FAPESP under Grant 2012/24835-1. The work of Vítor H. Nascimento was partially supported by CNPq under grant 306268/2014-0 and FAPESP under grant 2014/04256-2. The work of Ali Sayed was supported in part by NSF grants CCF-1011918 and ECCS-1407712. We are grateful to the colleagues with whom we have shared discussions and coauthorship of papers along this research line, especially Prof. Aníbal R. Figueiras-Vidal

SUPPORT VECTOR MACHINE FOR HIGH THROUGHPUT RODENT SLEEP BEHAVIOR CLASSIFICATION

This thesis examines the application of a Support Vector Machine (SVM) classifier to automatically detect sleep and quiet wake (rest) behavior in mice from pressure signals on their cage floor. Previous work employed Neural Networks (NN) and Linear Discriminant Analysis (LDA) to successfully detect sleep and wake behaviors in mice. Although the LDA was successful in distinguishing between the sleep and wake behaviors, it has several limitations, which include the need to select a threshold and difficulty separating additional behaviors with subtle differences, such as sleep and rest. The SVM has advantages in that it offers greater degrees of freedom than the LDA for working with complex data sets. In addition, the SVM has direct methods to limit overfitting for the training sets (unlike the NN method). This thesis develops an SVM classifier to characterize the linearly non separable sleep and rest behaviors using a variety of features extracted from the power spectrum, autocorrelation function, and generalized spectrum (autocorrelation of complex spectrum). A genetic algorithm (GA) optimizes the SVM parameters and determines a combination of 5 best features. Experimental results from over 9 hours of data scored by human observation indicate 75% classification accuracy for SVM compared to 68% accuracy for LDA

On Improvement of Proportionate Adaptive Algorithms for Sparse Impulse Response

高知工科大学博士(工学) 平成21年9月30日授与 (甲第168号