Nonparametric Methods in Astronomy: Think, Regress, Observe -- Pick Any Three

Telescopes are much more expensive than astronomers, so it is essential to minimize required sample sizes by using the most data-efficient statistical methods possible. However, the most commonly used model-independent techniques for finding the relationship between two variables in astronomy are flawed. In the worst case they can lead without warning to subtly yet catastrophically wrong results, and even in the best case they require more data than necessary. Unfortunately, there is no single best technique for nonparametric regression. Instead, we provide a guide for how astronomers can choose the best method for their specific problem and provide a python library with both wrappers for the most useful existing algorithms and implementations of two new algorithms developed here.Comment: 19 pages, PAS

Seasonal Decomposition for Geographical Time Series using Nonparametric Regression

A time series often contains various systematic effects such as trends and seasonality. These different components can be determined and separated by decomposition methods. In this thesis, we discuss time series decomposition process using nonparametric regression. A method based on both loess and harmonic regression is suggested and an optimal model selection method is discussed. We then compare the process with seasonal-trend decomposition by loess STL (Cleveland, 1979). While STL works well when that proper parameters are used, the method we introduce is also competitive: it makes parameter choice more automatic and less complex. The decomposition process often requires that time series be evenly spaced; any missing value is therefore necessarily estimated. For time series with seasonality, it is preferable to use the seasonal information to estimate missing observations. The seasonal adjustment algorithm (McLeod et al., 1983) can be used for monthly time series. In this thesis, we examine the algorithm and revise it to cover daily data cases

Time-varying Autoregressive Modeling of Nonstationary Signals

Nonstationary signal modeling is a research topic of practical interest. In this thesis, we adopt a time-varying (TV) autoregressive (AR) model using the basis function (BF) parameter estimation method for nonstationary process identification and instantaneous frequency (IF) estimation. The current TVAR model in direct form (DF) with the blockwise least-squares and recursive weighted-least-squares BF methods perform equivalently well in signal modeling, but the large estimation error may cause temporary instabilities of the estimated model. To achieve convenient model stability monitoring and pole tracking, the TVAR model in cascade form (CF) was proposed through the parameterization in terms of TV poles (represented by second order section coefficients, Cartesian coordinates, Polar coordinates), where the time variation of each pole parameter is assumed to be the linear combination of BFs. The nonlinear system equations for the TVAR model in CF are solved iteratively using the Gauss-Newton algorithm. Using the CF, the model stability is easily controlled by constraining the estimated TV poles within the unit circle. The CF model shows similar performance trends to the DF model using the recursive BF method, and the TV pole representation in Cartesian coordinates outperforms all other representations. The individual frequency variation can be finely tracked using the CF model, when several frequency components are present in the signal. Simulations were carried on synthetic sinusoidal signals with different frequency variations for IF estimation. For the TVAR model in DF (blockwise), the basis dimension (BD) is an important factor on frequency estimation accuracy. For the TVAR model in DF (recursive) and CF (Cartesian), the influences of BD are negligible. The additive white noise in the observed signal degrades the estimation performance, and the the noise effects can be reduce by using higher model order. Experiments were carried on the real electromyography (EMG) data for frequency estimation in the analysis of muscle fatigue. The TVAR modeling methods show equivalent performance to the conventional Fourier transform method

Very low bit rate parametric audio coding

[no abstract