Difference based Ridge and Liu type Estimators in Semiparametric Regression Models

We consider a difference based ridge regression estimator and a Liu type estimator of the regression parameters in the partial linear semiparametric regression model, y = Xβ + f + ε. Both estimators are analysed and compared in the sense of mean-squared error. We consider the case of independent errors with equal variance and give conditions under which the proposed estimators are superior to the unbiased difference based estimation technique. We extend the results to account for heteroscedasticity and autocovariance in the error terms. Finally, we illustrate the performance of these estimators with an application to the determinants of electricity consumption in Germany.Difference based estimator; Differencing estimator, Differencing matrix, Liu estimator, Liu type estimator, Multicollinearity, Ridge regression estimator, Semiparametric model

Comparison of ridge and other shrinkage estimation techniques

Includes bibliographical references.Shrinkage estimation is an increasingly popular class of biased parameter estimation techniques, vital when the columns of the matrix of independent variables X exhibit dependencies or near dependencies. These dependencies often lead to serious problems in least squares estimation: inflated variances and mean squared errors of estimates unstable coefficients, imprecision and improper estimation. Shrinkage methods allow for a little bias and at the same time introduce smaller mean squared error and variances for the biased estimators, compared to those of unbiased estimators. However, shrinkage methods are based on the shrinkage factor, of which estimation depends on the unknown values, often computed from the OLS solution. We argue that the instability of OLS estimates may have an adverse effect on performance of shrinkage estimators. Hence a new method for estimating the shrinkage factors is proposed and applied on ridge and generalized ridge regression. We propose that the new shrinkage factors should be based on the principal components instead of the unstable OLS estimates

Peter Schmidt: econometrician and consummate professional

Peter Schmidt has been one of its best-known and most respected econometricians in the profession for four decades. He has brought his talents to many scholarly outlets and societies, and has played a foundational and constructive role in the development of the field of econometrics. Peter Schmidt has also served and led the development of Econometric Reviews since its inception in 1982. His judgment has always been fair, informed, clear, decisive, and constructive. Respect for ideas and scholarship of others, young and old, is second nature to him. This is the best of traits, and Peter serves as an uncommon example to us all. The seventeen articles that make up this Econometric Reviews Special Issue in Honor of Peter Schmidt represent the work of fifty of the very best econometricians in our profession. They honor Professor Schmidt’s lifelong accomplishments by providing fundamental research work that reflects many of the broad research themes that have distinguished his long and productive career. These include time series econometrics, panel data econometrics, and stochastic frontier production analysis

Applications of Some Improved Estimators in Linear Regression

The problem of estimation of the regression coefficients under multicollinearity situation for the restricted linear model is discussed. Some improve estimators are considered, including the unrestricted ridge regression estimator (URRE), restricted ridge regression estimator (RRRE), shrinkage restricted ridge regression estimator (SRRRE), preliminary test ridge regression estimator (PTRRE), and restricted Liu estimator (RLIUE). The were compared based on the sampling variance-covariance criterion. The RRRE dominates other ridge estimators when the restriction does or does not hold. A numerical example was provided. The RRRE performed equivalently or better than the RLIUE in the sense of having smaller sampling variance

Distributed Supervised Statistical Learning

We live in the era of big data, nowadays, many companies face data of massive size that, in most cases, cannot be stored and processed on a single computer. Often such data has to be distributed over multiple computers which then makes the storage, pre-processing, and data analysis possible in practice. In the age of big data, distributed learning has gained popularity as a method to manage enormous datasets. In this thesis, we focus on distributed supervised statistical learning where sparse linear regression analysis is performed in a distributed framework. These methods are frequently applied in a variety of disciplines tackling large scale datasets analysis, including engineering, economics, and finance. In distributed learning, one key question is, for example, how to efficiently aggregate multiple estimators that are obtained based on data subsets stored on multiple computers. We investigate recent studies on distributed statistical inferences. There have been many efforts to propose efficient ways of aggregating local estimates, most popular methods are discussed in this thesis. Recently, an important question about the number of machines to deploy is addressed for several estimation methods, notable answers to the question are reviewed in this literature. We have considered a specific class of Liu-type shrinkage estimation methods for distributed statistical inference. We also conduct a Monte Carlo simulation study to assess performance of the Liu-type shrinkage estimation methods in a distributed framework

Statistical Inference for Complex Time Series Data

During recent years the focus of scientific interest has turned from low dimensional stationary time series to nonstationary time series and high dimensional time series. In addition new methodological challenges are coming from high frequency finance where data are recorded and analyzed on a millisecond basis. The three topics “nonstationarity”, “high dimensionality” and “high frequency” are on the forefront of present research in time series analysis. The topics also have some overlap in that there already exists work on the intersection of these three topics, e.g. on locally stationary diffusion models, on high dimensional covariance matrices for high frequency data, or on multivariate dynamic factor models for nonstationary processes. The aim of the workshop was to bring together researchers from time series analysis, nonparametric statistics, econometrics and empirical finance to work on these topics. This aim was successfully achieved and the workshops was very well attended