A Poisson Ridge Regression Estimator

The standard statistical method for analyzing count data is the Poisson regression model, which is usually estimated using maximum likelihood (ML). The ML method is very sensitive to multicollinearity. Therefore, we present a new Poisson ridge regression estimator (PRR) as a remedy to the problem of instability of the traditional ML method. To investigate the performance of the PRR and the traditional ML approaches for estimating the parameters of the Poisson regression model, we calculate the mean squared error (MSE) using Monte Carlo simulations. The result from the simulation study shows that the PRR method outperforms the traditional ML estimator in all of the different situations evaluated in this paper.Poisson regression; maximum likelihood; ridge regression; MSE; Monte Carlo simulations; Multicollinearity

Performance of Some Ridge Parameters for Probit Regression: with Application on Swedish Job Search Data

In ridge regression the estimation of the ridge parameter is an important issue. This paper generalizes some methods for estimating the ridge parameter for probit ridge regression (PRR) model based on the work of Kibria et al. (2011). The performance of these new estimators are judged by calculating the mean square error (MSE) using Monte Carlo simulations. In the design of the experiment we chose to vary the sample size and the number of regressors. Furthermore, we generate explanatory variables that are linear combinations of other regressors, which is a common situation in economics. In an empirical application regarding Swedish job search data we also illustrate the benefits of the new method.probit regression; maximum likelihood; multicollinearity; ridge regression; MSE; job search

A New Ridge Regression Causality Test in the Presence of Multicollinearity

This paper analyzes and compares the properties of the most commonly applied versions of the Granger causality (GC) test to a new ridge regression GC test (RRGC), in the presence of multicollinearity. The investigation has been carried out using Monte Carlo simulations. A large number of models have been investigated where the number of observations, strength of collinearity, and data generating processes have been varied. For each model we have performed 10000 replications and studied seven different versions of the test. The main conclusion from our study is that the traditional OLS version of the GC test over-rejects the true null hypothesis when there are relatively high (but empirically common levels of) multicollinearity, while it is established that the new RRGC test will remedy or substantially decrease this problem.Granger causality test; multicollinearity; ridge parameters; size and power

Size and Power of the RESET Test as Applied to Systems of Equations: A Bootstrap Approach

The size and power of various generalization of the RESET test for functional misspecification are investigated, using the “Bootsrap critical values”, in systems ranging from one to ten equations. The properties of 8 versions of the test are studied using Monte Carlo methods. The results are then compared with another study of Shukur and Edgerton (2002), in which they used the asymptotic critical values instead and found that in general only one version of the tests works well regarding size properties. In our study, when applying the bootstrap critical values, we find that all the tests exhibits correct size even in large systems. The power of the test is low, however, when the number of equations grows and the correlation between the omitted variables and the RESET proxies is small

Testing The Casual Relation Between Sunspots And Temperature Using Wavelets Analysis

Investigated and tested in this article are the causal nexus between sunspots and temperature by using statistical methodology and causality tests. Because this kind of relationship cannot be properly captured in the short run (daily, monthly or yearly data), the relationship is investigated in the long run using a very low frequency Wavelets-based decomposed data such as D8 (128 - 256 months). Results indicate that during the period 1854-1989, the causality nexus between these two series is as expected of onedirectional form, i.e., from sunspots to temperature

Modified Ridge Parameters for Seemingly Unrelated Regression Model

In this paper, we modify a number of new biased estimators of seemingly unrelated regression (SUR) parameters which are developed by Alkhamisi and Shukur (2008), AS, when the explanatory variables are affected by multicollinearity. Nine ridge parameters have been modified and compared in terms of the trace mean squared error (TMSE) and (PR) criterion. The results from this extended study are the also compared with those founded by AS. A simulation study has been conducted to compare the performance of the modified ridge parameters. The results showed that under certain conditions the performance of the multivariate ridge regression estimators based on SUR ridge RMSmax is superior to other estimators in terms of TMSE and PR criterion. In large samples and when the collinearity between the explanatory variables is not high the unbiased SUR, estimator produces a smaller TMSEs.Multicollinearity; modified SUR ridge regression; Monte Carlo simulations; TMSE

The Effect Of GARCH (1,1) On The Granger Causality Test In Stable VAR Models

Using Monte Carlo methods, the properties of Granger causality test in stable VAR models are studied under the presence of different magnitudes of GARCH effects in the error terms. Analysis reveals that substantial GARCH effects influence the size properties of the Granger causality test, especially in small samples. The power functions of the test are usually slightly lower when GARCH effects are imposed among the residuals compared with the case of white noise residuals

New Liu Estimators for the Poisson Regression Model: Method and Application

A new shrinkage estimator for the Poisson model is introduced in this paper. This method is a generalization of the Liu (1993) estimator originally developed for the linear regression model and will be generalised here to be used instead of the classical maximum likelihood (ML) method in the presence of multicollinearity since the mean squared error (MSE) of ML becomes inflated in that situation. Furthermore, this paper derives the optimal value of the shrinkage parameter and based on this value some methods of how the shrinkage parameter should be estimated are suggested. Using Monte Carlo simulation where the MSE and mean absolute error (MAE) are calculated it is shown that when the Liu estimator is applied with these proposed estimators of the shrinkage parameter it always outperforms the ML. Finally, an empirical application has been considered to illustrate the usefulness of the new Liu estimators.Estimation; MSE; MAE; Multicollinearity; Poisson; Liu; Simulation

Improved Ridge Regression Estimators for Binary Choice Models: An Empirical Study

This paper suggests some new estimators of the ridge parameter for binary choice models that may be applied in the presence of a multicollinearity problem. These new ridge parameters are functions of other estimators of the ridge parameter that have shown to work well in the previous research. Using a simulation study we investigate the mean square error (MSE) properties of these new ridge parameters and compare them with the best performing estimators from the previous research. The results indicate that we may improve the MSE properties of the ridge regression estimator by applying the proposed estimators in this paper, especially when there is a high multicollinearity between the explanatory variables and when many explanatory variables are included in the regression model. The benefit of this paper is then shown by a health related data where the effect of some risk factors on the probability of receiving diabetes is investigated

On Developing Ridge Regression Parameters: A Graphical investigation

In this paper we have reviewed some existing and proposed some new estimators for estimating the ridge parameter k . All in all 19 different estimators have been studied. The investigation has been carried out using Monte Carlo simulations. A large number of different models were investigated where the variance of the random error, the number of variables included in the model, the correlations among the explanatory variables, the sample size and the unknown coefficients vectors b have been varied. For each model we have performed 2000 replications and presented the results both in term of figures and tables. Based on the simulation study, we found that increasing the number of correlated variable, the variance of the random error and increasing the correlation between the independent variables have negative effect on the MSE. When the sample size increases the MSE decreases even when the correlation between the independent variables and the variance of the random error are large. In all situations, the proposed estimators have smaller MSE than the ordinary least squared and some other existing estimators