Regression with an infinite number of observations applied to estimating the parameters of the stable distribution using the empirical characteristic function

A function of the empirical characteristic function,exists for the stable distribution, which leads to a linear regression and can be used to estimate the parameters. Two approaches are often used, one to find optimal values of t, but these points are dependent on the unknown parameters. And using a fixed number of values for t. In this work the results when all points in an interval is used, thus where least squares using an infinite number of observations,is approximated. It was found that this procedure performs good in small samples

The efficiency of the likelihood ratio to choose between a t-distribution and a normal distribution

A decision must often be made between heavy-tailed and Gaussian errors for a regression or a time series model, and the t-distribution is frequently used when it is assumed that the errors are heavy-tailed distributed. The performance of the likelihood ratio to choose between the two distributions is investigated using entropy properties and a simulation study. The proportion of times or probability that the likelihood of the correct assumption will be bigger than the likelihood of the incorrect assumption is estimated.Comment: 5 figure

Applying least absolute deviation regression to regression-type estimation of the index of a stable distribution using the characteristic function

Least absolute deviation regression is applied using a fixed number of points for all values of the index to estimate the index and scale parameter of the stable distribution using regression methods based on the empirical characteristic function. The recognized fixed number of points estimation procedure uses ten points in the interval zero to one, and least squares estimation. It is shown that using the more robust least absolute regression based on iteratively re-weighted least squares outperforms the least squares procedure with respect to bias and also mean square error in smaller samples

The performance of univariate goodness-of-fit tests for normality based on the empirical characteristic function in large samples

An empirical power comparison is made between two tests based on the empirical characteristic function and some of the best performing tests for normality. A simple normality test based on the empirical characteristic function calculated in a single point is shown to outperform the more complicated Epps-Pulley test and the frequentist tests included in the study in large samples.Comment: 5 figures, 5 table

Estimating the Tail Index by using Model Averaging

The ideas of model averaging are used to find weights in peak-over-threshold problems using a possible range of thresholds. A range of the largest observations are chosen and considered as possible thresholds, each time performing estimation. Weights based on an information criterion for each threshold are calculated. A weighted estimate of the threshold and shape parameter can be calculated

Exact expressions for the weights used in least-squares regression estimation for the log-logistic and Weibull distribution

Estimation for the log-logistic and Weibull distributions can be performed by using the equations used for probability plotting. The equations leads to highly heteroscedastic regression. Exact expressions for the variances of the residuals are derived which can be used to perform weighted regression. In large samples maximum likelihood performs best, but it is shown that in smaller samples the weighted regression outperforms maximum likelihood estimation with respect to bias and mean square error

An empirical study to check the accuracy of approximating averages of ratios using ratios of averages

For a number of researchers a number of publications for each author is simulated using the zeta distribution and then for each publication a number of citations per publication simulated. Bootstrap confidence intervals indicate that the difference between the average of ratios and the ratio of averages are not significant, and there are no significant differences in the distributions in realistic problems when using the two-sample Kolmogorov-Smirnov test to compare distributions. It was found that the log-logistic distribution which is a general form for the ratio of two correlated Pareto random variables, give a good fit to the estimated ratios.Comment: 3 tables, 3 figure

A weighted least squares procedure to approximate least absolute deviation estimation in time series with specific reference to infinite variance unit root problems

A weighted regression procedure is proposed for regression type problems where the innovations are heavy-tailed. This method approximates the least absolute regression method in large samples, and the main advantage will be if the sample is large and for problems with many independent variables. In such problems bootstrap methods must often be utilized to test hypotheses and especially in such a case this procedure has an advantage over least absolute regression. The procedure will be illustrated on first-order autoregressive problems, including the random walk. A bootstrap procedure is used to test the unit root hypothesis and good results were found

An Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions

Kurtosis is seen as a measure of the discrepancy between the observed data and a Gaussian distribution and is defined when the 4th moment is finite. In this work an empirical study is conducted to investigate the behaviour of the sample estimate of kurtosis with respect to sample size and the tail index when applied to heavy-tailed data where the 4th moment does not exist. The study will focus on samples from the symmetric stable distributions. It was found that the expected value of excess kurtosis divided by the sample size is finite for any value of the tail index and the sample estimate of kurtosis increases as a linear function of sample size and tail index. It is very sensitive to changes in the tail-index

Estimation of the shape parameter of a generalized Pareto distribution based on a transformation to Pareto distributed variables

Random variables of the generalized Pareto distribution, can be transformed to that of the Pareto distribution. Explicit expressions exist for the maximum likelihood estimators of the parameters of the Pareto distribution. The performance of the estimation of the shape parameter of generalized Pareto distributed using transformed observations, based on the probability weighted method is tested. It was found to improve the performance of the probability weighted estimator and performs good with respect to bias and MSE