Newey–West estimator

A Newey–West estimator is used in statistics and econometrics to provide an estimate of the covariance matrix of the parameters of a regression-type model where the standard assumptions of regression analysis do not apply.[1] It was devised by Whitney K. Newey and Kenneth D. West in 1987, although there are a number of later variants.[2][3][4][5] The estimator is used to try to overcome autocorrelation (also called serial correlation), and heteroskedasticity in the error terms in the models, often for regressions applied to time series data. The abbreviation "HAC," sometimes used for the estimator, stands for "heteroskedasticity and autocorrelation consistent."[2] There are a number of HAC estimators described in,[6] and HAC estimator does not refer uniquely to Newey–West. One version of Newey–West Bartlett requires the user to specify the bandwidth and usage of the Bartlett kernel from Kernel density estimation[6]

Regression models estimated with time series data often exhibit autocorrelation; that is, the error terms are correlated over time. The heteroscedastic consistent estimator of the error covariance is constructed from a term ${\displaystyle X^{\operatorname {T} }\Sigma X}$, where ${\displaystyle X}$ is the design matrix for the regression problem and ${\displaystyle \Sigma }$ is the covariance matrix of the residuals. The least squares estimator ${\displaystyle b}$ is a consistent estimator of ${\displaystyle \beta }$. This implies that the least squares residuals ${\displaystyle e_{i}}$ are "point-wise" consistent estimators of their population counterparts ${\displaystyle E_{i}}$. The general approach, then, will be to use ${\displaystyle X}$ and ${\displaystyle e}$ to devise an estimator of ${\displaystyle X^{\operatorname {T} }\Sigma X}$.[7] This means that as the time between error terms increases, the correlation between the error terms decreases. The estimator thus can be used to improve the ordinary least squares (OLS) regression when the residuals are heteroscedastic and/or autocorrelated.

${\displaystyle X^{\operatorname {T} }\Sigma X={\frac {1}{T}}\sum _{t=1}^{T}e_{t}^{2}x_{t}x_{t}^{\operatorname {T} }+{\frac {1}{T}}\sum _{\ell =1}^{L}\sum _{t=\ell +1}^{T}w_{\ell }e_{t}e_{t-\ell }(x_{t}x_{t-\ell }^{\operatorname {T} }+x_{t-\ell }x_{t}^{\operatorname {T} })}$

${\displaystyle w_{\ell }=1-{\frac {\ell }{L+1}}}$

where T is the sample size, ${\displaystyle e_{t}}$ is the ${\displaystyle t^{\text{th}}}$ residual and ${\displaystyle x_{t}}$ is the ${\displaystyle t^{\text{th}}}$ row of the design matrix, and ${\displaystyle w_{\ell }}$ is the Bartlett kernel [8] and can be thought of as a weight that decreases with increasing separation between samples. Disturbances that are farther apart from each other are given lower weight, while those with equal subscripts are given a weight of 1. This ensures that second term converges (in some appropriate sense) to a finite matrix. This weighting scheme also ensures that the resulting covariance matrix is positive semi-definite.[2] L = 0 reduces the Newey–West estimator to Huber–White standard error.[9] L specifies the "maximum lag considered for the control of autocorrelation. A common choice for L" is ${\displaystyle T^{1/4}}$.[9][10]

Software implementations

In Julia, the CovarianceMatrices.jl package [11] supports several types of heteroskedasticity and autocorrelation consistent covariance matrix estimation including Newey–West, White, and Arellano.

In R, the packages sandwich[6] and plm[12] include a function for the Newey–West estimator.

In Stata, the command newey produces Newey–West standard errors for coefficients estimated by OLS regression.[13]

In MATLAB, the command hac in the Econometrics toolbox produces the Newey–West estimator (among others).[14]

In Python, the statsmodels[15] module includes functions for the covariance matrix using Newey–West.

In Gretl, the option --robust to several estimation commands (such as ols) in the context of a time-series dataset produces Newey–West standard errors.[16]

In SAS, the Newey–West corrected standard errors can be obtained in PROC AUTOREG and PROC MODEL [17]

See also

• Heteroskedasticity-consistent standard errors

References

1. "Newey West estimator – Quantitative Finance Collector". Archived from the original on 24 June 2018. Retrieved 18 May 2009.
2. Newey, Whitney K; West, Kenneth D (1987). "A Simple, Positive Semi-definite, Heteroscedasticity and Autocorrelation Consistent Covariance Matrix" (PDF). Econometrica. 55 (3): 703–708. doi:10.2307/1913610. JSTOR 1913610.
3. Andrews, Donald W. K. (1991). "Heteroskedasticity and autocorrelation consistent covariance matrix estimation" (PDF). Econometrica. 59 (3): 817–858. doi:10.2307/2938229. JSTOR 2938229.
4. Newey, Whitney K.; West, Kenneth D. (1994). "Automatic lag selection in covariance matrix estimation" (PDF). Review of Economic Studies. 61 (4): 631–654. doi:10.2307/2297912. JSTOR 2297912.
5. Smith, Richard J. (2005). "Automatic positive semidefinite HAC covariance matrix and GMM estimation" (PDF). Econometric Theory. 21 (1): 158–170. doi:10.1017/S0266466605050103.
6. "sandwich: Robust Covariance Matrix Estimators". CRAN.
7. Greene, William H. (1997). Econometric Analysis (3rd ed.).
8. "time series – Bartlett Kernel (Newey West Covariance Matrix)". Cross Validated. Retrieved 15 September 2022.
9. "Verallgemeinerte Kleinst-Quadrate-Schätzung" [Generalized Least Squares estimation]. www.uni-kassel.de. Uni-Kassel. Retrieved 21 September 2023.
10. Greene, William H. (2012). Econometric analysis (7th ed.). Boston: Pearson. ISBN 978-0-273-75356-8. OCLC 726074601.
11. "CovarianceMatrices.jl package".
12. "plm: Linear Models for Panel Data". CRAN.
13. "Regression with Newey–West standard errors" (PDF). Stata Manual.
14. "Heteroscedasticity and autocorrelation consistent covariance estimators". Econometrics Toolbox.
15. "statsmodels: Statistics". statsmodels.
16. "Robust covariance matrix estimation" (PDF). Gretl User's Guide, chapter 22.
17. "Usage Note 40098: Newey–West correction of standard errors for heteroscedasticity and autocorrelation".

Further reading

• Bierens, Herman J. (1994). Topics in Advanced Econometrics: Estimation, Testing, and Specification of Cross-section and Time Series Models. New York: Cambridge University Press. pp. 195–198. ISBN 978-0-521-41900-0.
• Hamilton, James D. (1994). Time Series Analysis. Princeton University Press. pp. 279–285. ISBN 978-0-691-04289-3.
• Hayashi, Fumio (2000). Econometrics. Princeton: Princeton University Press. pp. 408–410. ISBN 978-0-691-01018-2.
• Stock, James H.; Watson, Mark M. (2012). Introduction to Econometrics (Third international ed.). Harlow: Pearson. pp. 637–642. ISBN 978-1-4082-6433-1.
• Zeileis, A. (2004). "Econometric Computing with HC and HAC Covariance Matrix Estimators". Journal of Statistical Software. 11 (10): 1–17. doi:10.18637/jss.v011.i10.