Bandwidth selection in local polynomial regression using eigenvalues

Authors: Prewitt, Kathryn; Lohr, Sharon

Source: Journal of the Royal Statistical Society: Series B (Statistical Methodology), Volume 68, Number 1, February 2006 , pp. 135-154(20)

Publisher: Wiley-Blackwell

Buy & download fulltext article:

Price: $48.00 plus tax (Refund Policy)

Abstract:

Summary.

Local polynomial regression is commonly used for estimating regression functions. In practice, however, with rough functions or sparse data, a poor choice of bandwidth can lead to unstable estimates of the function or its derivatives. We derive a new expression for the leading term of the bias by using the eigenvalues of the weighted design matrix where the bias depends on the arrangement of the X-values in the bandwidth window. We then use this result to determine a local data-driven bandwidth selection method and to provide a diagnostic for poor bandwidths that are chosen by using other methods. We show that our data-driven bandwidth is asymptotically equivalent to the optimal local bandwidth and that it performs well for relatively small samples when compared with other methods. In addition, we provide simulation results for first-derivative estimation. We illustrate its performance with data from Mars Global Surveyor.

Keywords: Adaptive bandwidth selection; Derivative estimation; LOESS estimator; Multicollinearity; Nonparametric regression; Random design; Smoothing

Document Type: Research article

DOI: http://dx.doi.org/10.1111/j.1467-9868.2005.00537.x

Affiliations: 1: Arizona State University, Tempe, USA

Publication date: 2006-02-01