An overview on the shrinkage properties of partial least squares regression

Author: Krämer, Nicole

Source: Computational Statistics, Volume 22, Number 2, July 2007 , pp. 249-273(25)

Publisher: Springer

Buy & download fulltext article:

Price: $47.00 plus tax (Refund Policy)

Abstract:

The aim of this paper is twofold. In the first part, we recapitulate the main results regarding the shrinkage properties of partial least squares (PLS) regression. In particular, we give an alternative proof of the shape of the PLS shrinkage factors. It is well known that some of the factors are >1. We discuss in detail the effect of shrinkage factors for the mean squared error of linear estimators and argue that we cannot extend the results to PLS directly, as it is nonlinear. In the second part, we investigate the effect of shrinkage factors empirically. In particular, we point out that experiments on simulated and real world data show that bounding the absolute value of the PLS shrinkage factors by 1 seems to leads to a lower mean squared error.

Keywords: Linear regression; Biased estimators; Mean squared error

Document Type: Research article

DOI: http://dx.doi.org/10.1007/s00180-007-0038-z

Affiliations: 1: Email: nkraemer@cs.tu-berlin.de

Publication date: 2007-07-01