Skip to main content
padlock icon - secure page this page is secure

Modelling and smoothing parameter estimation with multiple quadratic penalties

Buy Article:

The full text article is temporarily unavailable.

We apologise for the inconvenience. Please try again later.

Penalized likelihood methods provide a range of practical modelling tools, including spline smoothing, generalized additive models and variants of ridge regression. Selecting the correct weights for penalties is a critical part of using these methods and in the single-penalty case the analyst has several well-founded techniques to choose from. However, many modelling problems suggest a formulation employing multiple penalties, and here general methodology is lacking. A wide family of models with multiple penalties can be fitted to data by iterative solution of the generalized ridge regression problem minimize ||W1/2 (Xp-y) ||2ρ+Σi=1m θipSip (p is a parameter vector, X a design matrix, Si a non-negative definite coefficient matrix defining the ith penalty with associated smoothing parameter θ i, W a diagonal weight matrix, y a vector of data or pseudodata and ρ an ‘overall’ smoothing parameter included for computational efficiency). This paper shows how smoothing parameter selection can be performed efficiently by applying generalized cross-validation to this problem and how this allows non-linear, generalized linear and linear models to be fitted using multiple penalties, substantially increasing the scope of penalized modelling methods. Examples of non-linear modelling, generalized additive modelling and anisotropic smoothing are given.
No References
No Citations
No Supplementary Data
No Article Media
No Metrics

Keywords: Generalized additive models; Generalized cross-validation; Generalized ridge regression; Model selection; Multiple smoothing parameters; Non-linear modelling; Penalized likelihood; Penalized regresion splines

Document Type: Research Article

Affiliations: University of St Andrews, UK

Publication date: February 1, 2000

  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more