Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler

Authors: Roberts, G. O.¹; Sahu, S. K.¹

Source: Journal of the Royal Statistical Society: Series B (Statistical Methodology), Volume 59, Number 2, 1997 , pp. 291-317(27)

Publisher: Blackwell Publishing

Key:

- Free Content

- New Content

- Subscribed Content

- Free Trial Content

Abstract:

In this paper many convergence issues concerning the implementation of the Gibbs sampler are investigated. Exact computable rates of convergence for Gaussian target distributions are obtained. Different random and non-random updating strategies and blocking combinations are compared using the rates. The effect of dimensionality and correlation structure on the convergence rates are studied. Some examples are considered to demonstrate the results. For a Gaussian image analysis problem several updating strategies are described and compared. For problems in Bayesian linear models several possible parameterizations are analysed in terms of their convergence rates characterizing the optimal choice.

Keywords: Bayesian Inference; Blocking; Correlation Structure; Gaussian Distribution; Gibbs Sampler; Markov Chain Monte Carlo Method; Markov Random Field; Parameterization; Random Scan; Rates of Convergence; Stochastic Relaxation; Updating Schemes