Using parallel computation to improve Independent Metropolis-Hastings based estimation
Smith, Murray H.; Robert, Christian P.; Jacob, Pierre E. (2011), Using parallel computation to improve Independent Metropolis-Hastings based estimation, Journal of Computational and Graphical Statistics, 20, 3, p. 616-635. http://dx.doi.org/10.1198/jcgs.2011.10167
Type
Article accepté pour publication ou publiéExternal document link
http://fr.arXiv.org/abs/1010.1595Date
2011Journal name
Journal of Computational and Graphical StatisticsVolume
20Number
3Publisher
American Statistical Association
Pages
616-635
Publication identifier
Metadata
Show full item recordAbstract (EN)
In this paper, we consider the implications of the fact that parallel raw-power can be exploited by a generic Metropolis--Hastings algorithm if the proposed values are independent. In particular, we present improvements to the independent Metropolis--Hastings algorithm that significantly decrease the variance of any estimator derived from the MCMC output, for a null computing cost since those improvements are based on a fixed number of target density evaluations. Furthermore, the techniques developed in this paper do not jeopardize the Markovian convergence properties of the algorithm, since they are based on the Rao--Blackwell principles of Gelfand and Smith (1990), already exploited in Casella and Robert (1996), Atchade and Perron (2005) and Douc and Robert (2010). We illustrate those improvement both on a toy normal example and on a classical probit regression model but insist on the fact that they are universally applicable.Subjects / Keywords
Metropolis-Hastings algorithmRelated items
Showing items related by title and author.
-
Cornuet, Jean-Marie; Robert, Christian P.; Pudlo, Pierre; Guillemaud, Thomas; Marin, Jean-Michel; Lombaert, Eric; Estoup, Arnaud (2012) Article accepté pour publication ou publié
-
Bayen, Alexandre M.; Claudel, Christian; Saint-Pierre, Patrick (2007) Communication / Conférence
-
McKimm, Hector; Wang, Andi Q.; Pollock, Murray; Robert, Christian P.; Roberts, Gareth O. (2022) Document de travail / Working paper
-
Saint-Pierre, Patrick; Claudel, Christian; Bayen, Alexandre M. (2008-01) Communication / Conférence
-
Singh, Sumeetpal S.; Sedki, Mohammed; Jasra, Ajay; Pudlo, Pierre; Robert, Christian P.; Lee, Anthony; Marin, Jean-Michel; Kosmidis, Ioannis; Girolami, Mark; Andrieu, Christophe; Cornebise, Julien; Doucet, Arnaud; Barthelme, Simon; Chopin, Nicolas (2012) Article accepté pour publication ou publié