An Adaptive Interacting Wang–Landau Algorithm for Automatic Density Exploration
Bornn, Luke; Del Moral, Pierre; Doucet, Arnaud; Jacob, Pierre E. (2013), An Adaptive Interacting Wang–Landau Algorithm for Automatic Density Exploration, Journal of Computational and Graphical Statistics, 22, 3, p. 749-773. http://dx.doi.org/10.1080/10618600.2012.723569
Type
Article accepté pour publication ou publiéDate
2013Journal name
Journal of Computational and Graphical StatisticsVolume
22Number
3Publisher
Taylor & Francis
Pages
749-773
Publication identifier
Metadata
Show full item recordAbstract (EN)
While statisticians are well-accustomed to performing exploratory analysis in the modeling stage of an analysis, the notion of conducting preliminary general-purpose exploratory analysis in the Monte Carlo stage (or more generally, the model-fitting stage) of an analysis is an area that we feel deserves much further attention. Toward this aim, this article proposes a general-purpose algorithm for automatic density exploration. The proposed exploration algorithm combines and expands upon components from various adaptive Markov chain Monte Carlo methods, with the Wang–Landau algorithm at its heart. Additionally, the algorithm is run on interacting parallel chains—a feature that both decreases computational cost as well as stabilizes the algorithm, improving its ability to explore the density. Performance of this new parallel adaptive Wang–Landau algorithm is studied in several applications. Through a Bayesian variable selection example, we demonstrate the convergence gains obtained with interacting chains. The ability of the algorithm’s adaptive proposal to induce mode-jumping is illustrated through a Bayesian mixture modeling application. Last, through a two-dimensional Ising model, the authors demonstrate the ability of the algorithm to overcome the high correlations encountered in spatial models. Supplemental materials are available online.Subjects / Keywords
Wang-Landau algorithm; Parallel chains; Adaptive Markov chain Monte Carlo; Adaptive binningRelated items
Showing items related by title and author.
-
Singh, Sumeetpal S.; Sedki, Mohammed; Jasra, Ajay; Pudlo, Pierre; Robert, Christian P.; Lee, Anthony; Marin, Jean-Michel; Kosmidis, Ioannis; Girolami, Mark; Andrieu, Christophe; Cornebise, Julien; Doucet, Arnaud; Barthelme, Simon; Chopin, Nicolas (2012) Article accepté pour publication ou publié
-
Adaptive greedy algorithm for moderately large dimensions in kernel conditional density estimation Nguyen, Minh-Lien; Lacour, Claire; Rivoirard, Vincent (2022) Article accepté pour publication ou publié
-
Barthelme, Simon; Beffy, Magali; Chopin, Nicolas; Doucet, Arnaud; Jacob, Pierre E.; Johansen, Adam M.; Marin, Jean-Michel; Robert, Christian P. (2011) Document de travail / Working paper
-
Rubenthaler, Sylvain; Jacob, Pierre E.; Doucet, Arnaud (2013) Document de travail / Working paper
-
Doucet, Arnaud; Robert, Christian P. (2000) Document de travail / Working paper