Free energy Sequential Monte Carlo, application to mixture modelling
Chopin, Nicolas; Jacob, Pierre E. (2011), Free energy Sequential Monte Carlo, application to mixture modelling, dans Bernardo, José M.; Bayarri, M.J.; Berger, James O.; Dawid, A.P.; Heckermann, David; Smith, Adrian F. M.; West, Mike, Bayesian Statistics 9, Oxford University Press : Oxford. 10.1093/acprof:oso/9780199694587.003.0003
Type
Communication / ConférenceDate
2011Titre du colloque
Bayesian Statistics 9Date du colloque
2011-06Ville du colloque
BenidormPays du colloque
SpainTitre de l'ouvrage
Bayesian Statistics 9Auteurs de l’ouvrage
Bernardo, José M.; Bayarri, M.J.; Berger, James O.; Dawid, A.P.; Heckermann, David; Smith, Adrian F. M.; West, MikeÉditeur
Oxford University Press
Ville d’édition
Oxford
Isbn
9780199694587
Identifiant publication
Métadonnées
Afficher la notice complèteRésumé (EN)
We introduce a new class of Sequential Monte Carlo (SMC) methods, which we call free energy SMC. This class is inspired by free energy methods, which originate from Physics, and where one samples from a biased distribution such that a given function $\xi(\theta)$ of the state $\theta$ is forced to be uniformly distributed over a given interval. From an initial sequence of distributions $(\pi_t)$ of interest, and a particular choice of $\xi(\theta)$, a free energy SMC sampler computes sequentially a sequence of biased distributions $(\tilde{\pi}_{t})$ with the following properties: (a) the marginal distribution of $\xi(\theta)$ with respect to $\tilde{\pi}_{t}$ is approximatively uniform over a specified interval, and (b) $\tilde{\pi}_{t}$ and $\pi_{t}$ have the same conditional distribution with respect to $\xi$. We apply our methodology to mixture posterior distributions, which are highly multimodal. In the mixture context, forcing certain hyper-parameters to higher values greatly faciliates mode swapping, and makes it possible to recover a symetric output. We illustrate our approach with univariate and bivariate Gaussian mixtures and two real-world datasets.Mots-clés
Free energy biasing; Label switching; Mixture; Sequential Monte Carlo; particle filterPublications associées
Affichage des éléments liés par titre et auteur.
-
Schäfer, Christian; Chopin, Nicolas (2013) Article accepté pour publication ou publié
-
Barthelme, Simon; Beffy, Magali; Chopin, Nicolas; Doucet, Arnaud; Jacob, Pierre E.; Johansen, Adam M.; Marin, Jean-Michel; Robert, Christian P. (2011) Document de travail / Working paper
-
Jacob, Pierre E.; Chopin, Nicolas; Robert, Christian P.; Rue, Havard (2009) Document de travail / Working paper
-
Arbel, Julyan; Salomond, Jean-Bernard (2016) Communication / Conférence
-
Fournié, Eric; Lasry, Jean-Michel; Lebuchoux, Jérôme; Lions, Pierre-Louis; Touzi, Nizar (1999) Article accepté pour publication ou publié