• xmlui.mirage2.page-structure.header.title
    • français
    • English
  • Help
  • Login
  • Language 
    • Français
    • English
View Item 
  •   BIRD Home
  • CEREMADE (UMR CNRS 7534)
  • CEREMADE : Publications
  • View Item
  •   BIRD Home
  • CEREMADE (UMR CNRS 7534)
  • CEREMADE : Publications
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Browse

BIRDResearch centres & CollectionsBy Issue DateAuthorsTitlesTypeThis CollectionBy Issue DateAuthorsTitlesType

My Account

LoginRegister

Statistics

Most Popular ItemsStatistics by CountryMost Popular Authors
Thumbnail - Request a copy

Sequential Monte Carlo on large binary sampling spaces

Schäfer, Christian; Chopin, Nicolas (2013), Sequential Monte Carlo on large binary sampling spaces, Statistics and Computing, 23, 2, p. 163-184. http://dx.doi.org/10.1007/s11222-011-9299-z

Type
Article accepté pour publication ou publié
Date
2013
Journal name
Statistics and Computing
Volume
23
Number
2
Publisher
Springer
Pages
163-184
Publication identifier
http://dx.doi.org/10.1007/s11222-011-9299-z
Metadata
Show full item record
Author(s)
Schäfer, Christian
Chopin, Nicolas
Abstract (EN)
A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for a good performance. In this paper, we present such a parametric family for adaptive sampling on high-dimensional binary spaces. A practical motivation for this problem is variable selection in a linear regression context. We want to sample from a Bayesian posterior distribution on the model space using an appropriate version of Sequential Monte Carlo. Raw versions of Sequential Monte Carlo are easily implemented using binary vectors with independent components. For high-dimensional problems, however, these simple proposals do not yield satisfactory results. The key to an efficient adaptive algorithm are binary parametric families which take correlations into account, analogously to the multivariate normal distribution on continuous spaces. We provide a review of models for binary data and make one of them work in the context of Sequential Monte Carlo sampling. Computational studies on real life data with about a hundred covariates suggest that, on difficult instances, our Sequential Monte Carlo approach clearly outperforms standard techniques based on Markov chain exploration by orders of magnitude.
Subjects / Keywords
Sequential Monte Carlo; Linear regression; Variable selection; Adaptive Monte Carlo; Multivariate binary data
JEL
C15 - Statistical Simulation Methods: General
C11 - Bayesian Analysis: General

Related items

Showing items related by title and author.

  • Thumbnail
    Adaptive Monte Carlo on multivariate binary sampling spaces 
    Schäfer, Christian; Chopin, Nicolas (2011) Article accepté pour publication ou publié
  • Thumbnail
    Monte Carlo methods for sampling high-dimensional binary vectors 
    Schäfer, Christian (2012-11) Thèse
  • Thumbnail
    Free energy Sequential Monte Carlo, application to mixture modelling 
    Chopin, Nicolas; Jacob, Pierre E. (2011) Communication / Conférence
  • Thumbnail
    Parametric families on large binary spaces 
    Schäfer, Christian (2011-02) Document de travail / Working paper
  • Thumbnail
    Three discussions of the paper "sequential quasi-Monte Carlo sampling", by M. Gerber and N. Chopin 
    Arbel, Julyan; Prünster, Igor; Robert, Christian P.; Ryder, Robin J. (2015-05) Article accepté pour publication ou publié
Dauphine PSL Bibliothèque logo
Place du Maréchal de Lattre de Tassigny 75775 Paris Cedex 16
Phone: 01 44 05 40 94
Contact
Dauphine PSL logoEQUIS logoCreative Commons logo