
BCMA-ES: A Bayesian approach to CMA-ES
Benhamou, Éric; Saltiel, David; Verel, Sébastien; Teytaud, Fabien (2020), BCMA-ES: A Bayesian approach to CMA-ES. https://basepub.dauphine.fr/handle/123456789/21201
View/ Open
Type
Document de travail / Working paperExternal document link
https://hal.archives-ouvertes.fr/hal-02886512Date
2020Series title
Preprint LamsadeMetadata
Show full item recordAuthor(s)
Benhamou, ÉricLaboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Saltiel, David
Verel, Sébastien

Teytaud, Fabien
Abstract (EN)
This paper introduces a novel theoretically sound approach for the celebrated CMA-ES algorithm. Assuming the parameters of the multi variate normal distribution for the minimum follow a conjugate prior distribution, we derive their optimal update at each iteration step. Not only provides this Bayesian framework a justification for the update of the CMA-ES algorithm but it also gives two new versions of CMA-ES either assuming normal-Wishart or normal-Inverse Wishart priors, depending whether we parametrize the likelihood by its covariance or precision matrix. We support our theoretical findings by numerical experiments that show fast convergence of these modified versions of CMA-ES.Subjects / Keywords
CMA-ES; Bayesian; conjugate prior; normal-inverse-WishartRelated items
Showing items related by title and author.
-
Benhamou, Éric; Saltiel, David; Guez, Beatrice; Paris, Nicolas (2020) Document de travail / Working paper
-
Benhamou, Eric; Saltiel, David; Verel, Sébastien (2020) Communication / Conférence
-
Benhamou, Éric; Saltiel, David; Laraki, Rida; Atif, Jamal (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Tabachnik, Serge; Wong, Sui Kai; Chareyron, François (2021) Document de travail / Working paper
-
Benhamou, Eric; Atif, Jamal; Laraki, Rida (2018) Document de travail / Working paper