
Distinguish the indistinguishable: a Deep Reinforcement Learning approach for volatility targeting models
Benhamou, Éric; Saltiel, David; Tabachnik, Serge; Wong, Sui Kai; Chareyron, François (2021), Distinguish the indistinguishable: a Deep Reinforcement Learning approach for volatility targeting models. https://basepub.dauphine.psl.eu/handle/123456789/22204
Voir/Ouvrir
Type
Document de travail / Working paperDate
2021Titre de la collection
Preprint LamsadeVille d’édition
Paris
Métadonnées
Afficher la notice complèteAuteur(s)
Benhamou, ÉricLaboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Saltiel, David
Tabachnik, Serge
Wong, Sui Kai
Chareyron, François
Résumé (EN)
Can an agent efficiently learn to distinguish extremely similar financial models in an environment dominated by noise and regime changes? Standard statistical methods based on averaging or ranking models fail precisely because of regime changes and noisy environments. Additional contextual information in Deep Reinforcement Learning (DRL), helps training an agent distinguish different financial models whose time series are very similar. Our contributions are four-fold: (i) we combine model-based and modelfree Reinforcement Learning (RL). The last model-free RL allows us selecting the different models, (ii) we present a concept, called "walk-forward analysis", which is defined by successive training and testing based on expanding periods, to assert the robustness of the resulting agent, (iii) we present a method based on the importance of features that looks like the one in gradient boosting methods and is based on features sensitivities, (iv) last but not least, we introduce the concept of statistical difference significance based on a two-tailed T-test, to highlight the ways in which our models differ from more traditional ones. Our experimental results show that our approach outperforms the benchmarks in almost all evaluation metrics commonly used in financial mathematics, namely net performance, Sharpe ratio, Sortino, maximum drawdown, maximum drawdown over volatility.Mots-clés
Features sensitivity; Walk forward; Portfolio allocation; Model-free; Model-based; Deep Reinforcement learningPublications associées
Affichage des éléments liés par titre et auteur.
-
Benhamou, Éric; Saltiel, David; Ohana, Jean-Jacques; Atif, Jamal; Laraki, Rida Communication / Conférence
-
Benhamou, Éric; Saltiel, David; Ungari, Sandrine; Mukhopadhyay, Abhishek (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Ungari, Sandrine; Mukhopadhyay, Abhishek (2020) Document de travail / Working paper
-
Benhamou, Éric; Saltiel, David; Ungari, Sandrine; Mukhopadhyay, Abhishek; Atif, Jamal (2020) Document de travail / Working paper
-
Ohana, Jean Jacques; Benhamou, Éric; Saltiel, David; Guez, Beatrice (2021) Document de travail / Working paper