Model Consistency of Partly Smooth Regularizers
Vaiter, Samuel; Fadili, Jalal; Peyré, Gabriel (2018), Model Consistency of Partly Smooth Regularizers, IEEE Transactions on Information Theory, 64, 3. 10.1109/TIT.2017.2713822
Type
Article accepté pour publication ou publiéExternal document link
https://hal.archives-ouvertes.fr/hal-00987293Date
2018Journal name
IEEE Transactions on Information TheoryVolume
64Number
3Publisher
IEEE - Institute of Electrical and Electronics Engineers
Publication identifier
Metadata
Show full item recordAuthor(s)
Vaiter, Samuel
Fadili, Jalal
CEntre de REcherches en MAthématiques de la DEcision [CEREMADE]
Peyré, Gabriel
CEntre de REcherches en MAthématiques de la DEcision [CEREMADE]
Abstract (EN)
This paper studies least-square regression penalized with partly smooth convex regularizers. This class of functions is very large and versatile allowing to promote solutions conforming to some notion of low-complexity. Indeed, they force solutions of variational problems to belong to a low-dimensional manifold (the so-called model) which is stable under small perturbations of the function. This property is crucial to make the underlying low-complexity model robust to small noise. We show that a generalized ''irrepresentable condition'' implies stable model selection under small noise perturbations in the observations and the design matrix, when the regularization parameter is tuned proportionally to the noise level. This condition is shown to be almost a necessary condition. We then show that this condition implies model consistency of the regularized estimator. That is, with a probability tending to one as the number of measurements increases, the regularized estimator belongs to the correct low-dimensional model manifold. This work unifies and generalizes several previous ones, where model consistency is known to hold for sparse, group sparse, total variation and low-rank regularizations.Subjects / Keywords
convexity; sparsity; sensitivity analysis; low-rank; partial smoothness; Inverse problemRelated items
Showing items related by title and author.
-
Vaiter, Samuel; Deledalle, Charles-Alban; Fadili, Jalal; Peyré, Gabriel; Dossal, Charles (2016) Article accepté pour publication ou publié
-
Peyré, Gabriel; Vaiter, Samuel; Fadili, Jalal (2014) Document de travail / Working paper
-
Vaiter, Samuel; Peyré, Gabriel; Fadili, Jalal (2015) Chapitre d'ouvrage
-
Fadili, Jalal; Dossal, Charles; Peyré, Gabriel; Deledalle, Charles-Alban; Vaiter, Samuel (2013) Article accepté pour publication ou publié
-
Deledalle, Charles-Alban; Vaiter, Samuel; Peyré, Gabriel; Fadili, Jalal; Dossal, Charles (2012) Communication / Conférence