Publications de Clément Dominique Luneau

Information theoretic limits of learning a sparse rule

Nicolas Macris, Clément Dominique Luneau

We consider generalized linear models in regimes where the number of nonzero components of the signal and accessible data points are sublinear with respect to the size of the signal. We prove a variational formula for the asymptotic mutual information per ...

IOP Publishing Ltd2022

Statistical limits of high-dimensional inference problems

Clément Dominique Luneau

This thesis focuses on two kinds of statistical inference problems in signal processing and data science. The first problem is the estimation of a structured informative tensor from the observation of a noisy tensor in which it is buried. The structure com ...

EPFL2021

Mutual information for low-rank even-order symmetric tensor estimation

Nicolas Macris, Jean François Emmanuel Barbier, Clément Dominique Luneau

We consider a statistical model for finite-rank symmetric tensor factorization and prove a single-letter variational expression for its asymptotic mutual information when the tensor is of even order. The proof applies the adaptive interpolation method orig ...

OXFORD UNIV PRESS2021

Tensor estimation with structured priors

Nicolas Macris, Clément Dominique Luneau

We consider rank-one symmetric tensor estimation when the tensor is corrupted by gaussian noise and the spike forming the tensor is a structured signal coming from a generalized linear model. The latter is a mathematically tractable model of a non-trivial ...

2020

High-dimensional rank-one nonsymmetric matrix decomposition: the spherical case

Nicolas Macris, Jean François Emmanuel Barbier, Clément Dominique Luneau

We consider the problem of estimating a rank-one nonsymmetric matrix under additive white Gaussian noise. The matrix to estimate can be written as the outer product of two vectors and we look at the special case in which both vectors are uniformly distribu ...

IEEE2020

Entropy and mutual information in models of deep neural networks

Nicolas Macris, Clément Dominique Luneau, Florent Gérard Krzakala, Lenka Zdeborová, Jean François Emmanuel Barbier

We examine a class of stochastic deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) we show how entropies and mutual informations can be derived from heuristic statistical physics ...

2019

Mutual Information for Low-Rank Even-Order Symmetric Tensor Factorization

Nicolas Macris, Jean François Emmanuel Barbier, Clément Dominique Luneau

We consider a statistical model for finite-rank symmetric tensor factorization and prove a single-letter variational expression for its mutual information when the tensor is of even order. The proof uses the adaptive interpolation method, for which rank-on ...

IEEE2019

Entropy and mutual information in models of deep neural networks

Nicolas Macris, Jean François Emmanuel Barbier, Florent Gérard Krzakala, Clément Dominique Luneau, Lenka Zdeborová

We examine a class of stochastic deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) We show how entropies and mutual informations can be derived from heuristic statistical physics ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2018