Publications related to Divergence (statistics)

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Daniel Kuhn, Viet Anh Nguyen, Bahar Taskesen

Least squares estimators, when trained on a few target domain samples, may predict poorly. Supervised domain adaptation aims to improve the predictive accuracy by exploiting additional labeled training samples from a source distribution that is close to th ...

2021

Robust Generalization via f−Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

Given two probability measures P and Q and an event E, we provide bounds on P(E) in terms of Q(E) and f-divergences. In particular, the bounds are instantiated when the measures considered are a joint distribution and the corresponding product of marginals ...

IEEE2020

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

Entropy as a tool for crystal discovery

Pablo Miguel Piaggi

The computational prediction of crystal structures has emerged as an useful alternative to expensive and often cumbersome experiments. We propose an approach to the prediction of crystal structures and polymorphism based on reproducing the crystallization ...

EPFL2019

Fast Mean Estimation with Sub-Gaussian Rates

Nicolas Henri Bernard Flammarion

We present an improved analysis of the Euler-Maruyama discretization of the Langevin diffusion. Our analysis does not require global contractivity, and yields polynomial dependence on the time horizon. Compared to existing approaches, we make an additional ...

2019

A sequence-dependent coarse-grain model of B-DNA with explicit description of bases and phosphate groups parametrised from large scale Molecular Dynamics simulations

Alessandro Samuele Patelli

We introduce a sequence-dependent coarse-grain model of double-stranded DNA with an explicit description of both the bases and the phosphate groups as interacting rigid-bodies. The model parameters are trained on extensive, state-of-the-art large scale mol ...

EPFL2019

Calculating Optimistic Likelihoods Using (Geodesically) Convex Optimization

Daniel Kuhn, Viet Anh Nguyen, Soroosh Shafieezadeh Abadeh, Wolfram Wiesemann

A fundamental problem arising in many areas of machine learning is the evaluation of the likelihood of a given observation under different nominal distributions. Frequently, these nominal distributions are themselves estimated from data, which makes them s ...

2019

An adaptive primal-dual framework for nonsmooth convex minimization

Volkan Cevher, Quoc Tran Dinh, Ahmet Alacaoglu

We propose a new self-adaptive and double-loop smoothing algorithm to solve composite, nonsmooth, and constrained convex optimization problems. Our algorithm is based on Nesterov’s smoothing technique via general Bregman distance functions. It self-adaptiv ...

2019

Optimistic Distributionally Robust Optimization for Nonparametric Likelihood Approximation

Daniel Kuhn, Viet Anh Nguyen, Soroosh Shafieezadeh Abadeh, Wolfram Wiesemann

The likelihood function is a fundamental component in Bayesian statistics. However, evaluating the likelihood of an observation is computationally intractable in many applications. In this paper, we propose a non-parametric approximation of the likelihood ...

2019

A structural test for the conformal invariance of the critical 3d Ising model

Pierre Mathieu Yvernay

How can a renormalization group fixed point be scale invariant without being conformal? Polchinski (1988) showed that this may happen if the theory contains a virial current a non-conserved vector operator of dimension exactly (d - 1), whose divergence exp ...

Springer2019

Divergence (statistics)

Graph Chatbot

Chat with Graph Search

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Robust Generalization via f−Mutual Information

Robust Generalization via $\alpha$-Mutual Information

Entropy as a tool for crystal discovery

Fast Mean Estimation with Sub-Gaussian Rates

A sequence-dependent coarse-grain model of B-DNA with explicit description of bases and phosphate groups parametrised from large scale Molecular Dynamics simulations

Calculating Optimistic Likelihoods Using (Geodesically) Convex Optimization

An adaptive primal-dual framework for nonsmooth convex minimization

Optimistic Distributionally Robust Optimization for Nonparametric Likelihood Approximation

A structural test for the conformal invariance of the critical 3d Ising model

Entropy as a tool for crystal discovery

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Fast Mean Estimation with Sub-Gaussian Rates

A sequence-dependent coarse-grain model of B-DNA with explicit description of bases and phosphate groups parametrised from large scale Molecular Dynamics simulations

A structural test for the conformal invariance of the critical 3d Ising model

Robust Generalization via $\alpha$-Mutual Information

Optimistic Distributionally Robust Optimization for Nonparametric Likelihood Approximation

An adaptive primal-dual framework for nonsmooth convex minimization

Calculating Optimistic Likelihoods Using (Geodesically) Convex Optimization

Robust Generalization via f−Mutual Information