Publications related to A Functional Perspective on Information Measures

Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution

Daniel Kuhn, Soroosh Shafieezadeh Abadeh, Bahar Taskesen

Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are ubiquitous in statistics, ...

2021

Common Information Components Analysis

Michael Christoph Gastpar, Erixhen Sula

Wyner's common information is a measure that quantifies and assesses the commonality between two random variables. Based on this, we introduce a novel two-step procedure to construct features from data, referred to as Common Information Components Analysis ...

MDPI2021

Realizing doubles: a conjugation zoo

Jérôme Scherer

Conjugation spaces are topological spaces equipped with an involution such that their fixed points have the same mod 2 cohomology (as a graded vector space, a ring and even an unstable algebra) but with all degrees divided by two, generalizing the classica ...

CAMBRIDGE UNIV PRESS2021

A decomposition of multicorrelation sequences for commuting transformations along primes

Florian Karl Richter

A decomposition of multicorrelation sequences for commuting transformations along primes, Discrete Analysis 2021:4, 27 pp. Szemerédi's theorem asserts that for every positive integer

k

and every

\delta>0

there exists

n

such that every subset of ${1, ...

2021

Learning in Volatile Environments With the Bayes Factor Surprise

Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi, Vasiliki Liakoni

Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...

MIT PRESS2021

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Ian Smith, Numa Joy Bertola

Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...

2021

Mutual information for low-rank even-order symmetric tensor estimation

Nicolas Macris, Jean François Emmanuel Barbier, Clément Dominique Luneau

We consider a statistical model for finite-rank symmetric tensor factorization and prove a single-letter variational expression for its asymptotic mutual information when the tensor is of even order. The proof applies the adaptive interpolation method orig ...

OXFORD UNIV PRESS2021

Mutual Information Disentangles Interactions from Changing Environments

Daniel Maria Busiello, Giorgio Nicoletti

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting model in a switc ...

AMER PHYSICAL SOC2021

Discretisation and continuity: The emergence of symbols in communication

Martin Alois Rohrmeier, Robert Lieck

Vocal signalling systems, as used by humans and various non-human animals, exhibit discrete and continuous properties that can naturally be used to express discrete and continuous information, such as distinct words to denote objects in the world and proso ...

2021

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

A Functional Perspective on Information Measures

Graph Chatbot

Chat with Graph Search

Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution

Common Information Components Analysis

Realizing doubles: a conjugation zoo

A decomposition of multicorrelation sequences for commuting transformations along primes

Learning in Volatile Environments With the Bayes Factor Surprise

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Mutual information for low-rank even-order symmetric tensor estimation

Mutual Information Disentangles Interactions from Changing Environments

Discretisation and continuity: The emergence of symbols in communication

Robust Generalization via $\alpha$-Mutual Information

Learning in Volatile Environments With the Bayes Factor Surprise

Robust Generalization via $\alpha$-Mutual Information

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Discretisation and continuity: The emergence of symbols in communication

A decomposition of multicorrelation sequences for commuting transformations along primes

Realizing doubles: a conjugation zoo

Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution

Common Information Components Analysis

Mutual information for low-rank even-order symmetric tensor estimation

Mutual Information Disentangles Interactions from Changing Environments