Publications related to Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

Strengthened Information-theoretic Bounds on the Generalization Error

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The following problem is considered: given a joint distribution P XY and an event E, bound P XY (E) in terms of P X P Y (E) (where P X P Y is the product of the marginals of P XY ) and a measure of dependence of X and Y. Such bounds have direct application ...

IEEE2019

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

Nicolas Macris, Jean François Emmanuel Barbier, Chun Lam Chan

We rigorously derive a single-letter variational expression for the mutual information of the asymmetric two-groups stochastic block model in the dense graph regime. Existing proofs in the literature are indirect, as they involve mapping the model to a ran ...

IEEE2019

Scheduling trips through a bottleneck: monotonicity and stability

Nikolaos Geroliminis, Raphael Ali Francis Lamotte

This paper investigates the stability of departure time choice within a population of commuters that need to pass through a bottleneck of constant capacity. It is shown that the corresponding utility function is monotonic if and only if the marginal utilit ...

2019

Quantifying high-order interdependencies via multivariate extensions of the mutual information

Michael Christoph Gastpar, Fernando Rosas de Andraca

This paper introduces a model-agnostic approach to study statistical synergy, a form of emergence in which patterns at large scales are not traceable from lower scales. Our framework leverages various multivariate extensions of Shannon's mutual information ...

2019

High-Dimensional Inference on Dense Graphs with Applications to Coding Theory and Machine Learning

Mohamad Baker Dia

We are living in the era of "Big Data", an era characterized by a voluminous amount of available data. Such amount is mainly due to the continuing advances in the computational capabilities for capturing, storing, transmitting and processing data. However, ...

EPFL2018

Unsupervised Change Detection in Satellite Images using Oversegmentation and Mutual Information

Bahar Taskesen, Beril Besbinar

In this paper, a novel solution to the problem of unsupervised change detection in bitemporal satellite images is presented. Information measures, which are well-known and commonly-used in the change detection literature, result in unsharp change maps and ...

Ieee2017

Nonequilibrium Dynamics of Collective Excitations in Strongly Interacting and Correlated Quantum Systems

Edoardo Baldini

Revealing the emergence and the dynamics of collective excitations in complex matter is a subject of pivotal importance, as it provides insight into the strength and spatial distribution of interactions and correlations. At the same time, collectivity lies ...

EPFL2017

Bright solitons in non-equilibrium coherent quantum matter

Hugo Pierre Alexandre Flayac

We theoretically demonstrate a mechanism for bright soliton generation in spinor non-equilibrium Bose-Einstein condensates made of atoms or quasi-particles such as polaritons in semiconductor microcavities. We give analytical expressions for bright (half) ...

Royal Soc2016

Solid-liquid interfacial free energy out of equilibrium

Michele Ceriotti, Bingqing Cheng, Gareth Aneurin Tribello

The properties of the interface between solid and melt are key to solidification and melting, as the interfacial free energy introduces a kinetic barrier to phase transitions. This makes solidification happen below the melting temperature, in out-of-equili ...

2015

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

Graph Chatbot

Chat with Graph Search

Robust Generalization via $\alpha$-Mutual Information

Strengthened Information-theoretic Bounds on the Generalization Error

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

Scheduling trips through a bottleneck: monotonicity and stability

Quantifying high-order interdependencies via multivariate extensions of the mutual information

High-Dimensional Inference on Dense Graphs with Applications to Coding Theory and Machine Learning

Unsupervised Change Detection in Satellite Images using Oversegmentation and Mutual Information

Nonequilibrium Dynamics of Collective Excitations in Strongly Interacting and Correlated Quantum Systems

Bright solitons in non-equilibrium coherent quantum matter

Solid-liquid interfacial free energy out of equilibrium

Robust Generalization via $\alpha$-Mutual Information

Strengthened Information-theoretic Bounds on the Generalization Error

Scheduling trips through a bottleneck: monotonicity and stability

Bright solitons in non-equilibrium coherent quantum matter

Quantifying high-order interdependencies via multivariate extensions of the mutual information

High-Dimensional Inference on Dense Graphs with Applications to Coding Theory and Machine Learning

Unsupervised Change Detection in Satellite Images using Oversegmentation and Mutual Information

Solid-liquid interfacial free energy out of equilibrium

Nonequilibrium Dynamics of Collective Excitations in Strongly Interacting and Correlated Quantum Systems

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method