Publications related to Mutual Information based Channel Selection for Speaker Diarization of Meetings Data

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

Daniel Maria Busiello, Giorgio Nicoletti

Biochemistry, ecology, and neuroscience are examples of prominent fields aiming at describing interacting systems that exhibit nontrivial couplings to complex, ever-changing environments. We have recently shown that linear interactions and a switching envi ...

AMER PHYSICAL SOC2022

The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

Michael Christoph Gastpar, Erixhen Sula

This paper presents explicit solutions for two related non-convex information extremization problems due to Gray and Wyner in the Gaussian case. The first problem is the Gray-Wyner network subject to a sum-rate constraint on the two private links. Here, ou ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Ian Smith, Numa Joy Bertola

Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...

2021

Mutual Information Disentangles Interactions from Changing Environments

Daniel Maria Busiello, Giorgio Nicoletti

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting model in a switc ...

AMER PHYSICAL SOC2021

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Nicolas Macris, Florent Gérard Krzakala, Jean François Emmanuel Barbier, Mohamad Baker Dia

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access. There has been a ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

Strengthened Information-theoretic Bounds on the Generalization Error

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The following problem is considered: given a joint distribution P XY and an event E, bound P XY (E) in terms of P X P Y (E) (where P X P Y is the product of the marginals of P XY ) and a measure of dependence of X and Y. Such bounds have direct application ...

IEEE2019

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

Nicolas Macris, Jean François Emmanuel Barbier, Chun Lam Chan

We rigorously derive a single-letter variational expression for the mutual information of the asymmetric two-groups stochastic block model in the dense graph regime. Existing proofs in the literature are indirect, as they involve mapping the model to a ran ...

IEEE2019

Optimal errors and phase transitions in high-dimensional generalized linear models

Nicolas Macris, Florent Gérard Krzakala, Lenka Zdeborová, Jean François Emmanuel Barbier

Generalized linear models (GLMs) are used in high-dimensional machine learning, statistics, communications, and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing, error-corre ...

PNAS2019

On the Use of Transfer Entropy to Investigate the Time Horizon of Causal Influences between Signals

Olivier Sauter, Ambrogio Fasoli, Basil Duval, Stefano Coda, Jonathan Graves, Yves Martin, Duccio Testa, Patrick Blanchard, Alessandro Pau, Cristian Sommariva, Henri Weisen, Richard Pitts, Yann Camenen, Jan Horacek, Javier García Hernández, Marco Wischmeier, Nicola Vianello, Mikhail Maslov, Federico Nespoli, Yao Zhou, David Pfefferlé, Davide Galassi, Antonio José Pereira de Figueiredo, Jonathan Marc Philippe Faustin, Liang Yao, Dalziel Joseph Wilson, Hamish William Patten, Samuel Lanthaler, Bernhard Sieglin, Otto Asunta

Understanding the details of the correlation between time series is an essential step on the route to assessing the causal relation between systems. Traditional statistical indicators, such as the Pearson correlation coefficient and the mutual information, ...

2018

Mutual Information based Channel Selection for Speaker Diarization of Meetings Data

Graph Chatbot

Chat with Graph Search

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Mutual Information Disentangles Interactions from Changing Environments

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Robust Generalization via $\alpha$-Mutual Information

Strengthened Information-theoretic Bounds on the Generalization Error

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

Optimal errors and phase transitions in high-dimensional generalized linear models

On the Use of Transfer Entropy to Investigate the Time Horizon of Causal Influences between Signals

Mutual information in changing environments: Nonlinear interactions, out-of-equilibrium systems, and continuously varying diffusivities

The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Strengthened Information-theoretic Bounds on the Generalization Error

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

On the Use of Transfer Entropy to Investigate the Time Horizon of Causal Influences between Signals

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Mutual Information Disentangles Interactions from Changing Environments

Robust Generalization via $\alpha$-Mutual Information

Optimal errors and phase transitions in high-dimensional generalized linear models