Publications related to Interaction information

Common Information Components Analysis

Wyner's common information is a measure that quantifies and assesses the commonality between two random variables. Based on this, we introduce a novel two-step procedure to construct features from data, referred to as Common Information Components Analysis ...

MDPI2021

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Ian Smith, Numa Joy Bertola

Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...

2021

Generalization Error Bounds Via Rényi-, f-Divergences and Maximal Leakage

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two random variables. ...

2021

Low-Cost Side-Channel Secure Standard 6T-SRAM-Based Memory With a 1% Area and Less Than 5% Latency and Power Overheads

Robert Giterman

Side-channel attacks constitute a concrete threat to IoT systems-on-a-chip (SoCs). Embedded memories implemented with 6T SRAM macrocells often dominate the area and power consumption of these SoCs. Regardless of the computational platform, the side-channel ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Nicolas Macris, Florent Gérard Krzakala, Jean François Emmanuel Barbier, Mohamad Baker Dia

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access. There has been a ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Robust Generalization via f−Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

Given two probability measures P and Q and an event E, we provide bounds on P(E) in terms of Q(E) and f-divergences. In particular, the bounds are instantiated when the measures considered are a joint distribution and the corresponding product of marginals ...

IEEE2020

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

Ian Smith, Numa Joy Bertola, Marco Proverbio

In developed countries, structural assessment of existing bridges should not be performed using the same conservative models that are used at the design stage. Field measurements of real behavior provide additional information for the inference of previous ...

2020

Strengthened Information-theoretic Bounds on the Generalization Error

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The following problem is considered: given a joint distribution P XY and an event E, bound P XY (E) in terms of P X P Y (E) (where P X P Y is the product of the marginals of P XY ) and a measure of dependence of X and Y. Such bounds have direct application ...

IEEE2019

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

Nicolas Macris, Jean François Emmanuel Barbier, Chun Lam Chan

We rigorously derive a single-letter variational expression for the mutual information of the asymmetric two-groups stochastic block model in the dense graph regime. Existing proofs in the literature are indirect, as they involve mapping the model to a ran ...

IEEE2019

Interaction information

Graph Chatbot

Chat with Graph Search

Common Information Components Analysis

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Generalization Error Bounds Via Rényi-, f-Divergences and Maximal Leakage

Low-Cost Side-Channel Secure Standard 6T-SRAM-Based Memory With a 1% Area and Less Than 5% Latency and Power Overheads

Robust Generalization via $\alpha$-Mutual Information

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Robust Generalization via f−Mutual Information

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

Strengthened Information-theoretic Bounds on the Generalization Error

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Generalization Error Bounds Via Rényi-, f-Divergences and Maximal Leakage

Common Information Components Analysis

Low-Cost Side-Channel Secure Standard 6T-SRAM-Based Memory With a 1% Area and Less Than 5% Latency and Power Overheads

Robust Generalization via $\alpha$-Mutual Information

Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation

Robust Generalization via f−Mutual Information

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

Strengthened Information-theoretic Bounds on the Generalization Error

Mutual Information for the Stochastic Block Model by the Adaptive Interpolation Method