Publications related to Feedback and Common Information: Bounds and Capacity for Gaussian Networks

Common Information Components Analysis

We give an information-theoretic interpretation of Canonical Correlation Analysis (CCA) via (relaxed) Wyner's common information. CCA permits to extract from two high-dimensional data sets low-dimensional descriptions (features) that capture the commonalit ...

IEEE2020

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

Ian Smith, Numa Joy Bertola, Marco Proverbio

In developed countries, structural assessment of existing bridges should not be performed using the same conservative models that are used at the design stage. Field measurements of real behavior provide additional information for the inference of previous ...

2020

On some consistent tests of mutual independence among several random vectors of arbitrary dimensions

Soham Sarkar

Testing for mutual independence among several random vectors is a challenging problem, and in recent years, it has gained significant attention in statistics and machine learning literature. Most of the existing tests of independence deal with only two ran ...

SPRINGER2020

A Local Law for Singular Values from Diophantine Equations

Marius Christopher Lemm

We introduce the

N\times N

random matrices

X_{j,k}=\exp\left(2\pi i \sum_{q=1}^d\ \omega_{j,q} k^q\right) \quad \text{with } \{\omega_{j,q}\}_{\substack{1\leq j\leq N\\ 1\leq q\leq d}} \text{ i.i.d. random variables},

and

d

a fixed integer. We pr ...

2020

Sum-Rate Capacity for Symmetric Gaussian Multiple Access Channels With Feedback

Michael Christoph Gastpar, Erixhen Sula

The feedback sum-rate capacity is established for the symmetric

J

-user Gaussian multiple-access channel (GMAC). The main contribution is a converse bound that combines the dependence-balance argument of Hekstra and Willems (1989) with a variant of the f ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Statistical Physics Methods for Community Detection

Chun Lam Chan

This thesis is devoted to information-theoretic aspects of community detection. The importance of community detection is due to the massive amount of scientific data today that describes relationships between items from a network, e.g., a social network. I ...

EPFL2019

Learning and Adaptive Data Analysis via Maximal Leakage

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

There has been growing interest in studying connections between generalization error of learning algorithms and information measures. In this work, we generalize a result that employs the maximal leakage, a measure of leakage of information, and explore ho ...

IEEE2019

Scalable Learning-Based Sampling Optimization for Compressive Dynamic MRI

Volkan Cevher, Ruud van Heeswijk, Baran Gözcü, Thomas Sanchez

Slow acquisition has been one of the historical problems in dynamic magnetic resonance imaging (dMRI), but the rise of compressed sensing (CS) has brought numerous algorithms that successfully achieve high acceleration rates. While CS proposes random sampl ...

2019

Entropic Matroids and Their Representation

Emmanuel Abbé

This paper investigates entropic matroids, that is, matroids whose rank function is given as the Shannon entropy of random variables. In particular, we consider p-entropic matroids, for which the random variables each have support of cardinality p. We draw ...

2019

Systems and methods for rate-compatible polar codes for general channels

Seyed Hamed Hassani, Marco Mondelli

According to certain embodiments, a transmit node in a wireless communications system includes a first universal rate-compatible polar encoder and a transmitter. The first universal rate-compatible polar encoder is configured for a family of two or more ty ...

2019

Feedback and Common Information: Bounds and Capacity for Gaussian Networks

Graph Chatbot

Chat with Graph Search

Common Information Components Analysis

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

On some consistent tests of mutual independence among several random vectors of arbitrary dimensions

A Local Law for Singular Values from Diophantine Equations

Sum-Rate Capacity for Symmetric Gaussian Multiple Access Channels With Feedback

Statistical Physics Methods for Community Detection

Learning and Adaptive Data Analysis via Maximal Leakage

Scalable Learning-Based Sampling Optimization for Compressive Dynamic MRI

Entropic Matroids and Their Representation

Systems and methods for rate-compatible polar codes for general channels

Statistical Physics Methods for Community Detection

Sum-Rate Capacity for Symmetric Gaussian Multiple Access Channels With Feedback

Framework to Approximate the Value of Information of Bridge Load Testing for Reserve Capacity Assessment

Common Information Components Analysis

On some consistent tests of mutual independence among several random vectors of arbitrary dimensions

Learning and Adaptive Data Analysis via Maximal Leakage

Entropic Matroids and Their Representation

Scalable Learning-Based Sampling Optimization for Compressive Dynamic MRI

A Local Law for Singular Values from Diophantine Equations

Systems and methods for rate-compatible polar codes for general channels