Concept

Interaction information

Related publications (107)

Database Alignment with Gaussian Features

We consider the problem of aligning a pair of databases with jointly Gaussian features. We consider two algorithms, complete database alignment via MAP estimation among all possible database alignments, and partial alignment via a thresholding approach of ...

MLR Press2019

Entropy and mutual information in models of deep neural networks

Nicolas Macris, Florent Gérard Krzakala, Lenka Zdeborová, Jean François Emmanuel Barbier, Clément Dominique Luneau

We examine a class of stochastic deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) We show how entropies and mutual informations can be derived from heuristic statistical physics ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2018

Chaining Mutual Information and Tightening Generalization Bounds

Emmanuel Abbé

Bounding the generalization error of learning algorithms has a long history, which yet falls short in explaining various generalization successes including those of deep learning. Two important difficulties are (i) exploiting the dependencies between the h ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2018

On the Use of Transfer Entropy to Investigate the Time Horizon of Causal Influences between Signals

Olivier Sauter, Ambrogio Fasoli, Basil Duval, Stefano Coda, Jonathan Graves, Yves Martin, Duccio Testa, Patrick Blanchard, Alessandro Pau, Cristian Sommariva, Henri Weisen, Richard Pitts, Yann Camenen, Jan Horacek, Javier García Hernández, Marco Wischmeier, Nicola Vianello, Mikhail Maslov, Federico Nespoli, Yao Zhou, David Pfefferlé, Davide Galassi, Antonio José Pereira de Figueiredo, Jonathan Marc Philippe Faustin, Liang Yao, Dalziel Joseph Wilson, Hamish William Patten, Samuel Lanthaler, Bernhard Sieglin, Otto Asunta

Understanding the details of the correlation between time series is an essential step on the route to assessing the causal relation between systems. Traditional statistical indicators, such as the Pearson correlation coefficient and the mutual information, ...

2018

High-Dimensional Inference on Dense Graphs with Applications to Coding Theory and Machine Learning

Mohamad Baker Dia

We are living in the era of "Big Data", an era characterized by a voluminous amount of available data. Such amount is mainly due to the continuing advances in the computational capabilities for capturing, storing, transmitting and processing data. However, ...

EPFL2018

The Mutual Information in Random Linear Estimation Beyond i.i.d. Matrices

Nicolas Macris, Florent Gérard Krzakala, Jean François Emmanuel Barbier

There has been definite progress recently in proving the variational single-letter formula given by the heuristic replica method for various estimation problems. In particular, the replica formula for the mutual information in the case of noisy linear esti ...

IEEE2018

Joint Inertial Sensor Orientation Drift Reduction for Highly Dynamic Movements

Kamiar Aminian, Benedikt Fasel, Julien Chardonnens

Inertial sensor drift is usually corrected on a single-sensor unit level. When multiple sensor units are used, mutual information from different units can be exploited for drift correction. This study introduces a method for a drift-reduced estimation of t ...

2018

Inferring interaction partners from protein sequences using mutual information

Anne-Florence Raphaëlle Bitbol

Functional protein-protein interactions are crucial in most cellular processes. They enable multi-protein complexes to assemble and to remain stable, and they allow signal transduction in various pathways. Functional interactions between proteins result in ...

2018

Unsupervised Change Detection in Satellite Images using Oversegmentation and Mutual Information

Bahar Taskesen, Beril Besbinar

In this paper, a novel solution to the problem of unsupervised change detection in bitemporal satellite images is presented. Information measures, which are well-known and commonly-used in the change detection literature, result in unsharp change maps and ...

Ieee2017

On the origin of primary 1/2 a(0) and a(0) loops in irradiated Fe(Cr) alloys

Robin Schäublin, Anna Prokhodtseva

The radiation-induced primary dislocation loops in thin foils of ultra-high purity Fe and Fe(Cr) model alloys were investigated using ion irradiation in situ in a TEM. In the '111 mechanism' the induced nanometric loops of type a(0) stem from mutual ...

Pergamon-Elsevier Science Ltd2017

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.