Publications related to Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface ele ...

SPRINGER INTERNATIONAL PUBLISHING AG2023

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is kn ...

2023

A Functional Perspective on Information Measures

Amedeo Roberto Esposito

Since the birth of Information Theory, researchers have defined and exploited various information measures, as well as endowed them with operational meanings. Some were born as a "solution to a problem", like Shannon's Entropy and Mutual Information. Other ...

EPFL2022

A taxonomy of surprise definitions

Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi

Surprising events trigger measurable brain activity and influence human behavior by affecting learning, memory, and decision-making. Currently there is, however, no consensus on the definition of surprise. Here we identify 18 mathematical definitions of su ...

2022

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Ian Smith, Numa Joy Bertola

Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...

2021

Learning in Volatile Environments With the Bayes Factor Surprise

Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi, Vasiliki Liakoni

Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...

MIT PRESS2021

Iron incorporation in synthetic precipitated calcium silicate hydrates

David Lyndon Emsley, Paul Bowen, Brennan James Walder, Jirawan Siramanont

Effect of Fe3+ on the precipitation of synthetic calcium silicate hydrates (C-S-H) under controlled conditions has been evaluated. Using extremely basic either initial calcium nitrate or sodium silicate solutions (pH > 11), incipient formation of ferrihydr ...

2021

Wasserstein Distributionally Robust Learning

Soroosh Shafieezadeh Abadeh

Many decision problems in science, engineering, and economics are affected by uncertainty, which is typically modeled by a random variable governed by an unknown probability distribution. For many practical applications, the probability distribution is onl ...

EPFL2020

Measurement-system design for structural identification

Numa Joy Bertola

In developed countries, the management of existing civil infrastructure is challenging due to evolving functional requirements, aging and climate change. Due to conservative approaches in construction design and practice, infrastructure often has hidden re ...

EPFL2020

Robust Generalization via $\alpha$-Mutual Information

Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa

The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi

\alpha

-Divergences and Sibson’s

\alpha

-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...

ETHZ2020

Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain

Graph Chatbot

Chat with Graph Search

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A Functional Perspective on Information Measures

A taxonomy of surprise definitions

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Learning in Volatile Environments With the Bayes Factor Surprise

Iron incorporation in synthetic precipitated calcium silicate hydrates

Wasserstein Distributionally Robust Learning

Measurement-system design for structural identification

Robust Generalization via $\alpha$-Mutual Information

Iron incorporation in synthetic precipitated calcium silicate hydrates

Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations

A Functional Perspective on Information Measures

A taxonomy of surprise definitions

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

A Comparison of optimal measurement-system design with engineering judgement for bridge load testing

Learning in Volatile Environments With the Bayes Factor Surprise

Wasserstein Distributionally Robust Learning

Measurement-system design for structural identification

Robust Generalization via $\alpha$-Mutual Information