Publication
Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain
Related publications (51)
Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition
Pasquale Davide Schiavone, Elisa Donati
Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface ele ...
SPRINGER INTERNATIONAL PUBLISHING AG2023Information Spectrum Converse for Minimum Entropy Couplings and Functional Representations
Given two jointly distributed random variables (X,Y), a functional representation of X is a random variable Z independent of Y, and a deterministic function g(⋅,⋅) such that X=g(Y,Z). The problem of finding a minimum entropy functional representation is kn ...
2023A Functional Perspective on Information Measures
Since the birth of Information Theory, researchers have defined and exploited various information measures, as well as endowed them with operational meanings. Some were born as a "solution to a problem", like Shannon's Entropy and Mutual Information. Other ...
EPFL2022A taxonomy of surprise definitions
Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi
Surprising events trigger measurable brain activity and influence human behavior by affecting learning, memory, and decision-making. Currently there is, however, no consensus on the definition of surprise. Here we identify 18 mathematical definitions of su ...
2022A Comparison of optimal measurement-system design with engineering judgement for bridge load testing
Due to conservative approaches in construction design and practice, infrastructure often has hidden reserve capacity. When quantified, this reserve has potential to improve decisions related to asset management. Field measurements, collected through load t ...
2021Learning in Volatile Environments With the Bayes Factor Surprise
Wulfram Gerstner, Johanni Michael Brea, Alireza Modirshanechi, Vasiliki Liakoni
Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...
MIT PRESS2021Iron incorporation in synthetic precipitated calcium silicate hydrates
David Lyndon Emsley, Paul Bowen, Brennan James Walder, Jirawan Siramanont
Effect of Fe3+ on the precipitation of synthetic calcium silicate hydrates (C-S-H) under controlled conditions has been evaluated. Using extremely basic either initial calcium nitrate or sodium silicate solutions (pH > 11), incipient formation of ferrihydr ...
2021Wasserstein Distributionally Robust Learning
Many decision problems in science, engineering, and economics are affected by uncertainty, which is typically modeled by a random variable governed by an unknown probability distribution. For many practical applications, the probability distribution is onl ...
EPFL2020Measurement-system design for structural identification
In developed countries, the management of existing civil infrastructure is challenging due to evolving functional requirements, aging and climate change. Due to conservative approaches in construction design and practice, infrastructure often has hidden re ...
EPFL2020Robust Generalization via $\alpha$-Mutual Information
Michael Christoph Gastpar, Amedeo Roberto Esposito, Ibrahim Issa
The aim of this work is to provide bounds connecting two probability measures of the same event using Rényi -Divergences and Sibson’s -Mutual Information, a generalization of respectively the Kullback-Leibler Divergence and Shannon’s Mutual ...
ETHZ2020