Concept
Conditional entropy
Related publications (38)
Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise
Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik
The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential entropy of the co ...
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022The Gray-Wyner Network and Wyner's Common Information for Gaussian Sources
Michael Christoph Gastpar, Erixhen Sula
This paper presents explicit solutions for two related non-convex information extremization problems due to Gray and Wyner in the Gaussian case. The first problem is the Gray-Wyner network subject to a sum-rate constraint on the two private links. Here, ou ...
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022Towards Measuring the Amount of Discriminatory Information in Finger Vein Biometric Characteristics Using a Relative Entropy Estimator
This chapter makes the first attempt to quantify the amount of discriminatory information in finger vein biometric characteristics in terms of Relative Entropy (RE) calculated on genuine and impostor comparison scores using a Nearest Neighbour (NN) estimat ...
Springer Open2019Fisher–Shannon Complexity Analysis of High-Frequency Urban Wind Speed Time Series
Dasaraden Mauree, Fabian Guignard
One-hertz wind time series recorded at different levels (from 1.5–25.5 m) in an urban area are investigated by using the Fisher–Shannon (FS) analysis. FS analysis is a well-known method to gain insight into the complex behavior of nonlinear systems, by qua ...
2019Dimension-free Information Concentration via Exp-Concavity
Information concentration of probability measures have important implications in learning theory. Recently, it is discovered that the information content of a log-concave distribution concentrates around their differential entropy, albeit with an unpleasan ...
2018