Publications related to Rényi entropy

Orthogonality of Two-Dimensional Separations Based on Conditional Entropy

Hubert Girault, Mohammad Reza Pourhaghighi, Mohammad Karzand

A new approach to assess the orthogonality of two-dimensional (2-D) separation systems based on conditional entropy is developed. It considers the quantitative distribution of peaks in the entire separation space such that the orthogonality obtained is ind ...

American Chemical Society2011

Polarization and randomness extraction

Emmanuel Abbé

This paper explores a connection between randomness extraction and channel (source) coding problems. It is explained how efficient extractors can be used to define efficient coding schemes and reciprocally, a new deterministic extractor based on a polar co ...

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2011

Accounting for Observational Uncertainty in Forecast Verification: An Information-Theoretical View on Forecasts, Observations, and Truth

Steven Vincent Weijs, Nicolaas Cornelis van de Giesen

Recently, an information-theoretical decomposition of Kullback–Leibler divergence into uncertainty, reliability, and resolution was introduced. In this article, this decomposition is generalized to the case where the observation is uncertain. Along with a ...

2011

Compression with Graphical Constraints: An Interactive Browser

Amin Karbasi, Morteza Zadimoghaddam

We study the problem of navigating/searching through a database of objects with potentially different popularities using a membership oracle. The membership oracle, given a subset of objects

A

, and a target object

t

, determines whether

A

contains

t

...

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2011

Polar Coding Theorems for Discrete Systems

Eren Sasoglu

Polar coding is a recently invented technique for communication over binary-input memoryless channels. This technique allows one to transmit data at rates close to the symmetric-capacity of such channels with arbitrarily high reliability, using low-complex ...

EPFL2011

A novel framework for noise robust ASR using cochlear implant-like spectrally reduced speech

We propose a novel framework for noise robust automatic speech recognition (ASR) based on cochlear implant-like spectrally reduced speech (SRS). Two experimental protocols (EPs) are proposed in order to clarify the advantage of using SRS for noise robust A ...

2011

Kullback–Leibler Divergence as a Forecast Skill Score with Classic Reliability–Resolution–Uncertainty Decomposition

Steven Vincent Weijs, Nicolaas Cornelis van de Giesen

This paper presents a score that can be used for evaluating probabilistic forecasts of multicategory events. The score is a reinterpretation of the logarithmic score or ignorance score, now formulated as the relative entropy or Kullback–Leibler divergence ...

2010

An entropy inequality for q-ary random variables and its application to channel polarization

Eren Sasoglu

It is shown that given two copies of a q-ary input channel W, where q is prime, it is possible to create two channels W- and W+ whose symmetric capacities satisfy I(W-)

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2010

An Information Theoretic Approach to Speaker Diarization of Meeting Recordings

Deepu Vijayasenan

In this thesis we investigate a non parametric approach to speaker diarization for meeting recordings based on an information theoretic framework. The problem is formulated using the Information Bottleneck (IB) principle. Unlike other approaches where the ...

EPFL2010

Why hydrological predictions should be evaluated using information theory

Steven Vincent Weijs, Nicolaas Cornelis van de Giesen

Probabilistic predictions are becoming increasingly popular in hydrology. Equally important are methods to test such predictions, given the topical debate on uncertainty analysis in hydrology. Also in the special case of hydrological forecasting, there is ...

2010

Rényi entropy

Graph Chatbot

Chat with Graph Search

Orthogonality of Two-Dimensional Separations Based on Conditional Entropy

Polarization and randomness extraction

Accounting for Observational Uncertainty in Forecast Verification: An Information-Theoretical View on Forecasts, Observations, and Truth

Compression with Graphical Constraints: An Interactive Browser

Polar Coding Theorems for Discrete Systems

A novel framework for noise robust ASR using cochlear implant-like spectrally reduced speech

Kullback–Leibler Divergence as a Forecast Skill Score with Classic Reliability–Resolution–Uncertainty Decomposition

An entropy inequality for q-ary random variables and its application to channel polarization

An Information Theoretic Approach to Speaker Diarization of Meeting Recordings

Why hydrological predictions should be evaluated using information theory

A novel framework for noise robust ASR using cochlear implant-like spectrally reduced speech

Polarization and randomness extraction

Compression with Graphical Constraints: An Interactive Browser

An entropy inequality for q-ary random variables and its application to channel polarization

Kullback–Leibler Divergence as a Forecast Skill Score with Classic Reliability–Resolution–Uncertainty Decomposition

An Information Theoretic Approach to Speaker Diarization of Meeting Recordings

Why hydrological predictions should be evaluated using information theory

Orthogonality of Two-Dimensional Separations Based on Conditional Entropy

Accounting for Observational Uncertainty in Forecast Verification: An Information-Theoretical View on Forecasts, Observations, and Truth

Polar Coding Theorems for Discrete Systems