Concept
Cross-entropy
Related publications (133)
Exact solution for the conditional entropy of Poissonian LDPC codes over the Binary Erasure Channel
Nicolas Macris, Satish Babu Korada, Shrinivas Kudekar
We consider communication over a binary erasure channel with low density parity check codes and optimal maximum a posteriori decoding. It is known that the problem of computing the average conditional entropy, over such code ensembles, in the asymptotic li ...
2007ON THE INEQUALITIES IN INFORMATION THEORY
Claude Elwood Shannon in 1948, then of the Bell Labs, published one of the ground breaking papers in the history of engineering [1]. This paper (”A Mathematical Theory of Communication”, Bell System Tech. Journal, Vol. 27, July and October 1948, pp. 379 - ...
2007An Acoustic Model Based on Kullback-Leibler Divergence for Posterior Features
Hervé Bourlard, Guillermo Aradilla
This paper investigates the use of features based on posterior probabilities of subword units such as phonemes. These features are typically transformed when used as inputs for a hidden Markov model with mixture of Gaussians as emission distribution (HMM/G ...
2007Multi-stream ASR: An Oracle Perspective
Multi-stream based automatic speech recognition (ASR) systems outperform their single stream counterparts, specially in case of noisy speech. The main issues in multi-stream systems are: a) Find the feature streams carrying complementary information, and b ...
2006Power-Efficient Sensor Placement and Transmission Structure for Data Gathering under Distortion Constraints
We consider the joint optimization of sensor placement and transmission structure for data gathering, where a given number of nodes need to be placed in a field such that the sensed data can be reconstructed at a sink within specified distortion bounds whi ...
2006Network Correlated Data Gathering with Explicit Communication: NP-Completeness and Algorithms
Martin Vetterli, Razvan Cristescu
We consider the problem of correlated data gathering by a network with a sink node and a tree based communication structure, where the goal is to minimize the total trans- mission cost of transporting the information collected by the nodes, to the sink nod ...
2006Multi-stream Processing for Noise Robust Speech Recognition
In this thesis, the framework of multi-stream combination has been explored to improve the noise robustness of automatic speech recognition (ASR) systems. The central idea of multi-stream ASR is to combine information from several sources to improve the pe ...
IDIAP2006Multi-stream processing for noise robust speech recognition
In this thesis, the framework of multi-stream combination has been explored to improve the noise robustness of automatic speech recognition (ASR) systems. The central idea of multi-stream ASR is to combine information from several sources to improve the pe ...
EPFL2006