Concept

Entropy and life

Publications associées (36)

A 3.3-Gb/s SPAD-Based Quantum Random Number Generator

Edoardo Charbon, Pouyan Keshavarzian, Francesco Gramuglia, Mario Stipcevic

Quantum random number generators (QRNGs) are a burgeoning technology used for a variety of applications, including modern security and encryption systems. Typical methods exploit an entropy source combined with an extraction or bit generation circuit in or ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Learning curves for the multi-class teacher-student perceptron

Lenka Zdeborová, Elisabetta Cornacchia, Bruno Loureiro, Bruno Loureiro, Francesca Mignacco

One of the most classical results in high-dimensional learning theory provides a closed-form expression for the generalisation error of binary classification with a single-layer teacher-student perceptron on i.i.d. Gaussian inputs. Both Bayes-optimal (BO) ...

IOP Publishing Ltd2023

Towards Interactions Through Differentiable-Non-Differentiable Scale Transitions In Scale Relativity Theory

Maria-Alexandra Paun

It is shown that, in the framework of Scale Relativity Theory, correlations of type informational entropy/cross entropy - probability density, in the description of the dynamics of any complex system, can be perceived as interactions. Explaining these inte ...

UNIV POLITEHNICA BUCHAREST, SCI BULL2021

Differential Entropy of the Conditional Expectation under Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

This paper considers an additive Gaussian noise channel with arbitrarily distributed finite variance input signals. It studies the differential entropy of the minimum mean-square error (MMSE) estimator and provides a new lower bound which connects the diff ...

IEEE2021

Gaussian Process Regression for Maximum Entropy Distribution

Mohsen Sadr

Maximum-Entropy Distributions offer an attractive family of probability densities suitable for moment closure problems. Yet finding the Lagrange multipliers which parametrize these distributions, turns out to be a computational bottleneck for practical clo ...

2020

Theory of screw dislocation strengthening in random BCC alloys from dilute to "High-Entropy" alloys

William Curtin, Francesco Maresca

Random body-centered-cubic (BCC) "High Entropy" alloys are a new class of alloys, some having high strength and good ductility at room temperature and some having exceptional high-temperature strength. There are no theories of strengthening of screw disloc ...

PERGAMON-ELSEVIER SCIENCE LTD2020

Coarse-grained entropy production with multiple reservoirs: Unraveling the role of time scales and detailed balance in biology-inspired systems

Daniel Maria Busiello, Amos Maritan, Deepak Gupta

A general framework to describe a vast majority of biology-inspired systems is to model them as stochastic processes in which multiple couplings are in play at the same time. Molecular motors, chemical reaction networks, catalytic enzymes, and particles ex ...

2020

Entropy production for coarse-grained dynamics

Daniel Maria Busiello, Amos Maritan

Systems out of equilibrium exhibit a net production of entropy. We study the dynamics of a stochastic system represented by a Master equation (ME) that can be modeled by a Fokker-Planck equation in a coarse-grained, mesoscopic description. We show that the ...

2019

Gaussian Process Regression for Maximum Entropy Distribution

Mohsen Sadr

2019

Coding for Communications and Secrecy

Mani Bastaniparizi

Shannon, in his landmark 1948 paper, developed a framework for characterizing the fundamental limits of information transmission. Among other results, he showed that reliable communication over a channel is possible at any rate below its capacity. In 2008, ...

EPFL2017

Graph Chatbot

Chattez avec Graph Search

Posez n’importe quelle question sur les cours, conférences, exercices, recherches, actualités, etc. de l’EPFL ou essayez les exemples de questions ci-dessous.

AVERTISSEMENT : Le chatbot Graph n'est pas programmé pour fournir des réponses explicites ou catégoriques à vos questions. Il transforme plutôt vos questions en demandes API qui sont distribuées aux différents services informatiques officiellement administrés par l'EPFL. Son but est uniquement de collecter et de recommander des références pertinentes à des contenus que vous pouvez explorer pour vous aider à répondre à vos questions.

Connectez-vous pour utiliser Chat avec Graph Search