Concept
Mutual information
Related lectures (82)
Supervised Learning: Decision Trees
Covers supervised learning with decision trees and feature selection for classification.
Protein Structure Prediction
Delves into predicting protein structure through amino acid contact analysis and advanced computational methods.
Quantifying Statistical Dependence
Delves into quantifying statistical dependence through covariance, correlation, and mutual information.
Generalization Error
Discusses mutual information, data processing inequality, and properties related to leakage in discrete systems.
Decision Trees: Overfitting and Randomization
Explores decision trees, overfitting, and randomization in supervised learning, emphasizing the importance of managing variance and feature selection.
Mutual Information: Understanding Random Variables
Explores mutual information, quantifying relationships between random variables and measuring information gain and statistical dependence.
Information Theory: Review and Mutual Information
Reviews information measures like entropy and introduces mutual information as a measure of information between random variables.
Information Theory: Channel Capacity and Convex Functions
Explores channel capacity and convex functions in information theory, emphasizing the importance of convexity.
Introduction: Course Structure and Fundamentals of Computing
Explores the role of Computing in society and the basics of computing, algorithms, communication systems, and computer security.
Random Walks and Moran Model in Population Genetics
Explores random walks, Moran model, bacterial chemotaxis, entropy, information theory, and coevolving sites in proteins.