This lecture delves into the concept of mutual information, focusing on quantifying statistical dependence between variables. It covers the definition of mutual information, its properties, and its role in identifying coevolving sites in interacting proteins. The lecture also explores inferring probability distributions from data, including model selection, parameter estimation, and predicting protein structure from sequence data.