This lecture covers linear regression, which finds a linear mapping between input and output, and weighted linear regression, where points have different weights. It also discusses limitations of linear regression and introduces locally weighted regression for model-free regression.