This lecture explores the use of simulations in Human-Robot Interaction (HRI), focusing on learning from human expertise and preferences. The instructor discusses user models for simulation, estimating expertise and reward from human demonstrations, system models, and simulation results. Additionally, the lecture covers learning with pedestrian simulations, user models for simulation, and learning to assist drone landings. Experimental results and a simulated user model are presented, along with discussions on user adaptation and closing questions on modeling human behavior in HRI.