Lecture
Stochastic Softmax Tricks
Description
This lecture delves into stochastic softmax tricks, focusing on the reparametrization trick and the stochastic argmax trick. It explores the challenges of expectation estimation and provides examples of optimizing paths in different scenarios. The lecture also discusses the high variance in gradient estimation and the use of relaxed estimators to reduce it.
Official source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.