Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
Lecture
Memory-Efficient Adaptive Optimization
Description
This lecture covers memory-efficient adaptive optimization for humungous-scale learning, focusing on joint work with Rohan Anil, Tomer Koren, and Vineet Gupta. Topics include deep non-linear learning, convex optimization, and preconditioning techniques. The instructor discusses the challenges of memory overhead in training large models and the practical applications of adaptive regularization methods.
Official source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.