Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
Lecture
Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture delves into resource management in distributed computing frameworks, focusing on static resource allocation and the concept of resource containers. The instructor explains how static allocation can lead to cluster underutilization and introduces the idea of resource containers as a more flexible approach. By using YARN as a case study, the lecture showcases how resource containers centralize resource management, enabling multiple frameworks to coexist harmoniously and scale efficiently.