Lecture
Resource Management and Fault Tolerance
Description
This lecture covers the design choices of Big Data systems, focusing on storage layer, programming model, execution engine, resource management, and fault tolerance. It explains how systems like Yarn enable multiple frameworks to co-exist, decisions of varying granularities in resource management, architectural choices of Spark, and the importance of fault tolerance in the face of hardware/software failures. The lecture also discusses data safety, job recovery in Spark, and the impact of failures on performance.
This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.
Watch on MediaspaceOfficial source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.