Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers resource management in Spark, focusing on architectural choices, fault tolerance, data safety, job recovery, and the limitations of vanilla Spark. It also delves into Spark SQL, data frames, DataFrame operators, user-defined functions, and optimization principles.