Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
Lecture
Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture introduces Spark Data Frames, discussing their origin, performance advantages over RDDs, and when to use them. It covers the Catalyst Optimizer, PySpark integration, and the transition to DataSets. The instructor also explores the analysis of the Gutenberg corpus using Spark.