Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
Lecture
Spark Data Frames: Overview and Performance Analysis
Description
This lecture introduces Spark Data Frames, discussing their origin, performance advantages over RDDs, and when to use them. It covers the Catalyst Optimizer, PySpark integration, and the transition to DataSets. The instructor also explores the analysis of the Gutenberg corpus using Spark.
Official source
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.