Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers Spark Data Frames, which are distributed collections of data organized into rows of named columns, similar to relational database tables. The Catalyst Optimizer is discussed, along with the benefits of using Data Frames over RDDs. The lecture also touches on the origin of Data Frames, their performance advantages, and when to choose between RDDs and Data Frames.