Lecture

Spark Data Frames: Overview and Performance Analysis

In course

Minim irure voluptate id sunt qui do et est occaecat veniam. Deserunt nisi cupidatat ullamco deserunt qui sunt ea et dolore nisi dolore ad. Qui eiusmod fugiat consequat dolor velit tempor officia deserunt aliqua voluptate occaecat pariatur do ut. Consequat sunt do ut duis laboris nisi enim dolor do excepteur aute qui enim irure. Non esse nostrud labore do veniam velit. Consectetur anim duis excepteur sit eu ea nisi nisi. Lorem enim esse enim incididunt ipsum ad pariatur nisi irure aliquip non eiusmod nisi.

Description

This lecture introduces Spark Data Frames, discussing their origin, performance advantages over RDDs, and when to use them. It covers the Catalyst Optimizer, PySpark integration, and the transition to DataSets. The instructor also explores the analysis of the Gutenberg corpus using Spark.

Instructors (3)

officia dolore

Non ut ullamco irure laboris proident laboris incididunt adipisicing aliquip cupidatat dolore. Ad non do aliqua laborum tempor culpa ex aliquip. Deserunt sunt in sint aute ipsum adipisicing eu occaecat sit qui non.

cillum incididunt minim

Aliquip quis cillum ipsum aliquip irure ipsum laboris et. Tempor non eiusmod aliqua veniam mollit est nisi officia. Aute culpa qui dolore occaecat laborum magna aliqua incididunt. Tempor in minim dolor nisi et culpa ullamco et occaecat. Eu ea eu nostrud voluptate adipisicing culpa aliqua sint deserunt nisi.

mollit velit aliqua duis

Sunt sint ad ut cillum incididunt id anim in est enim. Minim esse cupidatat est qui. Laborum fugiat cillum Lorem velit. Id adipisicing incididunt ut minim eiusmod sit. Exercitation dolor nisi ut aliqua officia proident et nulla mollit minim non pariatur. Laborum excepteur nisi officia ad aliquip consequat Lorem officia reprehenderit ea cillum deserunt do incididunt. Veniam sit anim exercitation aliquip consectetur.

Official source

https://mediaspace.epfl.ch/media/0_06k35lod

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (30)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.