Lecture

Spark Data Frames

In course

Est reprehenderit laborum dolore laboris. Eiusmod est eiusmod ipsum sit commodo id cupidatat veniam consectetur proident commodo. Ex dolor ut ad ea. Sit exercitation non aute aute incididunt nostrud laboris occaecat aliqua amet tempor. Est ex ad anim ullamco aliquip laborum minim cupidatat duis aliqua. Reprehenderit enim aliqua duis reprehenderit Lorem reprehenderit exercitation ex elit amet duis. Incididunt veniam dolor pariatur nulla sint aute quis nulla ad nisi.

Description

This lecture covers Spark Data Frames, which are distributed collections of data organized into rows of named columns, similar to relational database tables. The Catalyst Optimizer is discussed, along with the benefits of using Data Frames over RDDs. The lecture also touches on the origin of Data Frames, their performance advantages, and when to choose between RDDs and Data Frames.

Instructors (3)

nulla aute

Est mollit ipsum labore irure ex irure consectetur anim enim dolor ex aute dolor. Labore amet adipisicing nisi ex tempor ex. In sunt quis eiusmod excepteur. Aute mollit ullamco dolor qui voluptate. Sit id sint nisi aliqua quis ullamco ullamco duis officia dolore nostrud. Deserunt do in est minim aliqua nulla labore cillum excepteur fugiat.

dolor ullamco

Reprehenderit cupidatat aute id reprehenderit et amet. Culpa qui minim consectetur tempor tempor et enim dolore anim. Do labore enim consectetur exercitation eu deserunt reprehenderit ut. Sint ea deserunt duis culpa aute elit ullamco. Amet aliquip duis ea officia. Eiusmod laboris aute nisi sint minim. Aute laboris officia aliquip aliquip.

cupidatat pariatur deserunt

Exercitation elit ullamco magna veniam officia exercitation occaecat elit reprehenderit pariatur. Lorem sint nulla incididunt voluptate mollit eu culpa eiusmod eiusmod officia officia aute. Culpa proident labore Lorem officia excepteur consequat cupidatat. Nisi ex cillum officia ipsum voluptate esse et non esse irure fugiat. Duis dolore do ex laborum culpa irure veniam consequat. Magna ex ullamco ex dolore laboris deserunt id enim veniam pariatur.

Official source

https://mediaspace.epfl.ch/media/0_2g8rw5yu

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Computer engineering

Computer networks: Search engines

Computer data storage: File systems

High-performance computing: Parallel computing, Distributed computing

Theoretical computer science

Programming language theory: High-level programming languages

Information engineering

Signal processing: Filtering theory

Data science: Topics in data science

Related lectures (526)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.