Spark Ecosystem: Architectural Choices

In course

Elit et laboris eiusmod sunt nulla velit qui consequat nostrud duis enim aute ea. Velit duis labore consectetur cupidatat laborum ullamco tempor dolore quis. Duis reprehenderit cupidatat commodo esse eu reprehenderit cillum aliqua cupidatat. Consectetur id id occaecat velit non officia sit esse dolor pariatur anim. Cupidatat consequat dolore in duis adipisicing nulla esse qui sunt sint aliqua adipisicing. Amet qui exercitation officia nulla magna aliqua veniam.

Description

This lecture covers the Spark ecosystem, focusing on architectural choices such as the storage layer, programming models, fault tolerance, and RDDs. It discusses the limitations of MapReduce, the advantages of Spark's Resilient Distributed Datasets (RDDs), and the data flow model. The instructor explains how Spark improves expressiveness, extensibility, and performance by utilizing distributed RAM and enabling additional optimizations. Examples from Apache Spark, Microsoft, and Google are used to illustrate the concepts.

Instructor

reprehenderit ea occaecat

Excepteur commodo incididunt esse laborum eiusmod magna consequat nostrud commodo eu eiusmod Lorem duis magna. Sunt culpa qui nostrud aliquip occaecat cupidatat Lorem. Amet laborum Lorem qui consequat ipsum minim nostrud voluptate. Id nulla non ex sit in exercitation non laborum.

Official source

https://mediaspace.epfl.ch/media/0_ah0guphk

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Computer engineering

Computer programming: Compilers

Related lectures (72)