Spark Ecosystem: Architectural Choices

In course

Qui id laborum incididunt laborum do nisi magna aliqua. Minim tempor Lorem cillum elit ad id culpa sunt consequat. Amet deserunt cupidatat non officia reprehenderit Lorem qui pariatur ex do ad exercitation ex non. Dolore cillum labore laborum irure dolore.

Description

This lecture covers the Spark ecosystem, focusing on architectural choices such as the storage layer, programming models, fault tolerance, and RDDs. It discusses the limitations of MapReduce, the advantages of Spark's Resilient Distributed Datasets (RDDs), and the data flow model. The instructor explains how Spark improves expressiveness, extensibility, and performance by utilizing distributed RAM and enabling additional optimizations. Examples from Apache Spark, Microsoft, and Google are used to illustrate the concepts.

Instructor

Sunt velit dolore ut sit sunt ea qui mollit. Ut id ea non magna mollit eu anim. Duis irure ex do dolore ad esse magna minim labore ut non nisi. Ad ea deserunt exercitation Lorem deserunt ullamco aliquip Lorem reprehenderit cillum do Lorem ullamco. Ad id aliqua est enim velit sunt ad nisi exercitation veniam mollit deserunt ad. Aute est cillum anim ut quis aute laborum excepteur et minim amet ea aliquip laboris.

Official source

https://mediaspace.epfl.ch/media/0_ah0guphk

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Computer engineering

Computer programming: Compilers

Related lectures (72)