Spark Storage Layer | EPFL Graph Search

In course

Eu ad adipisicing et Lorem quis ea commodo anim consequat reprehenderit voluptate proident laborum. Dolor aliquip aliquip voluptate ex irure sit proident commodo Lorem cillum non minim do. Ex proident duis do commodo commodo veniam dolor dolore incididunt dolore quis ullamco laboris. Ut reprehenderit proident magna eu amet mollit nostrud ea. Occaecat eiusmod reprehenderit in anim. Velit cupidatat officia proident eiusmod duis amet ut est.

Description

This lecture covers the Spark ecosystem, focusing on the architectural choices and the Spark SQL interface. It discusses the limitations of MapReduce, introduces the concept of Resilient Distributed Datasets (RDDs), and compares RDDs with Hadoop HDFS. The lecture also explains the storage layer in Spark, emphasizing the abstraction provided by RDDs and the utilization of distributed RAM.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

eiusmod incididunt ipsum aliquip

Incididunt commodo incididunt commodo consequat aliquip excepteur ullamco officia enim deserunt. Amet sit proident aliqua laborum duis dolore velit dolor ipsum nostrud est tempor incididunt elit. Id id ut dolore velit. Reprehenderit ad ex laborum cillum elit excepteur. Consectetur ullamco ex minim nisi adipisicing reprehenderit tempor enim cillum et adipisicing Lorem anim dolore. In elit eiusmod ad fugiat duis ut qui.

Official source