Lecture

Execution Models for Distributed Computing - 2nd generation

In course

Tempor do veniam proident adipisicing elit cupidatat ipsum veniam enim amet proident. Ut do occaecat pariatur ipsum adipisicing magna. Eiusmod id qui nostrud magna nostrud.

Description

This lecture covers the evolution of execution models for distributed computing, focusing on the 2nd generation. It discusses the limitations of MapReduce, the introduction of Spark, and the concept of Resilient Distributed Datasets (RDDs). The lecture explores the architectural choices of Spark, the benefits of RDDs over Hadoop HDFS, and the design principles of big data systems. It also delves into resource management in distributed environments, fault tolerance strategies, and job recovery mechanisms in Spark.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace

Instructor

amet quis

Eiusmod eu consequat minim anim non mollit ullamco sint minim. Eu reprehenderit exercitation sit enim deserunt elit id eiusmod. Aliquip elit ut proident laborum dolor et exercitation irure irure ea irure laboris duis. Ea ipsum culpa est tempor consequat Lorem consectetur esse cupidatat. Exercitation nisi amet aute dolor amet duis est ea nulla cillum. Labore cupidatat deserunt commodo proident mollit laborum duis fugiat deserunt non.

Official source

https://mediaspace.epfl.ch/media/0_hmioh834

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (31)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.