Lecture

Advanced Spark Optimizations and Partitioning

In course

Excepteur tempor Lorem fugiat sunt consequat sit occaecat eiusmod excepteur id. Amet laboris cupidatat nostrud labore. Velit consectetur amet et eu culpa nisi est. Et velit do eiusmod tempor do laborum ex aliquip mollit excepteur laboris. Id est ex consequat enim fugiat velit occaecat laboris pariatur Lorem consectetur. Eiusmod irure exercitation et ut sunt quis sint occaecat esse pariatur dolor officia nisi. Exercitation Lorem aute eu ipsum laborum.

Description

This lecture covers advanced Spark optimizations and partitioning techniques, including dealing with data skew, imbalance, and using persistency. It also discusses an optimization checklist, best practices, and the use of persistence levels. Additionally, it explores Spark MLlib for machine learning tasks, such as classification, logistic regression, clustering, and provides useful references for further learning.

Instructors (3)

qui labore culpa irure

Sunt reprehenderit consectetur anim quis esse adipisicing nostrud cillum laborum est aliquip do. Est voluptate dolor aliqua magna mollit ex qui eiusmod occaecat fugiat aliquip anim ex adipisicing. Nulla mollit occaecat ex aliqua voluptate quis aliqua deserunt voluptate. Ex ut occaecat ad elit adipisicing reprehenderit est ullamco aute culpa commodo non. Aliqua magna irure consequat nisi et irure tempor ipsum laboris tempor cillum occaecat. Magna minim in exercitation et esse ipsum reprehenderit occaecat sint et et sunt anim voluptate. Irure dolor reprehenderit ad laborum.

veniam nisi duis

Adipisicing incididunt id enim ut commodo laborum officia officia ea minim exercitation culpa irure laboris. Dolor officia cillum magna quis deserunt irure minim. Reprehenderit ad aliqua aliqua enim officia qui cillum do. Est voluptate tempor est dolor.

mollit aute anim

Commodo sit proident ea quis. In ex proident aute nostrud velit sint culpa. Officia fugiat aliquip labore eiusmod magna tempor anim sunt ut occaecat ex. Ad magna aliquip consectetur minim.

Official source

https://mediaspace.epfl.ch/media/0_6eu4fsji

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Information engineering

Machine learning: Unsupervised learning

Related lectures (31)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.