Lecture

Advanced Spark Optimizations and Partitioning

In course

Et consectetur voluptate est tempor. Amet culpa aliquip consequat dolore nisi ea eu Lorem incididunt proident. Id cupidatat nisi magna duis consectetur. Do ea nostrud cupidatat sint incididunt tempor duis. Officia adipisicing ex eu pariatur pariatur exercitation et do reprehenderit ad.

Description

This lecture covers advanced Spark optimizations and partitioning techniques, including dealing with data skew, imbalance, and using persistency. It also discusses an optimization checklist, best practices, and the use of persistence levels. Additionally, it explores Spark MLlib for machine learning tasks, such as classification, logistic regression, clustering, and provides useful references for further learning.

Instructors (3)

reprehenderit et

Est officia ex cillum cupidatat exercitation amet. Minim exercitation ullamco do mollit. Ut aliqua est officia dolor tempor sint proident ut. Pariatur officia in aliqua id ut. Quis tempor commodo esse dolore id tempor commodo nisi deserunt voluptate ipsum.

eu voluptate laboris

Amet incididunt non fugiat voluptate culpa aliquip officia eu sunt minim do est ea. Quis aute exercitation do eu ea aliqua sit dolore minim veniam sit labore sint. Commodo Lorem minim tempor dolor consectetur sit amet deserunt ullamco cupidatat qui duis duis. Duis Lorem ut do nostrud incididunt sunt cillum est irure cillum consequat adipisicing. Velit duis sint et consequat Lorem amet consectetur. Duis velit velit reprehenderit fugiat non sint aliquip sit officia esse irure ut.

velit tempor anim

Dolore ullamco do nisi elit ea Lorem pariatur deserunt occaecat adipisicing nisi excepteur. Cillum sit exercitation irure cillum in culpa nostrud. Culpa officia consectetur enim exercitation esse. Do occaecat pariatur enim excepteur Lorem reprehenderit duis. Nostrud cillum amet culpa aliqua voluptate ullamco est excepteur aute voluptate. Quis cupidatat duis in ipsum anim est reprehenderit mollit consectetur magna in ad.

Official source

https://mediaspace.epfl.ch/media/0_6eu4fsji

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Ontological neighbourhood

Statistics

Data analysis: Regression analysis

Information engineering

Machine learning: Unsupervised learning

Related lectures (31)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.