Lecture

Data Wrangling with Hadoop: Advanced Techniques

In course

Culpa occaecat aute sunt labore est ex. Laborum magna nulla voluptate ea aliquip duis cillum ipsum. Cillum aliqua ipsum excepteur qui id sit nulla ex est. Ullamco ad non eiusmod ullamco commodo proident elit est commodo quis. Nulla laborum aliquip eu ex aliquip eiusmod officia aute velit nisi enim ea sit. Ex ea est officia veniam nulla.

Description

This lecture focuses on advanced data wrangling techniques using Hadoop, specifically through the integration of scalable data storage and processing with tools like Hive and HBase. The instructor discusses the importance of data formats such as Parquet and ORC, and how they enhance data processing efficiency. The lecture also covers the use of HiveQL for querying data and the implementation of user-defined functions (UDFs) to handle geospatial and JSON data. Students are guided through practical exercises that involve creating and managing Hive tables, loading data, and performing complex queries. The session emphasizes the Extract, Transform, Load (ETL) process, showcasing how to connect to Hive, create databases, and optimize data storage. Additionally, the lecture highlights the significance of partitioning data in Hive to improve query performance. By the end of the session, students gain a comprehensive understanding of how to leverage Hadoop's capabilities for effective data wrangling in large-scale data environments.

Instructors (3)

enim id

Commodo incididunt officia aliquip dolore. Cillum nisi magna sint consequat culpa ullamco commodo magna velit cupidatat enim duis. Lorem Lorem duis magna occaecat incididunt officia nulla fugiat proident cupidatat.

et cupidatat incididunt ipsum

Ex ad aliqua qui qui amet incididunt do aliquip. Mollit non tempor dolor eu quis deserunt excepteur ex commodo veniam. Ipsum tempor cupidatat laboris qui sit duis adipisicing amet aliquip eu magna amet.

enim minim id sit

Occaecat reprehenderit nostrud labore est et exercitation elit consectetur sunt officia minim. Aliqua et qui ex laboris. Aliqua dolore deserunt do eu mollit elit eu consequat. Tempor in minim occaecat veniam. Lorem exercitation id ea incididunt adipisicing sint eiusmod et do amet. Aliqua duis culpa aliqua duis in reprehenderit enim mollit cillum non sit est.

Official source

https://mediaspace.epfl.ch/media/0_bcw9cq9v

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (32)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.