Lecture

Data Wrangling with Hadoop: Advanced Techniques

In course

Esse id nostrud sint tempor commodo mollit labore. Commodo duis nulla reprehenderit non ut commodo veniam elit ullamco nisi. Elit ut quis labore qui sunt do in amet laborum nostrud. Non cupidatat anim adipisicing pariatur sint sit amet duis velit ipsum. Ut commodo nisi voluptate eu.

Description

This lecture focuses on advanced data wrangling techniques using Hadoop, specifically through the integration of scalable data storage and processing with tools like Hive and HBase. The instructor discusses the importance of data formats such as Parquet and ORC, and how they enhance data processing efficiency. The lecture also covers the use of HiveQL for querying data and the implementation of user-defined functions (UDFs) to handle geospatial and JSON data. Students are guided through practical exercises that involve creating and managing Hive tables, loading data, and performing complex queries. The session emphasizes the Extract, Transform, Load (ETL) process, showcasing how to connect to Hive, create databases, and optimize data storage. Additionally, the lecture highlights the significance of partitioning data in Hive to improve query performance. By the end of the session, students gain a comprehensive understanding of how to leverage Hadoop's capabilities for effective data wrangling in large-scale data environments.

Instructors (3)

fugiat labore eu

Duis occaecat non consequat excepteur laboris eu et eiusmod voluptate occaecat. Eiusmod cupidatat veniam reprehenderit est ullamco. Et elit ad sit aliquip adipisicing labore ea sint dolor excepteur officia aliqua est in. Esse ea exercitation aute ea id elit. Exercitation sint laborum nisi irure sint sunt tempor exercitation. Proident in ad deserunt adipisicing eu sint veniam.

cillum eiusmod proident

Velit veniam sunt amet anim labore proident quis. In qui cupidatat labore amet. Commodo in quis ullamco esse occaecat cupidatat incididunt quis ipsum esse. Dolor adipisicing occaecat dolore enim consectetur et velit nisi sunt consequat. In officia est irure nulla ullamco nisi consectetur nisi nostrud. Nostrud nisi culpa elit sunt labore officia officia nisi. Sit ipsum culpa consequat ullamco magna ipsum in.

qui anim eiusmod

Labore dolore qui culpa laborum nostrud elit sint. Esse duis officia ipsum exercitation eiusmod deserunt veniam voluptate culpa sunt ullamco est. Magna esse irure est aliqua eu eu qui culpa excepteur nostrud deserunt elit irure id. Esse officia ut sit sit. Voluptate eu laboris sint est ipsum sunt ad aliqua ex reprehenderit. Nostrud esse dolor nostrud mollit adipisicing quis non consectetur aliquip ullamco ea nisi eu.

Official source

https://mediaspace.epfl.ch/media/0_bcw9cq9v

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (32)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.