Lecture

Data Wrangling Techniques: HBase and Hive Integration

In course

Cupidatat do ex culpa culpa. Et minim duis amet quis. Deserunt ipsum duis enim cupidatat Lorem eu voluptate irure. Anim voluptate fugiat adipisicing laboris tempor amet mollit ipsum proident laborum sunt. Consectetur cupidatat Lorem labore duis in in minim mollit eu ex id pariatur id ad.

Description

This lecture provides an in-depth overview of data wrangling techniques using HBase and Hive. It begins with a general introduction to data science tools such as Python, Jupyter notebooks, and Spark. The instructor discusses the differences between HDFS and Hive, emphasizing the strengths and weaknesses of each in handling big data. The lecture covers the architecture of HBase, including its column-oriented data model and the importance of key design for efficient data retrieval. The integration of Hive with HBase is also explored, highlighting how Hive can be used to perform queries on data stored in HBase. The session includes practical exercises on using Hive with JSON data and user-defined functions (UDFs). The lecture concludes with a summary of the best practices for using HDFS, Hive, and HBase, providing students with a comprehensive understanding of how to effectively manage and query large datasets in a distributed environment.

Instructors (3)

voluptate non ea

Duis est deserunt proident laborum cillum officia deserunt laboris tempor minim aliqua ullamco. Proident nisi ipsum deserunt veniam aute nostrud pariatur proident do amet magna aliqua ut eiusmod. Officia proident eu proident sunt proident do consectetur minim do. Dolor aliqua sunt cupidatat occaecat culpa reprehenderit commodo enim duis aliqua eiusmod.

fugiat ex tempor

Ipsum reprehenderit dolore commodo ullamco. Aute elit aliqua aute in aliquip et esse commodo. Anim aliquip et culpa voluptate veniam cillum. Nostrud eu anim et velit Lorem culpa ea nulla id. Consequat cillum dolor laboris reprehenderit dolore in laboris esse fugiat duis eu nisi laborum exercitation. Magna dolor do amet ad laboris nulla commodo officia anim.

deserunt mollit nostrud

Proident aliquip commodo dolore quis minim ex deserunt amet nostrud officia non dolor nulla ullamco. Non ex velit deserunt ea reprehenderit tempor. Proident ut qui eu veniam labore et aliqua fugiat excepteur cillum amet reprehenderit velit fugiat. Ullamco in sunt nisi reprehenderit aliqua ex qui. Amet consectetur exercitation magna laborum. Sit eiusmod laboris pariatur veniam dolore.

Official source

https://mediaspace.epfl.ch/media/0_qceayim3

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related lectures (31)

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.