Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
This lecture covers the Hadoop ecosystem, focusing on the architectural choices of Hadoop, including the storage layer, programming model, execution engine, scheduling, optimizations, and fault tolerance. It also delves into the MapReduce programming model, explaining the data model, core functions, and providing a sample code for the word-count problem. The lecture discusses HDFS abstractions, replication, failures, evaluation, and the under-the-hood workings of MapReduce, highlighting its strengths and limitations.