Scaling up: Spark and Big Data

This lecture covers the challenges of processing big data, the rise of distributed computing, and the introduction of Spark as a solution. Topics include the big-data problem, hardware considerations, MapReduce, RDDs, transformations, actions, persistence, Spark SQL, and Spark's Machine Learning Toolkit.