Big Data Analysis with Scala and Spark (Scala 2 version)

Learning Outcomes. By the end of this course you will be able to:

• read data from persistent storage and load it into Apache Spark,
• manipulate data with Spark and Scala,
• express algorithms for data analysis in a functional style,
• recognize how to avoid shuffles and recomputation in Spark,

Recommended background: You should have at least one year programming experience. Proficiency with Java or C# is ideal, but experience with other languages such as C/C++, Python, Javascript or Ruby is also sufficient. You should have some familiarity using the command line. This course is intended to be taken after Parallel Programming: https://www.coursera.org/learn/parprog1.

Note that this version of the course uses Scala 2.13. You can find a more recent version of the course that uses Scala 3 here: https://www.coursera.org/learn/scala-spark-big-data