This is a multi-week course to get existing Software Engineers comfortable with Spark. The topics include the fundamental concepts for large-scale processing and the most important transformations. As a hands-on course, the exercises enable a seasoned programmer to produce scripts for data pipelines: from reading to transforming to writing.
Fault tolerance in spark
Working with key-value pairs: Transformations & Actions
Partitioning and Shuffling
I learned about parts of user experience journey that I didn’t understand before, so now I really know what mistakes I can avoid and what steps I shouldn’t miss.
It was a fun environment and it seemed like we were just learning about UX design and hanging out with friends.