Course Schedule

Part 1: Resources

Week 1

Mon, Jan 20
Martin Luther King Day!
Wed, Jan 22
Course Intro
Read: Syllabus
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Fri, Jan 24
Deployment (Linux Shell)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck

Week 2

Wed, Jan 29
Deployment (Docker)
Release: P1 (Docker)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Quiz: week 1

Week 3

Mon, Feb 3
Network Resources (gRPC)
Read: gRPC Basics Tutorial
Watch: Part 1: gRPC Demo
Watch: Part 2: gRPC repeated values
Watch: Part 3: Docker port forwarding
Slides: PDF
Anki Flashcards: Deck
Wed, Feb 5
Network Resources (Compose)
Watch: Lecture
Slides: PDF
Quiz: week 2 and before (cumulative)
Fri, Feb 7
Memory Resources (Caching)
Read: Systems Performance, Gregg (6.2.2; "CPU Caches" and "Latency" subsections of 6.4.1)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck

Week 4

Mon, Feb 10
Memory Resources (Caching Practice)
Due: P1
Release: P2 (Network+Memory)
Watch: Lecture
Wed, Feb 12
Memory Resources (PyArrow)
Read: Gallery of Processor Cache Effects (Examples 1 and 2)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Quiz: week 3 and before (cumulative)

Week 5

Mon, Feb 17
Compute Resources (Locks)
Read: Mastering Concurrency in Python ("Working With Threads In Python" chapter)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Wed, Feb 19
Storage Resources (File Systems)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Quiz: week 4 and before (cumulative)

Week 6

Wed, Feb 26
Midterm (in class)
Fri, Feb 28
SQL Practice
Watch: Lecture
Part 2: Clusters

Week 7

Fri, Mar 7
Spark RDDs
Watch: Lecture

Week 8

Fri, Mar 14
Spark Internals and Performance
Read: Learning Spark, 2nd edition by Damji et al. (Chapter 7, "Optimizing and Tuning Spark Applications")
Due: P4
Release: P5 (Spark, Loans)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck

Week 9

Mon, Mar 17
Spark Machine Learning API
Read: Learning Spark, 2nd edition by Damji et al. (Chapter 10, "Machine Learning with MLlib")
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Wed, Mar 19
Spark Machine Learning: PLANET
Watch: Lecture
Quiz: week 8 and before (cumulative)
Fri, Mar 21
Wide Tables: HBase and Cassandra
Read: Cassandra, The Definitive Guide, by Carpenter et al. (Chapter 4, "The Cassandra Query Language")
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck

Week 10

Mon, Mar 24
Spring Break
Wed, Mar 26
Spring Break
Fri, Mar 28
Spring Break

Week 11

Mon, Mar 31
Cassandra Query Language (CQL)
Watch: Part 1: CQL Demos
Watch: Part 2: Cassandra Partitioning
Anki Flashcards: Deck
Fri, Apr 4
Cassandra Replication
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck

Week 12

Mon, Apr 7
Midterm (in class)
Fri, Apr 11
Streaming: Kafka Demos
Watch: Lecture
Anki Flashcards: Deck

Week 13

Mon, Apr 14
Streaming: Kafka Reliability
Read: Kafka, The Definitive Guide, 2nd edition by Shapira et al. (Chapter 7, "Reliable Data Delivery")
Due: P6
Release: P7 (Kafka, Weather Stations)
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Wed, Apr 16
Streaming: Spark Programming
Read: Learning Spark, 2nd edition by Damji et al. (Chapter 8, "Structured Streaming")
Watch: Lecture
Anki Flashcards: Deck
Quiz: week 12 and before (cumulative)
Fri, Apr 18
Streaming: Spark Concepts
Watch: Lecture
Slides: PDF
Anki Flashcards: Deck
Part 3: Cloud

Week 14

Mon, Apr 21
The Cloud
Slides: PDF
Anki Flashcards: Deck
Wed, Apr 23
Big Query 1
Quiz: week 13 and before (cumulative)

Week 15

Wed, Apr 30
Big Query 4
Quiz: week 14 and before (cumulative)
Fri, May 2
Review
Due: P8