...
| Day | Date (2012) | Topic | Slides | Audio (Panopto) | Code Examples | Assignment | |
---|---|---|---|---|---|---|---|---|
Module 1: Deterministic Shared-Memory Parallelism | ||||||||
1 | Wed | Sep 05 | Lecture 1: Introduction, Async-Finish Parallel Programming, Computation Graphs, Abstract Performance Metrics, Parallel Array Sum | lec1-audio | HW0 (due by 11:59pm on Tuesday, Sep 11th) | |||
2 | Mon | Sep 10 | Lecture 2: Parallel Array Sum (contd), Amdahl's Law, Weak vs. Strong Scaling, Data Races and Determinism | lec2-audio |
| |||
3 | Wed | Sep 12 | Lecture 3: Finish Accumulators, Futures (Tasks with Return Values), Dataflow Programming, Data-Driven Tasks |
| HW1 (due by 11:59pm on Tuesday, Sep 18th) | |||
4 | Mon | Sep 17 | Lecture 4: Parallel Programming Patterns, Seq clause, Forall Loops, Barrier Synchronization |
|
| |||
5 | Wed | Sep 19 | Lecture 5: Systolic Algorithms, Parallel Odd-Even Sort |
|
| HW2 (due by 11:59pm on Tuesday, Sep 25th) | ||
6 | Mon | Sep 24 | Lecture 6: Collective and Point-to-point Synchronization with Phasers, Phased Forasync Loops, Phaser Accumulators, Loop Chunking | lec6-audio |
| |||
Module 2: Nondeterministic Shared-Memory Parallelism | ||||||||
7 | Wed | Sep 26 | Lecture 7: Critical sections and the Isolated statement, Monitors, Atomic Variables, Actors |
|
| HW3 (due by 11:59pm on Tuesday, Oct 2nd) | ||
8 | Mon | Oct 01 | Lecture 8: Cooperative Scheduling Observationally Cooperative Scheduling (Guest lecturer: Prof. Melissa O'Neil) |
|
|
| ||
9 | Wed | Oct 03 | Lecture 9: Linearizability of Concurrent Objects, Safety and Liveness Properties |
|
| HW4 (due by 11:59pm on Tuesday, Oct 9th) | ||
Module 3: Distributed-Memory Parallelism | ||||||||
10 | Mon | Oct 08 | Lecture 10: Task Affinity with Places, Message Passing Interface (MPI) |
|
|
| ||
11 | Wed | Oct 10 | Lecture 11: MPI (contd), Cloud Computing and MapReduce, GPU Programming |
|
| HW5 (due by 11:59pm on Tuesday, Oct 16h) | ||
Module 4: Real-world Parallel Programming Models and Challenges | ||||||||
12 | Mon | Oct 15 | Lecture 12: Parallel Programming Patterns, Comparison of Parallel Programming Models |
|
|
| ||
13 | Wed | Oct 17 | Lecture 13: Memory Consistency Models, Course Review |
|
| Take-home Final Exam (3-hour duration, due by 5pm on Oct 19th) |