Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

 

Day

Date (2012)

Topic

Slides

Audio (Panopto)

Code Examples

Assignment

   Module 1: Deterministic Shared-Memory Parallelism    

1

Wed

Sep 05

Lecture 1: Introduction, Async-Finish Parallel Programming, Computation Graphs, Abstract Performance Metrics, Parallel Array Sum

lec1-slides

lec1-audio

ArraySum1.hj

HW0 (due by 11:59pm on Tuesday, Sep 11th)

2

Mon

Sep 10

Lecture 2: Parallel Array Sum (contd), Amdahl's Law, Weak vs. Strong Scaling, Data Races and Determinism 

lec2-slides

 

 Node.hj

 

3

Wed

Sep 12

Lecture 3: Finish Accumulators, Futures (Tasks with Return Values), Dataflow Programming, Data-Driven Tasks, DeadlockAbstract vs. Real Performance, Seq clause, Forall Loops, Loop Chunking, Barrier Synchronization

 

 

 

HW1 (due by 11:59pm on Tuesday, Sep 18th)

4

Mon

Sep 17

Lecture 4: Collective and Point-to-point Synchronization with Phasers, Phased Forasync Loops, Phaser Accumulators

 

 

 

 

5

Wed

Sep 19

Lecture 5: Parallel MergeSort, Parallel BitonicSort

 

 

 

HW2 (due by 11:59pm on Tuesday, Sep 25th)

   Module 2: Nondeterministic Shared-Memory Parallelism    

6

Mon

Sep 24

Lecture 6: Critical sections and the Isolated statement, Monitors, Atomic Variables

 

  

 

7

Wed

Sep 26

Lecture 7: Actors

 

 

 

HW3 (due by 11:59pm on Tuesday, Oct 2nd)

8

Mon

Oct 01

Lecture 8: Systolic arrays, Systolic algorithms

 

 

 

 

9

Wed

Oct 03

Lecture 9: Linearizability of Concurrent Objects, Safety and Liveness Properties

 

 

 

HW4 (due by 11:59pm on Tuesday, Oct 9th)

   Module 3: Distributed-Memory Parallelism    

10

Mon

Oct 08

Lecture 10: Task Affinity with Places, Message Passing Interface (MPI)

 

 

 

 

11

Wed

Oct 10

Lecture 11: MPI (contd), Cloud Computing and MapReduce, GPU Programming

 

 

 

HW5 (due by 11:59pm on Tuesday, Oct 16h)

   Module 4: Real-world Parallel Programming Models and Challenges    

12

Mon

Oct 15

Lecture 12: Parallel Programming Patterns, Comparison of Parallel Programming Models

 

 

 

 

13

Wed

Oct 17

Lecture 13: Memory Consistency Models, Course Review

 

 

 

Take-home Final Exam (3-hour duration, due by 5pm on Oct 19th)