Versions Compared

Old Version 2008

changes.mady.by.user Mack Joyner

Saved on

compared with

New Version Current

changes.mady.by.user Mack Joyner

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)


Instructor:

Mackale Joyner, DH 2063

TAs:Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar

Piazza site:

https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)

Cross-listing:

ELEC 323

Lecture location:

Herzstein AmphitheaterAmp

Lecture times:

MWF 1:00pm - 1:50pm

Lab locations:

Mon (Herzstein AmpBrockman 101)

, Tue (Keck 100Herzstein Amp)

Lab times:

Mon  3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha, Jasmine)HA, AO)

Tue   4Tue 4:00pm - 4:50pm 50pm  (Tina, Delaney, Chase, Hung, Jerry, KailinRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here.  Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

  • Module 1 handout (Parallelism)
  • Module 2 handout  handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course.  You are encouraged to get copies of any or all of these books.  They will serve as useful references both during and after this course:

Lecture Schedule



Week

Day

Date (

2023

2024)

Lecture

Assigned Reading

Assigned Videos (see Canvas site for video links)

In-class Worksheets

Slides

Work Assigned

Work Due

Worksheet Solutions

1

Mon

Jan

09

08

Lecture 1: Introduction



worksheet1lec1-slides  



WS1-solution


Wed

Jan

11

10

Lecture 2:  Functional Programming



worksheet2lec02-slides



WS2-solution

FriJan
13
12Lecture 3: Higher order functions

worksheet3 lec3-slides   



WS3-solution

2

Mon

Jan

16

15

No class: MLK










Wed

Jan

18

17

Lecture 4: Lazy Computation



worksheet4lec4-slides

WS4-solution


Fri

Jan

20

19

Lecture 5: Java Streams



worksheet5lec5-slidesHomework 1
WS5-solution
3MonJan
23
22

Lecture 6: Map Reduce with Java Streams

Module 1: Section 2.4Topic 2.4 Lecture, Topic 2.4 Demonstration  worksheet6lec6-slides



WS6-solution


Wed

Jan

25

24

Lecture 7: Futures

Module 1: Section 2.1Topic 2.1 Lecture , Topic 2.1 Demonstrationworksheet7lec7-slides



WS7-solution


Fri

Jan

27

26

Lecture 8:  Async, Finish, Computation Graphs

Module 1: Sections 1.1, 1.2Topic 1.1 Lecture, Topic 1.1 Demonstration, Topic 1.2 Lecture, Topic 1.2 Demonstrationworksheet8lec8-slides

WS8-solution

4

Mon


Jan
30
29 Lecture 9: Ideal Parallelism, Data-Driven Tasks 

Module 1: Section 1.3, 4.5


Topic 1.3 Lecture, Topic 1.3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-slides 

WS9-solution

Wed
Feb 01
Jan 31Lecture 10: Event-based programming model




worksheet10lec10-slides
Homework 1WS10-solution

FriFeb
03
02Lecture 11: GUI programming, Scheduling/executing computation graphs

Module 1: Section 1.4Topic 1.4 Lecture , Topic 1.4 Demonstrationworksheet11lec11-slidesHomework 2
WS11-solution
5

Mon

Feb

06

05

Lecture 12: Abstract performance metrics, Parallel Speedup, Amdahl's Law Module 1: Section 1.5Topic 1.5 Lecture , Topic 1.5 Demonstrationworksheet12lec12-slides

WS12-solution


Wed

Feb

08

07

Lecture 13: Accumulation and reduction. Finish accumulators

Module 1: Section 2.3

Topic 2.3 Lecture   Topic 2.3 Demonstration

worksheet13lec13-slides 
WS13-solution


Fri

Feb

10

09

No class: Spring Recess










6

Mon

Feb

13

12

Lecture 14:

Recursive Task Parallelism  worksheet14lec14-slidesWS14-solution

Wed

Feb 15Lecture 15:

Data Races, Functional & Structural Determinism

Module 1: Sections 2.5, 2.6Topic 2.5 Lecture ,  Topic 2.5 Demonstration,  Topic 2.6 Lecture,  Topic 2.6 Demonstration
worksheet15
worksheet14
lec15WS15
lec14-slides
Homework 2


WS14-solution
Fri


Wed

Feb
17
14

Lecture

16

15: Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet16


worksheet15
lec16
lec15-slides



Homework
3
2
WS16
WS15-solution

FriFeb 16

Lecture 16: Recursive Task Parallelism  



worksheet16 lec16-slidesHomework 3
WS16-solution

7

Mon

Feb

20

19

Lecture 17: Midterm Review




lec17-slides




Wed

Feb

22

21

Lecture 18: Midterm Review




lec18-slides
WS18-solution





Fri

Feb
24 
23 

Lecture 19:  Fork/Join programming model. OS Threads. Scheduler Pattern

 


Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration
, 
worksheet19lec19-slides

WS19-solution

8

Mon

Feb
27
26 

Lecture 20:

Confinement & Monitor Pattern. Critical sections
Global lock Module 2: Sections 5.1, 5.2, 5.6 Topic 5

Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic
5
3.1 Demonstration , Topic
5
3.2 Lecture,
Topic 5
 Topic 3.2 Demonstration, Topic
5
3.
6
3 Lecture,
Topic 5
 Topic 3.
6
3 Demonstrationworksheet20lec20-slides
   
 

WS20-solution


Wed

Mar 01

Feb 28

Lecture 21:

  Atomic variables, Synchronized statements

Barrier Synchronization with Phasers

Module
2
1: Sections
5
3.4 Topic 3.4 Lecture,
7.2Topic 5.4 Lecture, Topic 5
Topic 3.4 Demonstration
, Topic 7.2 Lecture
worksheet21    lec21-slides
Homework 3


WS21-solution


Fri

Mar

03

01

Lecture 22:

Parallel Spanning Tree, other graph algorithms 

Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Sections 4.2, 4

 worksheet22lec22-slidesHomework 4WS22-solution

9

Mon

Mar 06

Lecture 23: Java Threads and Locks

Module 2: Sections 7.1, 7

.3

Topic
7
4.
1
2 Lecture, Topic
7
4.2 Demonstration, Topic 4.3 Lecture
, Topic 4.3 Demonstrationworksheet22lec22
worksheet23 lec23
-slides
WS23


WS22-solution

9

Wed

Mon

Mar

08

04

Lecture

24: Java Locks - Soundness and progress guarantees  Module 2: 7.5Topic 7.5 Lecture worksheet24 lec24-slidesWS24-solution

Fri

Mar 10

 Lecture 25: Dining Philosophers Problem  Module 2: 7.6Topic 7.6 Lectureworksheet25lec25-slidesWS25-solution

23: Fuzzy Barriers with Phasers

Module 1: Section 4.1 Topic 4.1 Lecture, Topic 4.1 Demonstrationworksheet23lec23-slides

Homework 3 (CP 1)

WS23-solution


Wed

Mar 06

Lecture 24: Confinement & Monitor Pattern. Critical sections
Global lock

Module 2: Sections 5.1, 5.2Topic 5.1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstrationworksheet24 lec24-slides


WS24-solution


Fri

Mar 08

 Lecture 25:  Atomic variables, Synchronized statementsModule 2: Sections 5.4, 7.2Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture worksheet25lec25-slides


WS25-solution

Mon

Mar 11

Mon

Mar 13

No class: Spring Break

 WedMar 15

No class: Spring Break


 
Fri







WedMar
17
13No class: Spring Break
10









Fri

Mon

Mar

20

15

Lecture 26: N-Body problem, applications and implementations 

worksheet26lec26-slides WS26-solution

Wed

Mar 22

No class: Spring Break









10

Mon

Mar 18

Lecture 26: Java Threads and Locks

Lecture 27: Read-Write Locks, Linearizability of Concurrent Objects

Module 2: Sections 7.
3
1, 7.
4
3Topic 7.
3
1 Lecture, Topic 7.
4
3 Lecture
worksheet27
worksheet26
lec27
lec26-slides
WS27


WS26-solution
Fri


Wed

Mar

24

20

Lecture

28

27:

Message-Passing programming model with Actors

Read-Write Locks,  Soundness and progress guarantees

Module 2:
6.1, 6.2
Section 7.3Topic
6
7.
1 worksheet28lec28-slides WS28-solution
3 Lecture, Topic
6.1 Demonstration,   Topic 6.2 Lecture, Topic 6.2 Demonstration
7.5 Lectureworksheet27lec27-slides


Homework 3 (CP 2)WS27-solution


Fri

Mar 22

Lecture 28: Dining Philosophers Problem


Topic 7.6 Lectureworksheet28lec28-slides




WS28-solution

11

Mon

Mar

27

25

Lecture 29:

Active Object Pattern. Combining Actors with task parallelism 

 Linearizability of Concurrent Objects

Module 2:
6.3, 6
Sections 7.4Topic
6worksheet29
7.
3 Lecture, Topic 6.3 Demonstration,   Topic 6.4 Lecture, Topic 6.4 Demonstration
4 Lectureworksheet29
lec29-slides



WS29-solution


Wed

Mar

29

27

Lecture 30:

Task Affinity and locality. Memory hierarchy

 Parallel Spanning Tree, other graph algorithms

 
worksheet30lec30-slides
Homework 4



WS30
-solution

Fri

Mar 31

Lecture 31: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture,  Topic 3.2 Demonstration, Topic 3.3 Lecture,  Topic 3.3 Demonstrationworksheet31lec31-slidesHomework 5WS31
-solution

12

Mon



Fri

Mar 29

Apr 03

Lecture

32: Barrier Synchronization with PhasersModule 1: Section 3.4Topic 3.4 Lecture,  Topic 3.4 Demonstrationworksheet32lec32-slidesWS32-solution

Wed

Apr 05

Lecture 33:  Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Section 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture,  Topic 4.3 Demonstration

worksheet33lec33-slidesWS33-solution

31: Message-Passing programming model with Actors

Module 2: Sections 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration,   Topic 6.2 Lecture, Topic 6.2 Demonstrationworksheet31lec31-slides


WS31-solution

12

Mon

Apr 01

Lecture 32: Active Object Pattern. Combining Actors with task parallelismModule 2: Sections 6.3, 6.4Topic 6.3 Lecture, Topic 6.3 Demonstration,   Topic 6.4 Lecture, Topic 6.4 Demonstrationworksheet32lec32-slides

Homework 4

Homework 3 (All)

WS32-solution


Wed

Apr 03

Lecture 33: Task Affinity and locality. Memory hierarchy



worksheet33lec33-slides



WS33-solution


Fri

Apr 05

Lecture 34: Eureka-style Speculative Task Parallelism

 
worksheet34lec34-slides


WS34-solution

13

Mon

Apr 08

No class: Solar Eclipse









WedApr 10Lecture 35

Fri

Apr 07

Lecture 34: Fuzzy Barriers with Phasers

Module 1: Section 4.1Topic 4.1 Lecture, Topic 4.1 Demonstrationworksheet34lec34-slidesWS34-solution

13

Mon

Apr 10

Lecture 35: Eureka-style Speculative Task Parallelismworksheet35lec35-slidesWS35-solutionWedApr 12Lecture 36
: Scan Pattern. Parallel Prefix Sum
worksheet36


worksheet35
lec36
lec35-slides
WS36

Homework 4 (CP 1)WS35-solution

FriApr
14
12Lecture
37
36: Parallel Prefix Sum applications
worksheet37


worksheet36
lec37
lec36-slides

WS36-solution
14MonApr
17
15Lecture
38
37: Overview of other models and frameworks
lec38



lec37-slides




WedApr
19
17Lecture
39
38: Course Review (Lectures 19-
38
34)
 
lec39

lec38-slides
Homework
5
4 (All)


FriApr
21
19Lecture
40
39: Course Review (Lectures 19-
38
34)
lec40



lec39-slides




Lab Schedule

Lab #

Date (2023)

Topic

Handouts

Examples

1

Jan 0908

Infrastructure setup

lab0-handout

lab1-handout


-Jan 1615No lab this week (MLK)

2Jan 2322Functional Programminglab2-handout

3

Jan 3029

Futures

lab3-handout

4Feb 0605Data-Driven Taskslab4-handout

5-

Feb 13

Async / Finish

lab5-handout

12

No lab this week



-Feb 19-Feb 20No lab this week (Midterm Exam)

65

Feb 27

Recursive Task Cutoff Strategy

26

Loop Parallelism 

lab5lab6-handoutimage kernels
67Mar 06Java Threads04Recursive Task Cutoff Strategylab6lab7-handout
-Mar 1311No lab this week (Spring Break)

7Mar 18Java Threadslab7-handout
8Mar 2025Concurrent Listslab8-handout
9Mar 27Apr 01Actorslab9-handout
-

Apr

03		TBD10

Apr 10

Loop Parallelism

08

No lab this week (Solar Eclipse)

lab10-handout



-

Apr 1715

No lab this week



Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm.  Labs must be checked off by a TA.

...