...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)

Instructor:	Mackale Joyner, DH 2063	TAs:	Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar
Piazza site:	https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)	Cross-listing:	ELEC 323
Lecture location:	Herzstein AmphitheaterAmp	Lecture times:	MWF 1:00pm - 1:50pm
Lab locations:	Mon (Herzstein AmpBrockman 101) , Tue (Keck 100Herzstein Amp)	Lab times:	Mon 3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha, Jasmine)HA, AO) Tue 4Tue 4:00pm - 4:50pm 50pm (Tina, Delaney, Chase, Hung, Jerry, KailinRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here. Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

Module 1 handout (Parallelism)
Module 2 handout handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course. You are encouraged to get copies of any or all of these books. They will serve as useful references both during and after this course:

Fork-Join Parallelism with a Data-Structures Focus (FJP) by Dan Grossman (Chapter 7 in Topics in Parallel and Distributed Computing)
Java Concurrency in Practice by Brian Goetz with Tim Peierls, Joshua Bloch, Joseph Bowbeer, David Holmes and Doug Lea
Principles of Parallel Programming by Calvin Lin and Lawrence Snyder
The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit

Lecture Schedule

Week	Day	Date (

2023

2024)	Lecture	Assigned Reading	Assigned Videos (see Canvas site for video links)	In-class Worksheets	Slides	Work Assigned	Work Due	Worksheet Solutions
1	Mon	Jan

09

08	Lecture 1: Introduction			worksheet1	lec1-slides			WS1-solution
	Wed	Jan

11

10	Lecture 2: Functional Programming			worksheet2	lec02-slides			WS2-solution
	Fri	Jan

13

12	Lecture 3: Higher order functions			worksheet3	lec3-slides			WS3-solution
2	Mon	Jan

16

15	No class: MLK
	Wed	Jan

18

17	Lecture 4: Lazy Computation			worksheet4	lec4-slides			WS4-solution
	Fri	Jan

20

19	Lecture 5: Java Streams			worksheet5	lec5-slides	Homework 1		WS5-solution
3	Mon	Jan

23

22	Lecture 6: Map Reduce with Java Streams	Module 1: Section 2.4	Topic 2.4 Lecture, Topic 2.4 Demonstration	worksheet6	lec6-slides			WS6-solution
	Wed	Jan

25

24	Lecture 7: Futures	Module 1: Section 2.1	Topic 2.1 Lecture , Topic 2.1 Demonstration	worksheet7	lec7-slides			WS7-solution
	Fri	Jan

27

26

Lecture 8: Async, Finish, Computation Graphs

Module 1: Sections 1.1, 1.2

Topic 1.1 Lecture, Topic 1.1 Demonstration, Topic 1.2 Lecture, Topic 1.2 Demonstration

worksheet8

lec8

l ec8-slides			WS8-solution
4	Mon	Jan

30

29

Lecture 9: Ideal Parallelism, Data-Driven Tasks

Module 1: Section 1.3, 4.5

Topic 1.3 Lecture, Topic 1.3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-

slides

slides			WS9-solution
	Wed

Feb 01

Jan 31	Lecture 10: Event-based programming model			worksheet10	lec10-slides		Homework 1	WS10-solution
	Fri	Feb

03

02	Lecture 11: GUI programming

as an example of event-basedworksheet11lec11-slidesHomework 2WS11-solution5

Mon

Feb 06

Lecture 12:

,

futures/callbacks in GUI programming

Scheduling/executing computation graphs

Abstract performance metrics

Module 1: Section 1.4

Topic 1.4 Lecture , Topic 1.4 Demonstration

worksheet12

worksheet11

lec12

lec11-slides

WS12

Homework 2		WS11-solution
5

Wed

Mon

Feb

08

05

Lecture

13

12: Abstract performance metrics, Parallel Speedup,

Critical Path,

Amdahl's

Law

Module 1: Section 1.5

Topic 1.5 Lecture , Topic 1.5 Demonstration

worksheet13

worksheet12

lec13WS13

lec12-slides

WS12-solution

Fri


	Wed	Feb

10No class: Spring Recess6

Mon

Feb 13

07	Lecture 13

Lecture 14

: Accumulation and reduction. Finish accumulators

Module 1: Section 2.3

Topic 2.3 Lecture Topic 2.3 Demonstration

worksheet14

worksheet13

lec14

lec13-slides

WS14

WS13-solution

Wed


	Fri	Feb

15

09

Lecture 15: Recursive Task Parallelism

worksheet15lec15-slidesHomework 2WS15-solutionFriFeb 17

No class: Spring Recess
6	Mon	Feb 12	Lecture 14

Lecture 16

: Data Races, Functional & Structural Determinism

Module 1: Sections 2.5, 2.6

Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.6 Lecture, Topic 2.6 Demonstration

worksheet16

worksheet14

lec16

7

Mon

Feb 20

Lecture 17: Midterm Review

lec17-slides

lec14-slides

Homework 3WS16-solution

WS14-solution
	Wed	Feb

22

14

Lecture

18

15: Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet18

worksheet15

lec18

lec15-slides

Homework 2

WS18

WS15-solution
	Fri	Feb

24

16

Lecture

19: Fork/Join programming model. OS Threads. Scheduler Pattern

16: Recursive Task Parallelism			worksheet16	lec16-slides	Homework 3		WS16-solution
7	Mon	Feb 19	Lecture 17: Midterm Review				lec17-slides
	Wed	Feb 21	Lecture 18: Midterm Review				lec18-slides
	Fri	Feb 23	Lecture 19: Fork/Join programming model. OS Threads. Scheduler Pattern		Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration	worksheet19	lec19-slides		WS19-solution
8	Mon	Feb 26	Lecture 20: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking	Module 1: Sections 3.1, 3.2, 3.3	Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration, Topic 3.3 Lecture, Topic 3.3 Demonstration	worksheet20	lec20-slides		WS20-solution
	Wed	Feb 28	Lecture 21: Barrier Synchronization with Phasers	Module 1: Sections 3.4	Topic 3.4 Lecture, Topic 3.4 Demonstration	worksheet21	lec21-slides		WS21-solution
	Fri	Mar 01	Lecture 22:Stencil computation. Point-to-point Synchronization with Phasers	Module 1: Sections 4.2, 4.3	Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration	worksheet22	lec22-slides		WS22-solution
9	Mon	Mar 04	Lecture 23: Fuzzy Barriers with Phasers	Module 1: Section 4.1	Topic 4.1 Lecture, Topic 4.1 Demonstration	worksheet23	lec23-slides	Homework 3 (CP 1)	WS23-solution
	Wed	Mar 06	Lecture 24: Confinement & Monitor Pattern. Critical sections Global lock	Module 2: Sections 5.1, 5.2	Topic 5.1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstration	worksheet24	lec24-slides		WS24-solution
	Fri	Mar 08	Lecture 25: Atomic variables, Synchronized statements	Module 2: Sections 5.4, 7.2	Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture	worksheet25	l ec25-slides		WS25-solution
	Mon	Mar 11	No class: Spring Break
	Wed	Mar 13

Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration, worksheet19lec19-slidesWS19-solution

8

Mon

Feb 27

Lecture 20: Confinement & Monitor Pattern. Critical sections
Global lock

Module 2: Sections 5.1, 5.2, 5.6 Topic 5.1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstrationworksheet20lec20-slides WS20-solution

Wed

Mar 01

Lecture 21: Atomic variables, Synchronized statements

Module 2: Sections 5.4, 7.2

Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lectureworksheet21lec21-slidesHomework 3WS21-solution

Fri

Mar 03

Lecture 22: Parallel Spanning Tree, other graph algorithms

worksheet22lec22-slidesHomework 4WS22-solution

9

Mon

Mar 06

Lecture 23: Java Threads and Locks

Module 2: Sections 7.1, 7.3

Topic 7.1 Lecture, Topic 7.3 Lecture

worksheet23 lec23-slides WS23-solution

Wed

Mar 08

Lecture 24: Java Locks - Soundness and progress guarantees

Module 2: 7.5Topic 7.5 Lecture worksheet24 lec24-slidesWS24-solution

Fri

Mar 10

Lecture 25: Dining Philosophers Problem Module 2: 7.6Topic 7.6 Lectureworksheet25lec25-slidesWS25-solution

Mon

Mar 13

No class: Spring Break

WedMar 15

	No class: Spring Break
	Fri	Mar

17

15	No class: Spring Break
10	Mon	Mar

20

18	Lecture 26:

N-Body problem, applications and implementations

Java Threads and Locks	Module 2: Sections 7.1, 7.3	Topic 7.1 Lecture, Topic 7.3 Lecture	worksheet26	lec26-slides			WS26-solution
	Wed	Mar

22

20	Lecture 27: Read-Write Locks,

Linearizability of Concurrent Objects

Soundness and progress guarantees

Module 2: Section 7.3

, 7.4

Topic 7.3 Lecture, Topic 7.

4

5 Lecture	worksheet27	lec27-slides		Homework 3 (CP 2)	WS27-solution
	Fri	Mar

24

22	Lecture 28:

Message-Passing programming model with ActorsModule 2: 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration

Dining Philosophers Problem

Topic 7.6 Lecture

worksheet28

lec28-slides

WS28-solution

11

Mon

Mar

27

25	Lecture 29:

Active Object Pattern. Combining Actors with task parallelism

Linearizability of Concurrent Objects

Module 2:

6.3, 6.4Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration

Sections 7.4	Topic 7.4 Lecture	worksheet29	lec29-slides			WS29-solution
	Wed	Mar

29

27	Lecture 30:

Task Affinity and locality. Memory hierarchy

Parallel Spanning Tree, other graph algorithms

worksheet30

lec30

-slidesHomework 4WS30-solution

Fri

Mar 31

Lecture 31: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration, Topic 3.3 Lecture, Topic 3.3 Demonstrationworksheet31lec31-slidesHomework 5WS31-solution

12

Mon

Apr 03

Lecture 32: Barrier Synchronization with PhasersModule 1: Section 3.4Topic 3.4 Lecture, Topic 3.4 Demonstrationworksheet32lec32-slidesWS32-solution

Wed

Apr 05

Lecture 33: Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Section 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

worksheet33lec33-slidesWS33-solution

-slides			WS30-solution
	Fri	Mar 29	Lecture 31: Message-Passing programming model with Actors	Module 2: Sections 6.1, 6.2	Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration	worksheet31	lec31-slides			WS31-solution
12	Mon	Apr 01	Lecture 32: Active Object Pattern. Combining Actors with task parallelism	Module 2: Sections 6.3, 6.4	Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration	worksheet32	lec32-slides	Homework 4	Homework 3 (All)	WS32-solution
	Wed	Apr 03	Lecture 33: Task Affinity and locality. Memory hierarchy			worksheet33	lec33-slides			WS33-solution
	Fri	Apr 05	Lecture 34

Fri

Apr 07

Lecture 34: Fuzzy Barriers with Phasers

Module 1: Section 4.1Topic 4.1 Lecture, Topic 4.1 Demonstrationworksheet34lec34-slidesWS34-solution

13

Mon

Apr 10

Lecture 35

: Eureka-style Speculative Task Parallelism

worksheet35

worksheet34

lec35

lec34-slides

WS35

		WS34-solution
13	Mon	Apr 08	No class: Solar Eclipse
	Wed	Apr

12

10

Lecture

36

35: Scan Pattern. Parallel Prefix Sum

worksheet36

worksheet35

lec36

lec35-slides

WS36

	Homework 4 (CP 1)	WS35-solution
	Fri	Apr

14

12

Lecture

37

36: Parallel Prefix Sum applications

worksheet37

worksheet36

lec37

lec36-slides			WS36-solution
14	Mon	Apr

17

15

Lecture

38

37: Overview of other models and frameworks

lec38

			lec37-slides
	Wed	Apr

19

17

Lecture

39

38: Course Review (Lectures 19-

38

34)

lec39

lec38-slides

Homework

5

4 (All)
	Fri	Apr

21

19

Lecture

40

39: Course Review (Lectures 19-

38

34)

lec40

lec39-slides

Lab Schedule

Lab #	Date (2023)	Topic	Handouts	Examples
1	Jan 0908	Infrastructure setup	lab0-handout lab1-handout
-	Jan 1615	No lab this week (MLK)
2	Jan 2322	Functional Programming	lab2-handout
3	Jan 3029	Java StreamsFutures	lab3-handout
4	Feb 0605	Data-Driven TasksFutures	lab4-handout
5-	Feb 13	Data-Driven Tasks	12	No lab this week lab5-handout
-	Feb 2019	No lab this week (Midterm Exam)
65	Feb 27	Async / Finish	lab6-handout	26	Loop Parallelism	lab5-handout	image kernels
6	Mar 04	7	Mar 06	Recursive Task Cutoff Strategy	lab7lab6-handout
-	Mar 1311	No lab this week (Spring Break)
87	Mar 2018	Java Threads	lab8lab7-handout
98	Mar 2725	Concurrent Lists	lab9lab8-handout
109	Apr 0301	Actors	lab10lab9-handout
11-	Apr 10	Loop Parallelism	08	No lab this week (Solar Eclipse) lab11-handout
-	Apr 1715	No lab this week

Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm. Labs must be checked off by a TA.

...

Child pages

Versions Compared

Old Version 1984

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures

Child pages

Page History

Versions Compared

Old Version 1984

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures