...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)

Instructor:	Mackale Joyner, DH 2063	TAs:	Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar
Piazza site:	https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)	Cross-listing:	ELEC 323
Lecture location:	Herzstein AmphitheaterAmp	Lecture times:	MWF 1:00pm - 1:50pm
Lab locations:	Mon (Herzstein AmpBrockman 101) , Tue (Keck 100Herzstein Amp)	Lab times:	Mon 3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha, Jasmine)HA, AO) Tue 4Tue 4:00pm - 4:50pm 50pm (Tina, Delaney, Chase, Hung, Jerry, KailinRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here. Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

Module 1 handout (Parallelism)
Module 2 handout handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course. You are encouraged to get copies of any or all of these books. They will serve as useful references both during and after this course:

Fork-Join Parallelism with a Data-Structures Focus (FJP) by Dan Grossman (Chapter 7 in Topics in Parallel and Distributed Computing)
Java Concurrency in Practice by Brian Goetz with Tim Peierls, Joshua Bloch, Joseph Bowbeer, David Holmes and Doug Lea
Principles of Parallel Programming by Calvin Lin and Lawrence Snyder
The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit

Lecture Schedule

Week	Day	Date (

2023

2024)	Lecture	Assigned Reading	Assigned Videos (see Canvas site for video links)	In-class Worksheets	Slides	Work Assigned	Work Due	Worksheet Solutions
1	Mon	Jan

09

08	Lecture 1: Introduction			worksheet1	lec1-slides			WS1-solution
	Wed	Jan

11

10	Lecture 2: Functional Programming			worksheet2	lec02-slides			WS2-solution
	Fri	Jan

13

12	Lecture 3: Higher order functions			worksheet3	lec3-slides			WS3-solution
2	Mon	Jan

16

15	No class: MLK
	Wed	Jan

18

17	Lecture 4: Lazy Computation			worksheet4	lec4-slides			WS4-solution
	Fri	Jan

20

19	Lecture 5: Java Streams			worksheet5	lec5-slides	Homework 1		WS5-solution
3	Mon	Jan

23

22	Lecture 6: Map Reduce with Java Streams	Module 1: Section 2.4	Topic 2.4 Lecture, Topic 2.4 Demonstration	worksheet6	lec6-slides			WS6-solution
	Wed	Jan

25

24	Lecture 7: Futures	Module 1: Section 2.1	Topic 2.1 Lecture , Topic 2.1 Demonstration	worksheet7	lec7-slides			WS7-solution
	Fri	Jan

27

26	Lecture 8: Async, Finish, Computation Graphs	Module 1: Sections 1.1, 1.2	Topic 1.1 Lecture, Topic 1.1 Demonstration, Topic 1.2 Lecture, Topic 1.2 Demonstration	worksheet8	l ec8-slides			WS8-solution
4	Mon	Jan

30

29

Lecture 9: Ideal Parallelism, Data-Driven Tasks

Module 1: Section 1.3, 4.5

Topic 1.3 Lecture, Topic 1.3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-

slides

slides			WS9-solution
	Wed

Feb 01

Jan 31	Lecture 10: Event-based programming model			worksheet10	lec10-slides		Homework 1	WS10-solution
	Fri	Feb

03

02	Lecture 11: GUI programming

as an example of event-basedworksheet11lec11-slidesHomework 2WS11-solution5

Mon

Feb 06

Lecture 12:

,

futures/callbacks in GUI programming

Scheduling/executing computation graphs

Abstract performance metrics

Module 1: Section 1.4

Topic 1.4 Lecture , Topic 1.4 Demonstration

worksheet12

worksheet11

lec12

lec11-slides

WS12

Homework 2

WS11-solution

Wed


5	Mon	Feb

08

05

Lecture

13

12: Abstract performance metrics, Parallel Speedup

, Critical Path

, Amdahl's

Law

Module 1: Section 1.5

Topic 1.5 Lecture , Topic 1.5 Demonstration

worksheet13

worksheet12

lec13WS13

lec12-slides

WS12-solution

Fri


	Wed	Feb

10No class: Spring Recess6

Mon

Feb 13

07	Lecture 13

Lecture 14

: Accumulation and reduction. Finish accumulators

Module 1: Section 2.3

Topic 2.3 Lecture Topic 2.3 Demonstration

worksheet14

worksheet13

lec14

lec13-slides

WS14

WS13-solution

Wed


	Fri	Feb

15

09

Lecture 15: Recursive Task Parallelism

worksheet15lec15-slidesHomework 2WS15-solutionFriFeb 17

No class: Spring Recess
6	Mon	Feb 12	Lecture 14

Lecture 16

: Data Races, Functional & Structural Determinism

Module 1: Sections 2.5, 2.6

Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.6 Lecture, Topic 2.6 Demonstration

worksheet16

worksheet14

lec16

7

Mon

Feb 20

Lecture 17: Midterm Review

lec17-slides

lec14-slides

Homework 3WS16-solution

WS14-solution
	Wed	Feb

22

14

Lecture

18

15: Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet18

worksheet15

lec18

lec15-slides

WS18

Homework 2

WS15-solution

Fri

Feb

24

16

Lecture

19: Fork/Join programming model. OS Threads. Scheduler Pattern

7
16: Recursive Task Parallelism			worksheet16	lec16-slides	Homework 3		WS16-solution

Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration, worksheet19lec19-slidesWS19-solution8

	Mon	Feb

27

Lecture 20: Confinement & Monitor Pattern. Critical sections
Global lock

Module 2: Sections 5.1, 5.2, 5.6 Topic 5

19	Lecture 17: Midterm Review				lec17-slides
	Wed	Feb 21	Lecture 18: Midterm Review				lec18-slides
	Fri	Feb 23	Lecture 19: Fork/Join programming model. OS Threads. Scheduler Pattern		Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration	worksheet19	lec19-slides	WS19-solution
8	Mon	Feb 26	Lecture 20: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking	Module 1: Sections 3.1, 3.2, 3.3	Topic 3.1 Lecture, Topic

5

3.1 Demonstration , Topic

5

3.2 Lecture,

Topic 5

Topic 3.2 Demonstration, Topic

5

3.

6

3 Lecture,

Topic 5

Topic 3.

6

3 Demonstration

worksheet20

lec20-slides

			WS20-solution
	Wed

Mar 01

Feb 28

Lecture 21:

Atomic variables, Synchronized statements

Barrier Synchronization with Phasers

Module

2

1: Sections

5.4, 7.2

3.4

Topic

5

3.4 Lecture, Topic

5

3.4 Demonstration

, Topic 7.2 Lecture

worksheet21

lec21-slides

Homework 3

			WS21-solution
	Fri	Mar

03

01	Lecture 22:

Parallel Spanning Tree, other graph algorithms

Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Sections 4.2, 4

worksheet22lec22-slidesHomework 4WS22-solution

9

Mon

Mar 06

Lecture 23: Java Threads and Locks

Module 2: Sections 7.1, 7

.3

Topic

7

4.

1 Lecture

2 Lecture, Topic 4.2 Demonstration, Topic

7

4.3 Lecture

worksheet23 lec23-slides WS23-solution

Wed

Mar 08

Lecture 24: Java Locks - Soundness and progress guarantees

Module 2: 7.5Topic 7.5 Lecture worksheet24 lec24-slidesWS24-solution

Fri

Mar 10

Lecture 25: Dining Philosophers Problem Module 2: 7.6Topic 7.6 Lectureworksheet25lec25-slidesWS25-solution

Mon

Mar 13

No class: Spring Break

WedMar 15No class: Spring Break

Fri

Mar 17

No class: Spring Break

10

Mon

Mar 20

Lecture 26: N-Body problem, applications and implementations

worksheet26lec26-slides WS26-solution

Wed

Mar 22

Lecture 27: Read-Write Locks, Linearizability of Concurrent Objects

Module 2: 7.3, 7.4Topic 7.3 Lecture, Topic 7.4 Lectureworksheet27lec27-slides WS27-solution

Fri

Mar 24

Lecture 28: Message-Passing programming model with Actors

Module 2: 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration worksheet28lec28-slides WS28-solution

11

Mon

Mar 27

Lecture 29: Active Object Pattern. Combining Actors with task parallelism

Module 2: 6.3, 6.4Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstrationworksheet29lec29-slidesWS29-solution

Wed

Mar 29

Lecture 30: Task Affinity and locality. Memory hierarchy

worksheet30lec30-slidesHomework 4WS30-solution

Fri

Mar 31

Lecture 31: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration, Topic 3.3 Lecture, Topic 3.3 Demonstrationworksheet31lec31-slidesHomework 5WS31-solution

12

Mon

Apr 03

Lecture 32: Barrier Synchronization with PhasersModule 1: Section 3.4Topic 3.4 Lecture, Topic 3.4 Demonstrationworksheet32lec32-slidesWS32-solution

Wed

Apr 05

Lecture 33: Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Section 4.2, 4.3

, Topic 4.3 Demonstration	worksheet22	lec22-slides			WS22-solution
9	Mon	Mar 04	Lecture 23: Fuzzy Barriers with Phasers	Module 1: Section 4.1	Topic 4.1 Lecture, Topic 4.1 Demonstration	worksheet23	lec23-slides		Homework 3 (CP 1)	WS23-solution
	Wed	Mar 06	Lecture 24: Confinement & Monitor Pattern. Critical sections Global lock	Module 2: Sections 5.1, 5.2	Topic 5.1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstration	worksheet24	lec24-slides			WS24-solution
	Fri	Mar 08	Lecture 25: Atomic variables, Synchronized statements	Module 2: Sections 5.4, 7.2	Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture	worksheet25	l ec25-slides			WS25-solution
	Mon	Mar 11	No class: Spring Break
	Wed	Mar 13	No class: Spring Break
	Fri	Mar 15	No class: Spring Break
10	Mon	Mar 18	Lecture 26: Java Threads and Locks	Module 2: Sections 7.1, 7.3	Topic 7.1 Lecture, Topic 7.3 Lecture	worksheet26	lec26-slides			WS26-solution
	Wed	Mar 20	Lecture 27: Read-Write Locks, Soundness and progress guarantees	Module 2: Section 7.3	Topic 7.3 Lecture, Topic 7.5 Lecture	worksheet27	lec27-slides		Homework 3 (CP 2)	WS27-solution
	Fri	Mar 22	Lecture 28: Dining Philosophers Problem		Topic 7.6 Lecture	worksheet28	lec28-slides			WS28-solution
11	Mon	Mar 25	Lecture 29: Linearizability of Concurrent Objects	Module 2: Sections 7.4	Topic 7.4 Lecture	worksheet29	lec29-slides			WS29-solution
	Wed	Mar 27	Lecture 30: Parallel Spanning Tree, other graph algorithms			worksheet30	lec30-slides			WS30-solution
	Fri	Mar 29	Lecture 31: Message-Passing programming model with Actors	Module 2: Sections 6.1, 6.2	Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration	worksheet31	lec31-slides			WS31-solution
12	Mon	Apr 01	Lecture 32: Active Object Pattern. Combining Actors with task parallelism	Module 2: Sections 6.3, 6.4	Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration	worksheet32	lec32-slides	Homework 4	Homework 3 (All)	WS32-solution
	Wed	Apr 03	Lecture 33: Task Affinity and locality. Memory hierarchy			worksheet33	lec33-slides			WS33-solution
	Fri	Apr 05	Lecture 34: Eureka-style Speculative Task Parallelism			worksheet34	lec34-slides			WS34-solution
13	Mon	Apr 08	No class: Solar Eclipse
	Wed	Apr 10	Lecture 35: Scan Pattern. Parallel Prefix Sum			worksheet35	lec35-slides		Homework 4 (CP 1)	WS35-solution
	Fri	Apr 12	Lecture 36: Parallel Prefix Sum applications			worksheet36	lec36-slides			WS36-solution
14	Mon	Apr 15	Lecture 37: Overview of other models and frameworks				lec37-slides
	Wed	Apr 17	Lecture 38: Course Review (Lectures 19-34)				lec38-slides		Homework 4 (All)
	Fri	Apr 19	Lecture 39: Course Review (Lectures 19-34)				lec39

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

worksheet33lec33-slidesWS33-solution

Fri

Apr 07

Lecture 34: Fuzzy Barriers with Phasers

Module 1: Section 4.1Topic 4.1 Lecture, Topic 4.1 Demonstrationworksheet34lec34-slidesWS34-solution

13

Mon

Apr 10

Lecture 35: Eureka-style Speculative Task Parallelismworksheet35lec35-slidesWS35-solutionWedApr 12Lecture 36: Scan Pattern. Parallel Prefix Sumworksheet36lec36-slidesWS36-solutionFriApr 14Lecture 37: Parallel Prefix Sum applicationsworksheet37lec37-slides14MonApr 17Lecture 38: Overview of other models and frameworkslec38-slidesWedApr 19Lecture 39: Course Review (Lectures 19-38)lec39-slidesHomework 5FriApr 21Lecture 40: Course Review (Lectures 19-38)lec40

-slides

Lab Schedule

No lab this week (Spring Recess) 13

Lab #	Date (2023)	Topic	Handouts	Examples
1	Jan 0908	Infrastructure setup	lab0-handout lab1-handout
-	Jan 1615	No lab this week (MLK)
2	Jan 2322	Functional Programming	lab2-handout
3	Jan 3029	Futures	lab3-handout	-	Feb 06
4	Feb	05	Data-Driven Tasks	lab4-handout
-	Feb 12	No lab this week
-	Feb 2019	No lab this week (Midterm Exam)
5	Feb 2726	Loop Parallelism Async / Finish	lab5-handout	image kernels
6	Mar 0604	Recursive Task Cutoff Strategy	lab6-handout
-	Mar 1311	No lab this week (Spring Break)
7	Mar 2018	Java Threads	lab7-handout
8	Mar 2725	Concurrent Lists	lab8-handout
9	Apr 0301	Actors	lab9-handout
10-	Apr 10	Loop Parallelism	08	No lab this week (Solar Eclipse) lab10-handout
-	Apr 1715	No lab this week

Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm. Labs must be checked off by a TA.

...

Child pages

Versions Compared

Old Version 1991

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures

Child pages

Page History

Versions Compared

Old Version 1991

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures