...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)

Instructor:	Mackale Joyner, DH 2063	TAs:	Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar
Piazza site:	https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)	Cross-listing:	ELEC 323
Lecture location:	Herzstein AmphitheaterAmp	Lecture times:	MWF 1:00pm - 1:50pm
Lab locations:	Mon (Herzstein AmpBrockman 101) , Tue (Keck 100Herzstein Amp)	Lab times:	Mon 3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha, Jasmine)HA, AO) Tue 4Tue 4:00pm - 4:50pm 50pm (Tina, Delaney, Chase, Hung, JerryRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here. Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

Module 1 handout (Parallelism)
Module 2 handout handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course. You are encouraged to get copies of any or all of these books. They will serve as useful references both during and after this course:

Fork-Join Parallelism with a Data-Structures Focus (FJP) by Dan Grossman (Chapter 7 in Topics in Parallel and Distributed Computing)
Java Concurrency in Practice by Brian Goetz with Tim Peierls, Joshua Bloch, Joseph Bowbeer, David Holmes and Doug Lea
Principles of Parallel Programming by Calvin Lin and Lawrence Snyder
The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit

Lecture Schedule

Week	Day	Date (

2023

2024)	Lecture	Assigned Reading	Assigned Videos (see Canvas site for video links)	In-class Worksheets	Slides	Work Assigned	Work Due	Worksheet Solutions
1	Mon	Jan

09

08	Lecture 1: Introduction			worksheet1	lec1-slides			WS1-solution
	Wed	Jan

11

10	Lecture 2: Functional Programming			worksheet2	lec02-slides			WS2-solution
	Fri	Jan

13

12	Lecture 3: Higher order functions			worksheet3	lec3-slides			WS3-solution
2	Mon	Jan

16

15	No class: MLK
	Wed	Jan

18

17	Lecture 4: Lazy Computation			worksheet4	lec4-slides			WS4-solution
	Fri	Jan

20

19	Lecture 5: Java Streams			worksheet5	lec5-slides	Homework 1		WS5-solution
3	Mon	Jan

23

22	Lecture 6: Map Reduce with Java Streams	Module 1: Section 2.4	Topic 2.4 Lecture, Topic 2.4 Demonstration	worksheet6	lec6-slides			WS6-solution
	Wed	Jan

25

24	Lecture 7: Futures	Module 1: Section 2.1	Topic 2.1 Lecture , Topic 2.1 Demonstration	worksheet7	lec7-slides			WS7-solution
	Fri	Jan

27

26	Lecture 8:

Computation Graphs, Ideal Parallelism

Async, Finish, Computation Graphs

Module 1: Sections 1.

2

1, 1.

3

2

Topic 1.

2

1 Lecture, Topic 1.

2

1 Demonstration, Topic 1.

3

2 Lecture, Topic 1.

3

2 Demonstration

worksheet8

lec8

l ec8-slides			WS8-solution
4	Mon	Jan

30

29	Lecture 9:

Async, Finish

Ideal Parallelism, Data-Driven Tasks

Module 1: Section 1.

1

3, 4.5

Topic 1.

1

3 Lecture, Topic 1.

1

3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-

slides

slides			WS9-solution
	Wed

Feb 01

Jan 31	Lecture 10: Event-based programming model			worksheet10	lec10-slides		Homework 1	WS10-solution
	Fri	Feb

03

02	Lecture 11: GUI programming

as an example of event-based,
futures/callbacks in GUI programming

, Scheduling/executing computation graphs

Module 1: Section 1.4

Topic 1.4 Lecture , Topic 1.4 Demonstration

worksheet11	lec11-slides	Homework 2		WS11-solution
5	Mon	Feb

06

05	Lecture 12:

Scheduling/executing computation graphs

Abstract performance metrics, Parallel Speedup, Amdahl's Law

Module 1: Section 1.

4

5

Topic 1.

4

5 Lecture , Topic 1.

4

5 Demonstration	worksheet12	lec12-slides			WS12-solution
	Wed	Feb

08

07	Lecture 13:

Parallel Speedup, Critical Path, Amdahl's Law

Accumulation and reduction. Finish accumulators

Module 1: Section

1

2.

5

3

Topic

1

2.

5

3 Lecture

,

Topic

1

2.

5

3 Demonstration	worksheet13	lec13-slides			WS13-solution
	Fri	Feb

10

09	No class: Spring Recess
6	Mon	Feb

13

12	Lecture 14:

Accumulation and reduction. Finish accumulators

Data Races, Functional & Structural Determinism

Module 1:

Section

Sections 2.5, 2.

3

6	Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.

3

6 Lecture, Topic 2.

3

6 Demonstration	worksheet14	lec14-slides			WS14-solution
	Wed	Feb

15

14	Lecture 15:

Recursive Task Parallelism

Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet15

lec15-slides

Homework 2

WS15-solution

Fri

Feb

17

16	Lecture 16:

Data Races, Functional & Structural DeterminismModule 1: Sections 2.5, 2.6Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.6 Lecture, Topic 2.6 Demonstrationworksheet16 lec16-slidesHomework 3Homework 2WS16-solution

Recursive Task Parallelism			worksheet16	lec16-slides	Homework 3		WS16-solution
7	Mon	Feb 19

7

Mon

Feb 20

	Lecture 17: Midterm Review				lec17-slides
	Wed	Feb

22

21	Lecture 18:

Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

Midterm Review				lec18-slides
	Fri	Feb 23

worksheet18lec18-slidesWS18-solution

Fri

Feb 24

Lecture 19: Fork/Join programming model. OS Threads. Scheduler Pattern

Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration

,

	worksheet19	lec19-slides			WS19-solution
8	Mon	Feb

27

26	Lecture 20:

Confinement & Monitor Pattern. Critical sections
Global lock Module 2: Sections 5.1, 5.2, 5.6 Topic 5

Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3

Topic 3.1 Lecture, Topic

5

3.1 Demonstration , Topic

5

3.2 Lecture,

Topic 5

Topic 3.2 Demonstration, Topic

5

3.

6

3 Lecture,

Topic 5

Topic 3.

6

3 Demonstration

worksheet20

lec20-slides

			WS20-solution
	Wed

Mar 01

Feb 28

Lecture 21:

Atomic variables, Synchronized statements

Barrier Synchronization with Phasers

Module

2

1: Sections

5.4, 7.2

3.4

Topic

5

3.4 Lecture, Topic

5

3.4 Demonstration

, Topic 7.2 Lecture

	worksheet21	lec21-slides			WS21-solution
	Fri	Mar

03

01	Lecture 22:

Parallel Spanning Tree, other graph algorithms

Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Sections 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

worksheet22

lec22-slides

Homework 4Homework 3

			WS22-solution
9	Mon	Mar

06

04	Lecture 23:

Java Threads and Locks

Fuzzy Barriers with Phasers

Module

2

1:

Sections 7

Section 4.1

, 7.3

Topic 4

Topic 7

.1 Lecture, Topic

7

4.

3 Lecture

1 Demonstration	worksheet23	lec23-slides		Homework 3 (CP 1)	WS23-solution
	Wed	Mar

08

06	Lecture 24:

Java Locks - Soundness and progress guarantees

Confinement & Monitor Pattern. Critical sections
Global lock

Module 2:

7

Sections 5.1, 5.2

Topic

7

5.

5 Lecture

1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstration	worksheet24	lec24-slides			WS24-solution
	Fri	Mar

10

08	Lecture 25:

Dining Philosophers Problem

Atomic variables, Synchronized statements

Module 2: Sections 5.4, 7.

6

2

Topic

7

5.

6 Lectureworksheet25

4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture

worksheet25

l ec25

lec25

-slides			WS25-solution
	Mon	Mar

13

11	No class: Spring Break
	Wed	Mar

15

13	No class: Spring Break
	Fri	Mar

17

15	No class: Spring Break
10	Mon	Mar

20

18	Lecture 26:

N-Body problem, applications and implementations

Java Threads and Locks	Module 2: Sections 7.1, 7.3	Topic 7.1 Lecture, Topic 7.3 Lecture	worksheet26	lec26-slides			WS26-solution
	Wed	Mar

22

20	Lecture 27: Read-Write Locks,

Linearizability of Concurrent Objects

Soundness and progress guarantees

Module 2: Section 7.3

, 7.4

Topic 7.3 Lecture, Topic 7.

4

5 Lecture	worksheet27	lec27-slides		Homework 3 (CP 2)	WS27-solution
	Fri	Mar

24

22	Lecture 28:

Message-Passing programming model with ActorsModule 2: 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration

Dining Philosophers Problem

Topic 7.6 Lecture

worksheet28

lec28-slides

WS28-solution

11

Mon

Mar

27

25	Lecture 29:

Active Object Pattern. Combining Actors with task parallelism

Linearizability of Concurrent Objects

Module 2:

6.3, 6

Sections 7.4

Topic

6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration

7.4 Lecture	worksheet29	lec29-slides			WS29-solution
	Wed	Mar

29

27	Lecture 30:

Task Affinity and locality. Memory hierarchy

Parallel Spanning Tree, other graph algorithms

worksheet30

lec30-slides

WS30

-solution

Fri

Mar 31

Lecture 31: Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration, Topic 3.3 Lecture, Topic 3.3 Demonstrationworksheet31lec31-slidesHomework 5

Homework 4

WS31

-solution

12

Mon


	Fri	Mar 29

Apr 03

Lecture

32: Barrier Synchronization with PhasersModule 1: Section 3.4Topic 3.4 Lecture, Topic 3.4 Demonstrationworksheet32lec32-slidesWS32-solution

Wed

Apr 05

Lecture 33: Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Section 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

worksheet33lec33-slidesWS33-solution

31: Message-Passing programming model with Actors	Module 2: Sections 6.1, 6.2	Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration	worksheet31	lec31-slides			WS31-solution
12	Mon	Apr 01	Lecture 32: Active Object Pattern. Combining Actors with task parallelism	Module 2: Sections 6.3, 6.4	Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration	worksheet32	lec32-slides	Homework 4	Homework 3 (All)	WS32-solution
	Wed	Apr 03	Lecture 33: Task Affinity and locality. Memory hierarchy			worksheet33	lec33-slides			WS33-solution
	Fri	Apr 05	Lecture 34

Fri

Apr 07

Lecture 34: Fuzzy Barriers with Phasers

Module 1: Section 4.1Topic 4.1 Lecture, Topic 4.1 Demonstrationworksheet34lec34-slidesWS34-solution

13

Mon

Apr 10

Lecture 35

: Eureka-style Speculative Task Parallelism

worksheet35

worksheet34

lec35

lec34-slides

WS35

		WS34-solution
13	Mon	Apr 08	No class: Solar Eclipse
	Wed	Apr

12

10

Lecture

36

35: Scan Pattern. Parallel Prefix Sum

worksheet36

worksheet35

lec36

lec35-slides

WS36

	Homework 4 (CP 1)	WS35-solution
	Fri	Apr

14

12

Lecture

37

36: Parallel Prefix Sum applications

worksheet37

worksheet36

lec37

lec36-slides			WS36-solution
14	Mon	Apr

17

15

Lecture

38

37: Overview of other models and frameworks

lec38

			lec37-slides
	Wed	Apr

19

17

Lecture

39

38: Course Review (Lectures 19-

38

34)

lec39

	lec38-slides		Homework 4 (All)
	Fri	Apr

21

19

Lecture

40

39: Course Review (Lectures 19-

38

34)

lec40

lec39-slides

Homework 5

Lab Schedule

Lab #	Date (2023)	Topic	Handouts	Examples
1	Jan 0908	Infrastructure setup	lab0-handout lab1-handout
-	Jan 1615	No lab this week (MLK)
2	Jan 2322	Functional Programming	lab2-handout
3	Jan 3029	Java StreamsFutures	lab3-handout
4	Feb 0605	Data-Driven TasksFutures	lab4-handout
5-	Feb 13	Data-Driven Tasks	12	No lab this week lab5-handout
-	Feb 2019	No lab this week (Midterm Exam)
65	Feb 27	Async / Finish	lab6-handout	26	Loop Parallelism	lab5-handout	image kernels
6	Mar 04	7	Mar 06	Recursive Task Cutoff Strategy	lab7lab6-handout
-	Mar 1311	No lab this week (Spring Break)
87	Mar 2018	Java Threads	lab8lab7-handout
98	Mar 2725	Concurrent Lists	lab9lab8-handout
109	Apr 0301	Actors	lab10lab9-handout
11-	Apr 10	Loop Parallelism	08	No lab this week (Solar Eclipse) lab11-handout
-	Apr 1715	No lab this week

Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm. Labs must be checked off by a TA.

...

Child pages

Versions Compared

Old Version 1972

New Version 2307

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures

Child pages

Page History

Versions Compared

Old Version 1972

New Version 2307

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures