...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)

Instructor:	Mackale Joyner, DH 2063	TAs:	Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar
Piazza site:	https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)	Cross-listing:	ELEC 323
Lecture location:	Herzstein AmphitheaterAmp	Lecture times:	MWF 1:00pm - 1:50pm
Lab locations:	Mon (Herzstein AmpBrockman 101) , Tue (Keck 100Herzstein Amp)	Lab times:	Mon 3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha)Tue 4HA, AO) Tue 4:00pm - 4:50pm 50pm (Tina, Delaney, Chase, Hung, Jerry, Kailin, JasmineRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here. Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

Module 1 handout (Parallelism)
Module 2 handout handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course. You are encouraged to get copies of any or all of these books. They will serve as useful references both during and after this course:

Fork-Join Parallelism with a Data-Structures Focus (FJP) by Dan Grossman (Chapter 7 in Topics in Parallel and Distributed Computing)
Java Concurrency in Practice by Brian Goetz with Tim Peierls, Joshua Bloch, Joseph Bowbeer, David Holmes and Doug Lea
Principles of Parallel Programming by Calvin Lin and Lawrence Snyder
The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit

Lecture Schedule

Week	Day	Date (

2023

2024)	Lecture	Assigned Reading	Assigned Videos (see Canvas site for video links)	In-class Worksheets	Slides	Work Assigned	Work Due	Worksheet Solutions
1	Mon	Jan

09

08	Lecture 1: Introduction			worksheet1	lec1-slides			WS1-solution
	Wed	Jan

11

10	Lecture 2: Functional Programming			worksheet2	lec02-slides			WS2-solution
	Fri	Jan

13

12	Lecture 3: Higher order functions			worksheet3	lec3-slides			WS3-solution
2	Mon	Jan

16

15	No class: MLK
	Wed	Jan

18

17	Lecture 4: Lazy Computation			worksheet4	lec4-slides			WS4-solution
	Fri	Jan

20

19	Lecture 5: Java Streams			worksheet5	lec5-slides	Homework 1		WS5-solution
3	Mon	Jan

23

22	Lecture 6: Map Reduce with Java Streams	Module 1: Section 2.4	Topic 2.4 Lecture, Topic 2.4 Demonstration	worksheet6	lec6-slides			WS6-solution
	Wed	Jan

25

24	Lecture 7: Futures	Module 1: Section 2.1	Topic 2.1 Lecture , Topic 2.1 Demonstration	worksheet7	lec7-slides			WS7-solution
	Fri	Jan

27

26	Lecture 8: Async, Finish, Computation Graphs	Module 1: Sections 1.1, 1.2	Topic 1.1 Lecture, Topic 1.1 Demonstration, Topic 1.2 Lecture, Topic 1.2 Demonstration	worksheet8	l ec8-slides			WS8-solution
4	Mon	Jan

30

29

Lecture 9: Ideal Parallelism, Data-Driven Tasks

Module 1: Section 1.3, 4.5

Topic 1.3 Lecture, Topic 1.3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-slides

WS9-solution

Wed

Feb 01

Jan 31	Lecture 10: Event-based programming model			worksheet10	lec10-slides		Homework 1	WS10-solution
	Fri	Feb

03

02	Lecture 11: GUI programming, Scheduling/executing computation graphs	Module 1: Section 1.4	Topic 1.4 Lecture , Topic 1.4 Demonstration	worksheet11	lec11-slides	Homework 2		WS11-solution
5	Mon	Feb

06

05	Lecture 12: Abstract performance metrics, Parallel Speedup, Amdahl's Law	Module 1: Section 1.5	Topic 1.5 Lecture , Topic 1.5 Demonstration	worksheet12	lec12-slides			WS12-solution
	Wed	Feb

08

07	Lecture 13: Accumulation and reduction. Finish accumulators	Module 1: Section 2.3	Topic 2.3 Lecture Topic 2.3 Demonstration	worksheet13	lec13-slides			WS13-solution
	Fri	Feb

10

09	No class: Spring Recess
6	Mon	Feb

13

12	Lecture 14: Data Races, Functional & Structural Determinism	Module 1: Sections 2.5, 2.6	Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.6 Lecture, Topic 2.6 Demonstration	worksheet14	lec14-slides			WS14-solution
	Wed	Feb

15

14

Lecture 15: Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet15

lec15-slides

Homework 2

WS15-solution

Fri

Feb

17

16	Lecture 16: Recursive Task Parallelism			worksheet16	lec16-slides	Homework 3		WS16-solution
7	Mon	Feb

20

19	Lecture 17: Midterm Review				lec17-slides
	Wed	Feb

22

21	Lecture 18: Midterm Review				lec18-slides
	Fri	Feb

24

23	Lecture 19:

Data-Parallel Programming model. Loop-Level Parallelism, Loop ChunkingModule 1: Sections 3.1, 3.2, 3.3Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration,

Fork/Join programming model. OS Threads. Scheduler Pattern

Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8

Topic 3.3 Lecture, Topic 3.3

Demonstration	worksheet19	lec19-slides			WS19-solution
8	Mon	Feb

27

26	Lecture 20:

Barrier Synchronization with Phasers

Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.

4 Topic

1, 3.

4 Lecture

2,

Topic 3.4

3.3

Topic 3.1 Lecture, Topic 3.1 Demonstration , Topic 3.2 Lecture, Topic 3.2 Demonstration, Topic 3.3 Lecture, Topic 3.3 Demonstration

worksheet20

lec20-slides

			WS20-solution
	Wed

Mar 01

Feb 28

Lecture 21:

Stencil computation. Point-to-point

Barrier Synchronization with Phasers

Module 1: Sections

4.2, 4.3

3.4

Topic 3.4

.2

Lecture, Topic

4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3

3.4 Demonstration	worksheet21	lec21-slides			WS21-solution
	Fri	Mar

03

01	Lecture 22:

Fuzzy Barriers

Stencil computation. Point-to-point Synchronization with Phasers

Module 1:

Section 4.1

Sections 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3

Topic 4.1

Lecture, Topic 4.

1

3 Demonstration	worksheet22	lec22-slides			WS22-solution
9	Mon	Mar

06

04	Lecture 23:

Java Threads and Locks

Fuzzy Barriers with Phasers

Module

2

1:

Sections 7

Section 4.1

, 7.3

Topic 4

Topic 7

.1 Lecture, Topic

7

4.

3 Lecture

1 Demonstration	worksheet23	lec23-slides		Homework 3 (CP 1)	WS23-solution
	Wed	Mar

08

06	Lecture 24:

Java Locks - Soundness and progress guarantees

Confinement & Monitor Pattern. Critical sections
Global lock

Module 2:

7

Sections 5.1, 5.2

Topic

7

5.

5 Lecture

1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstration	worksheet24	lec24-slides			WS24-solution
	Fri	Mar

10

08	Lecture 25:

Dining Philosophers Problem

Atomic variables, Synchronized statements

Module 2: Sections 5.4, 7.

6

2

Topic

7

5.

6 Lectureworksheet25

4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture

worksheet25

l ec25

lec25

-slides			WS25-solution
	Mon	Mar

13

11	No class: Spring Break
	Wed	Mar

15

13	No class: Spring Break
	Fri	Mar

17

15	No class: Spring Break
10	Mon	Mar

20

18	Lecture 26:

N-Body problem, applications and implementations

Java Threads and Locks	Module 2: Sections 7.1, 7.3	Topic 7.1 Lecture, Topic 7.3 Lecture	worksheet26	lec26-slides			WS26-solution
	Wed	Mar

22

20	Lecture 27: Read-Write Locks,

Linearizability of Concurrent Objects

Soundness and progress guarantees

Module 2: Section 7.3

, 7.4

Topic 7.3 Lecture, Topic 7.

4

5 Lecture	worksheet27	lec27-slides		Homework 3 (CP 2)	WS27-solution
	Fri	Mar

24

22	Lecture 28:

Message-Passing programming model with ActorsModule 2: 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration

Dining Philosophers Problem

Topic 7.6 Lecture

worksheet28

lec28-slides

WS28-solution

11

Mon

Mar

27

25	Lecture 29:

Active Object Pattern. Combining Actors with task parallelism

Linearizability of Concurrent Objects

Module 2:

6.3, 6

Sections 7.4

Topic

6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration

7.4 Lecture	worksheet29	lec29-slides			WS29-solution
	Wed	Mar

29

27	Lecture 30:

Task Affinity and locality. Memory hierarchy

Parallel Spanning Tree, other graph algorithms

worksheet30

lec30-slides

Homework 3 (All)

		WS30-solution
	Fri	Mar

31

29	Lecture 31:

Fork/Join

Message-Passing programming model

. OS Threads. Scheduler Pattern

with Actors

Module 2: Sections 6.1, 6.2

Topic 6.1

Topic 2.7

Lecture, Topic

2

6.

7

1 Demonstration, Topic 6.2

.8

Lecture, Topic 6.2

.8

Demonstration

worksheet31

lec31-slides

Homework 4

		WS31-solution
12	Mon	Apr

03

01	Lecture 32:

Confinement & Monitor

Active Object Pattern.

Critical sections
Global lock

Combining Actors with task parallelism

Module 2:

Section 5

Sections 6.

1

3,

5.2, 5.6

6.4

Topic

5

6.

1

3 Lecture, Topic

5

6.

1

3 Demonstration, Topic

5

6.

2 Lecture, Topic 5.2 Demonstration

4 Lecture, Topic

5.

6

Lecture, Topic 5

.

6

4 Demonstration	worksheet32	lec32-slides	Homework 4	Homework 3 (All)	WS32-solution
	Wed	Apr

05

03	Lecture 33:

Atomic variables, Synchronized statementsModule 2: Section 5.4, 7.2Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture

Task Affinity and locality. Memory hierarchy			worksheet33	lec33-slides			WS33-solution
	Fri	Apr

07

05	Lecture 34:

Parallel Spanning Tree, other graph algorithms

Eureka-style Speculative Task Parallelism			worksheet34	lec34-slides			WS34-solution
13	Mon	Apr

10

08

Lecture 35: Eureka-style Speculative Task Parallelismworksheet35lec35-slidesWS35-solution

No class: Solar Eclipse
	Wed	Apr

12

10

Lecture

36

35: Scan Pattern. Parallel Prefix Sum

worksheet36

worksheet35

lec36

lec35-slides

WS36

	Homework 4 (CP 1)	WS35-solution
	Fri	Apr

14

12

Lecture

37

36: Parallel Prefix Sum applications

worksheet37

worksheet36

lec37

lec36-slides			WS36-solution
14	Mon	Apr

17

15

Lecture

38

37: Overview of other models and frameworks

lec38

			lec37-slides
	Wed	Apr

19

17

Lecture

39

38: Course Review (Lectures 19-

38

34)

lec39

	lec38-slides		Homework 4 (All)
	Fri	Apr

21

19

Lecture

40

39: Course Review (Lectures 19-

38

34)

lec40

lec39-slides

Lab Schedule

Lab #	Date (2023)	Topic	Handouts	Examples
1	Jan 0908	Infrastructure setup	lab0-handout lab1-handout
-	Jan 1615	No lab this week (MLK)
2	Jan 2322	Functional Programming	lab2-handout
3	Jan 3029	Futures	lab3-handout
4	Feb 0605	Data-Driven Tasks	lab4-handout
5-	Feb 13	Async / Finish	lab5-handout	12	No lab this week
-	Feb 19	-	Feb 20	No lab this week (Midterm Exam)
65	Feb 2726	Loop Parallelism	lab6lab5-handout	image kernels
76	Mar 0604	Recursive Task Cutoff Strategy	lab7lab6-handout
-	Mar 1311	No lab this week (Spring Break)
87	Mar 2018	Java Threads	lab8lab7-handout
98	Mar 2725	Concurrent Lists	lab9lab8-handout
-9	Apr 03	TBD	01	Actors	lab9-handout
-10	Apr 10	Actors	08	No lab this week (Solar Eclipse) lab10-handout
-	Apr 1715	No lab this week

Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm. Labs must be checked off by a TA.

...

Child pages

Versions Compared

Old Version 2070

New Version 2307

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures

Child pages

Page History

Versions Compared

Old Version 2070

New Version 2307

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures