...

Home

Office Hours

HJlib Info

edX site

Autograder Guide

Other Resources

COMP 322: Fundamentals of Parallel Programming (Spring

...

2024)

Instructor:	Mackale Joyner, DH 2063	TAs:	Mohamed Abead, Chase Hartsell, Taha Hasan, Harrison Huang, Jerry Jiang, Jasmine Lee, Michelle Lee, Hung Nguyen, Quang Nguyen, Ryan Ramos, Oscar Reynozo, Delaney Schultz, Tina Wen, Raiyan Zannat, Kailin ZhangHaotian Dang, Andrew Ondara, Stefan Boskovic, Huzaifa Ali, Raahim Absar
Piazza site:	https://piazza.com/rice/spring2023spring2024/comp322 (Piazza is the preferred medium for all course communications)	Cross-listing:	ELEC 323
Lecture location:	Herzstein AmphitheaterAmp	Lecture times:	MWF 1:00pm - 1:50pm
Lab locations:	Mon (Herzstein AmpBrockman 101) , Tue (Keck 100Herzstein Amp)	Lab times:	Mon 3:00pm - 3:50pm (RaiyanSB, Oscar, Mohamed, Ryan, Michelle, Taha, Jasmine)HA, AO) Tue 4Tue 4:00pm - 4:50pm 50pm (Tina, Delaney, Chase, Hung, Jerry, KailinRA, HD)

Course Syllabus

A summary PDF file containing the course syllabus for the course can be found here. Much of the syllabus information is also included below in this course web site, along with some additional details that are not included in the syllabus.

...

Module 1 handout (Parallelism)
Module 2 handout handout (Concurrency)

There are also a few optional textbooks that we will draw from during the course. You are encouraged to get copies of any or all of these books. They will serve as useful references both during and after this course:

Fork-Join Parallelism with a Data-Structures Focus (FJP) by Dan Grossman (Chapter 7 in Topics in Parallel and Distributed Computing)
Java Concurrency in Practice by Brian Goetz with Tim Peierls, Joshua Bloch, Joseph Bowbeer, David Holmes and Doug Lea
Principles of Parallel Programming by Calvin Lin and Lawrence Snyder
The Art of Multiprocessor Programming by Maurice Herlihy and Nir Shavit

Lecture Schedule

Week	Day	Date (

2023

2024)	Lecture	Assigned Reading	Assigned Videos (see Canvas site for video links)	In-class Worksheets	Slides	Work Assigned	Work Due	Worksheet Solutions
1	Mon	Jan

09

08	Lecture 1: Introduction			worksheet1	lec1-slides			WS1-solution
	Wed	Jan

11

10	Lecture 2: Functional Programming			worksheet2	lec02-slides			WS2-solution
	Fri	Jan

13

12	Lecture 3: Higher order functions			worksheet3	lec3-slides			WS3-solution
2	Mon	Jan

16

15	No class: MLK
	Wed	Jan

18

17	Lecture 4: Lazy Computation			worksheet4	lec4-slides			WS4-solution
	Fri	Jan

20

19	Lecture 5: Java Streams			worksheet5	lec5-slides	Homework 1		WS5-solution
3	Mon	Jan

23

22	Lecture 6: Map Reduce with Java Streams	Module 1: Section 2.4	Topic 2.4 Lecture, Topic 2.4 Demonstration	worksheet6	lec6-slides			WS6-solution
	Wed	Jan

25

24	Lecture 7: Futures	Module 1: Section 2.1	Topic 2.1 Lecture , Topic 2.1 Demonstration	worksheet7	lec7-slides			WS7-solution
	Fri	Jan

27

26	Lecture 8: Async, Finish, Computation Graphs	Module 1: Sections 1.1, 1.2	Topic 1.1 Lecture, Topic 1.1 Demonstration, Topic 1.2 Lecture, Topic 1.2 Demonstration	worksheet8	l ec8-slides			WS8-solution
4	Mon	Jan

30

29

Lecture 9: Ideal Parallelism, Data-Driven Tasks

Module 1: Section 1.3, 4.5

Topic 1.3 Lecture, Topic 1.3 Demonstration, Topic 4.5 Lecture, Topic 4.5 Demonstration

worksheet9

lec9-slides

WS9-solution

Wed

Feb 01

Jan 31	Lecture 10: Event-based programming model			worksheet10	lec10-slides		Homework 1	WS10-solution
	Fri	Feb

03

02	Lecture 11: GUI programming, Scheduling/executing computation graphs

Abstract performance metrics

	Module 1: Section 1.4	Topic 1.4 Lecture , Topic 1.4 Demonstration	worksheet11	lec11-slides	Homework 2		WS11-solution
5	Mon	Feb

06

05	Lecture 12:

GUI programming

Abstract performance metrics, Parallel Speedup, Amdahl's Law	Module 1: Section 1.5	Topic 1.5 Lecture , Topic 1.5 Demonstration	worksheet12	lec12-slides			WS12-solution
	Wed	Feb

08

07	Lecture 13: Accumulation and reduction. Finish accumulators	Module 1: Section 2.3	Topic 2.3 Lecture Topic 2.3 Demonstration	worksheet13	lec13-slides			WS13-solution
	Fri	Feb

10

09	No class: Spring Recess
6	Mon	Feb

13

12	Lecture 14:

Recursive Task Parallelism worksheet14lec14-slidesWS14-solution

Wed

Feb 15Lecture 15:

Data Races, Functional & Structural Determinism

Module 1: Sections 2.5, 2.6

Topic 2.5 Lecture , Topic 2.5 Demonstration, Topic 2.6 Lecture, Topic 2.6 Demonstration

worksheet15

worksheet14

lec15WS15

lec14-slides

Homework 2

WS14-solution

Fri


	Wed	Feb

17

14

Lecture

16

15: Limitations of Functional parallelism.
Abstract vs. real performance. Cutoff Strategy

worksheet15

lec15-slides

Homework 2

WS15-solution

Fri

Feb 16

Lecture 16: Recursive Task Parallelism

worksheet16

lec16-slides

Homework 3

WS16-solution

7

Mon

Feb

20

19	Lecture 17: Midterm Review				lec17-slides
	Wed	Feb

22

21

Lecture 18: Midterm Review

lec18-slides

WS18-solution


	Fri	Feb

24

23	Lecture 19: Fork/Join programming model. OS Threads. Scheduler Pattern

Topic 2.7 Lecture, Topic 2.7 Demonstration, Topic 2.8 Lecture, Topic 2.8 Demonstration

,

	worksheet19	lec19-slides			WS19-solution
8	Mon	Feb

27

26	Lecture 20:

Confinement & Monitor Pattern. Critical sections
Global lock Module 2: Sections 5.1, 5.2, 5.6 Topic 5

Data-Parallel Programming model. Loop-Level Parallelism, Loop Chunking

Module 1: Sections 3.1, 3.2, 3.3

Topic 3.1 Lecture, Topic

5

3.1 Demonstration , Topic

5

3.2 Lecture,

Topic 5

Topic 3.2 Demonstration, Topic

5

3.

6

3 Lecture,

Topic 5

Topic 3.

6

3 Demonstration

worksheet20

lec20-slides

			WS20-solution
	Wed

Mar 01

Feb 28

Lecture 21:

Atomic variables, Synchronized statements

Barrier Synchronization with Phasers

Module

2

1: Sections

5.4, 7.2Topic 5

3.4	Topic 3.4 Lecture, Topic

5

3.4 Demonstration

, Topic 7.2 Lecture

worksheet21

lec21-slides

Homework 3

			WS21-solution
	Fri	Mar

03

01	Lecture 22:

Parallel Spanning Tree, other graph algorithms

Stencil computation. Point-to-point Synchronization with Phasers

Module 1: Sections 4.2, 4.3

Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

worksheet22

lec22-slides

WS22-

worksheet22lec22-slidesHomework 4WS22-

solution
9	Mon	Mar

06

04	Lecture 23:

Java Threads and Locks

Fuzzy Barriers with Phasers

Module

2

1:

Sections 7

Section 4.1

, 7.3

Topic 4

Topic 7

.1 Lecture, Topic

7

4.

3 Lecture

1 Demonstration

worksheet23

lec23-slides

WS23

	Homework 3 (CP 1)	WS23-solution
	Wed	Mar

08

06	Lecture 24:

Java Locks - Soundness and progress guarantees

Confinement & Monitor Pattern. Critical sections
Global lock

Module 2:

7

Sections 5.1, 5.2

Topic 7.5 Lecture

Topic 5.1 Lecture, Topic 5.1 Demonstration, Topic 5.2 Lecture, Topic 5.2 Demonstration, Topic 5.6 Lecture, Topic 5.6 Demonstration	worksheet24	lec24-slides			WS24-solution
	Fri	Mar

10

08	Lecture 25:

Dining Philosophers Problem

Atomic variables, Synchronized statements

Module 2: Sections 5.4, 7.

6Topic 7.6 Lecture

2

Topic 5.4 Lecture, Topic 5.4 Demonstration, Topic 7.2 Lecture

worksheet25

lec25

l ec25-slides			WS25-solution
	Mon	Mar

13

11	No class: Spring Break
	Wed	Mar

15

13	No class: Spring Break
	Fri	Mar

17

15	No class: Spring Break
10	Mon	Mar

20Lecture 26: N-Body problem, applications and implementations

18	Lecture 26: Java Threads and Locks	Module 2: Sections 7.1, 7.3	Topic 7.1 Lecture, Topic 7.3 Lecture	worksheet26	lec26-slides			WS26-solution
	Wed	Mar

22

20	Lecture 27: Read-Write Locks,

Linearizability of Concurrent Objects

Soundness and progress guarantees

Module 2: Section 7.3

, 7.4

Topic 7.3 Lecture, Topic 7.

4

5 Lecture	worksheet27	lec27-slides		Homework 3 (CP 2)	WS27-solution
	Fri	Mar

24

22	Lecture 28

: Message-Passing programming model with ActorsModule 2: 6.1, 6.2Topic 6.1 Lecture, Topic 6.1 Demonstration, Topic 6.2 Lecture, Topic 6.2 Demonstration

: Dining Philosophers Problem

Topic 7.6 Lecture

worksheet28

lec28-slides

WS28-solution

11

Mon

Mar

27

25	Lecture 29:

Active Object Pattern. Combining Actors with task parallelism

Linearizability of Concurrent Objects

Module 2: Sections 7.4

Topic 7.4 Lecture

Module 2: 6.3, 6.4Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture, Topic 6.4 Demonstration

	worksheet29	lec29-slides			WS29-solution
	Wed	Mar

29

27	Lecture 30:

Task Affinity and locality. Memory hierarchy

Parallel Spanning Tree, other graph algorithms

worksheet30

lec30-slides

Homework 4

		WS30-solution
	Fri	Mar

31

29	Lecture 31:

Data

Message-

Parallel Programming model. Loop-Level Parallelism, Loop ChunkingModule 1: Sections 3

Passing programming model with Actors

Module 2: Sections 6.1,

3

6.2

, 3.3

Topic

3

6.1 Lecture, Topic

3

6.1 Demonstration, Topic

3

6.2 Lecture,

Topic 3

Topic 6.2 Demonstration

, Topic 3.3 Lecture, Topic 3.3 Demonstration

worksheet31

lec31-slides

Homework 5

		WS31-solution
12	Mon	Apr

03

01	Lecture 32:

Barrier Synchronization with Phasers

Active Object Pattern. Combining Actors with task parallelism

Module

1

2:

Section

Sections 6.3, 6.4

Topic 3

Topic 6.3 Lecture, Topic 6.3 Demonstration, Topic 6.4 Lecture,

Topic 3

Topic 6.4 Demonstration	worksheet32	lec32-slides	Homework 4	Homework 3 (All)	WS32-solution
	Wed	Apr

05

03	Lecture 33:

Stencil computation. Point-to-point Synchronization with PhasersModule 1: Section 4.2, 4.3Topic 4.2 Lecture, Topic 4.2 Demonstration, Topic 4.3 Lecture, Topic 4.3 Demonstration

Task Affinity and locality. Memory hierarchy			worksheet33	lec33-slides			WS33-solution
	Fri	Apr

07

05	Lecture 34:

Fuzzy Barriers with PhasersModule 1: Section 4.1Topic 4.1 Lecture, Topic 4.1 Demonstration

Eureka-style Speculative Task Parallelism			worksheet34	lec34-slides			WS34-solution
13	Mon	Apr

10

08

Lecture 35: Eureka-style Speculative Task Parallelismworksheet35lec35-slidesWS35-solution

No class: Solar Eclipse
	Wed	Apr

12

10

Lecture

36

35: Scan Pattern. Parallel Prefix Sum

worksheet36

worksheet35

lec36

lec35-slides

Homework 4 (CP 1)

WS35

WS36

-solution
	Fri	Apr

14

12

Lecture

37

36: Parallel Prefix Sum applications

worksheet37

worksheet36

lec37

lec36-slides			WS36-solution
14	Mon	Apr

17

15

Lecture

38

37: Overview of other models and frameworks

lec38

			lec37-slides
	Wed	Apr

19

17

Lecture

39

38: Course Review (Lectures 19-

38

34)

lec39

lec38-slides

Homework

5

4 (All)
	Fri	Apr

21

19

Lecture

40

39: Course Review (Lectures 19-

38

34)

lec40

lec39-slides

Lab Schedule

Lab #	Date (2023)	Topic	Handouts	Examples
1	Jan 0908	Infrastructure setup	lab0-handout lab1-handout
-	Jan 1615	No lab this week (MLK)
2	Jan 2322	Functional Programming	lab2-handout
3	Jan 3029	Futures	lab3-handout
4	Feb 0605	Data-Driven Tasks	lab4-handout
-	Feb 1312	No lab this weekTBD
-	Feb 2019	No lab this week (Midterm Exam)
5	Feb 2726	Loop Parallelism Async / Finish	lab5-handout	image kernels
6	Mar 0604	Recursive Task Cutoff Strategy	lab6-handout
-	Mar 1311	No lab this week (Spring Break)
7	Mar 2018	Java Threads	lab7-handout
8	Mar 2725	Concurrent Lists	lab8-handout
9	Apr 0301	Actors	lab9-handout
10-	Apr 10	Loop Parallelism	08	No lab this week (Solar Eclipse) lab10-handout
-	Apr 1715	No lab this week

Grading, Honor Code Policy, Processes and Procedures

...

Labs must be submitted by the following Wednesday Monday at 4:30pm3pm. Labs must be checked off by a TA.

...

Child pages

Versions Compared

Old Version 2005

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures

Child pages

Page History

Versions Compared

Old Version 2005

New Version Current

Key

COMP 322: Fundamentals of Parallel Programming (Spring

2024)

Course Syllabus

Lecture Schedule

Lab Schedule

Grading, Honor Code Policy, Processes and Procedures