COMP 515: Advanced Compilation for Vector and Parallel Processors (Fall 2015)
Prof. Vivek Sarkar, firstname.lastname@example.org, DH 3080 (office hours by appointment)
|Assistant Instructor:||Dr. Jun Shirako, email@example.com, DH 3098|
Annepha Hurlock, firstname.lastname@example.org, DH 3080, 713-348-5186
Keck 107, TTh 09:25am - 10:40am
Are you curious about what makes a parallelizing compiler tick, and what program properties enable or prevent software from executing efficiently on vector and parallel computers?
This question has taken on new importance with the ubiquity of multicore processors, and the increased interest in heterogeneous accelerators such as GPGPUs and FPGAs. To answer this question, this course will cover the foundations of advanced compilation techniques for vector and parallel computer systems, including the analysis of program dependence, program transformations to enhance parallelism, compiler management of the memory hierarchy, and inter-procedural data flow analysis. At the conclusion of the course, the students should be knowledgeable about the strengths and limitations of state-of-the-art compilers, both from the viewpoint of the compiler user as well as of the compiler designer. The techniques taught in the course should be relevant to anyone interested in enabling software to execute efficiently on vector and parallel computers, whether by hand or through the use of compilers.
Required Prerequisite: COMP 412 or equivalent
NOTE: Lectures marked ** are at non-standard times and locations. Also, topics for future lectures may be updated during the semester as the course progresses.
- Lecture 1 (08/25/2015): Compiler Challenges for High Performance Architectures (Chapter 1)
- NO CLASS (08/27/2015): Rescheduled to 08/28/2015 below
- ** Lecture 2 (08/28/2015, 4pm, DH 3076): Dependence: Theory and Practice (Chapter 2), Homework 1 assigned, due by 09/08/2015
- Lecture 3 (09/01/2015): Dependence: Theory and Practice (Chapter 2, contd)
- Lecture 4 (09/03/2015): Dependence Testing (Chapter 3)
- Lecture 5 (09/08/2015): Dependence Testing (Chapter 3, contd), Homework 2 assigned, due by 09/22/2015
- NO CLASS (09/10/2015): Work on problem statement for your class projects
- Lecture 6 (09/15/2015): Dependence Testing (Chapter 3, contd), Preliminary Transformations (Chapter 4)
- Lecture 7 (09/17/2015): Preliminary Transformations (Chapter 4, contd), Vectorization Algorithm (Chapter 2)
- Lecture 8 (09/22/2015): Vectorization Algorithm (Chapter 2, contd), Enhancing Fine-Grained Parallelism (Chapter 5), Homework 3 assigned, due by 10/08/2015
- Lecture 9 (09/24/2015): Enhancing Fine-Grained Parallelism (Chapter 5, contd)
- Lecture 10 (09/29/2015): Enhancing Fine-Grained Parallelism (Chapter 5, contd), Coarse-Grained Parallelism (Chapter 6)
- NO CLASS (10/01/2015): Work on class project
- Lecture 11 (10/06/2015): Coarse-Grained Parallelism (Chapter 6, contd), ￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼￼Optimal Weighted Loop Fusion for Parallel Programs
- NO CLASS (10/08/2015): Homework 3 due, self-study, work on project
- NO CLASS (10/13/2015): MIDTERM RECESS (discuss project with instructor)
- Lecture 12 (10/15/2015): Midterm Review, Take-home Exam 1 assigned, due by 10/22/2015
- Lecture 13 (10/20/2015): Control Dependence (Chapter 7)
- NO CLASS (10/22/2015): Work on class project, Exam 1 due
- Lecture 14 (10/27/2015): Pipeline Parallelism, OpenMP 4.1 Doacross construct (guest lecture by Dr. Jun Shirako, Rice University)
- Lecture 15 (10/29/2015): Control Dependence (Chapter 7, contd), Compiler Improvement of Register Usage (Chapter 8)
- Lecture 16 (11/03/2015): Compiler Improvement of Register Usage (Chapter 8, contd), Homework 4 assigned, due by 11/24/2015
- Lecture 17 (11/05/2015): Managing Cache (Chapter 9)
- Lecture 18 (11/10/2015): Managing Cache (Chapter 9, contd), ASTI Optimizer
- Lecture 19 (11/12/2015): Polyhedral Transformations (guest lecture by Prof. Uday Reddy, Indian Institute of Science)
- NO CLASS (11/17/2015): Self-study, work on project
- NO CLASS (11/19/2015): Self-study, work on project
- Lecture 20 (11/24/2015): Transformation Framework Case Studies
- NO CLASS (11/26/2015): THANKSGIVING
- Lecture 21 (12/01/2015): Compiling Array Assignments (Chapter 13)
- Lecture 22 (12/03/2015): End-Semester Summary (Chapters 7, 8, 9, 13), Take-home Exam 2 assigned, due by 12/11/2015
- Lecture 23 (12/08/2015): Student project presentations (special meeting time and place: 8:30am - 12noon, DH 3076)
- Course text: Optimizing Compilers for Modern Architectures, Randy Allen & Ken Kennedy.
- Automatic Selection of High Order Transformations in the IBM XL Fortran Compilers. Vivek Sarkar. IBM Journal of Research and Development, 41(3), May 1997.
- A General Framework for Iteration-Reordering Loop Transformations. Vivek Sarkar and Radhika Thekkath. Proceedings of the ACM SIGPLAN 1992 Conference on Programming Language Design and Implementation (PLDI), San Francisco, California, pages 175-187, June 1992.
- Optimal Weighted Loop Fusion for Parallel Programs. Nimrod Megiddo and Vivek Sarkar. Proceedings of the Ninth Annual ACM Symposium on Parallel Algorithms and Architecture (SPAA), Newport, Rhode Island, June, 1997, pages 282-291.
- Array SSA form and its use in Parallelization. Kathleen Knobe and Vivek Sarkar. Proceedings of the 25th ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages, San Diego, California, January 1998.
Grading, Honor Code Policy, Processes and Procedures
Grading will be based on your performance on four homeworks (weighted 30% in all), one class project to be done in pairs (weighted 30%), and two exams (weighted 20% each). Each project team will be expected to give an in-class presentation on their project at the end of the semester, and to submit a report by December 11, 2015.
The purpose of the homeworks is to train you to solve problems and to help deepen your understanding of concepts introduced in class. Homeworks are due on the dates and times specified in the course schedule. Homework is worth full credit when turned in on time. A 10% penalty per day will be levied on late homeworks, up to a maximum of 6 days. No submissions will be accepted more than 6 days after the due date. If you believe we have made an error in grading your homework or exam, please bring the matter to our attention within one week after you receive the graded material.
You will be expected to follow the Honor Code in all homeworks and exams. All submitted homeworks are expected to be the result of your individual effort. You are free to discuss course material and approaches to homework problems with your other classmates, the teaching assistants and the professor, but you should never misrepresent someone else's work as your own. If you use any material from external sources, you must provide proper attribution (as shown here). Exams 1 and 2 are pledged under the Honor Code. They test your individual understanding and knowledge of the material. Collaboration on exams is strictly forbidden. Finally, it is also your responsibility to protect your homeworks and exams from unauthorized access.
If you believe we have made an error in grading your homework or exam, please bring the matter to our attention within one week.
Accommodations for Students with Special Needs
Students with disabilities are encouraged to contact us during the first two weeks of class regarding any special needs. Students with disabilities should also contact Disabled Student Services in the Ley Student Center and the Rice Disability Support Services.