CPT S 411: Introduction to Parallel Computing

Fall 2020

(August 24, 2020 - December 22, 2020)
SCHOOL OF EECS
WASHINGTON STATE UNIVERSITY

TuTh 12:05-13:20

(Zoom-based live synchronous delivery)

Course Information        Policies      Lecture Notes        Course Schedule        Programming Projects    White Paper    (old announcements archive)

CURRENT ANNOUNCEMENTS

• White Paper specifications are now posted - click above on the White Paper.
• Programming project #4 has been posted.
• Programming project #3 has been posted. Click on the link above for projects.

Instructor:

ANANTH KALYANARAMAN

EME 237, 335-6760

Weekly office hours:  Mondays 3:30-4:30pm PDT (virtual, over Zoom)

Instructor contact:

• For all face-to-face meetings, we will use Zoom. Please use the office hour above as the time when the instructor will be available (unless otherwise explicitly noted). No appointment needed for office hours. For meetings at other times, appointments needed.
• For all discussions use Piazza (for CptS 411 - Fall 2020).
  
• Directly emailing the instructor is prohibited. You need to use only Piazza (use private note) for all communication with the instructor and students about the course.
  

Teaching Assistant:

        Kaniz Fatema Madhobi, PhD student, EECS
        Weekly office hour: Thursdays 3-4pm PDT (virtual, over Zoom)

Syllabus:

    This course will serve as a basic introduction to the field of parallel computing. Emphasis will be on the fundamental principles for parallel algorithm design and analysis, and parallel programming for distributed and shared memory parallel machines. Topics to be covered (not necessarily in order) include (but not limited to):

1. Fundamentals in parallel algorithm design and analysis
2. Parallel computation models
3. Network intraconnects and embeddings
4. MPI programming
5. OpenMP shared memory multicore programming
6. Parallel reduction operations
7. Parallel prefix and applications
8. Parallel sorting algorithms
9. Parallel matrix operations
10. Parallel scientific computing applications
11. Parallel graph analytics
12. Other parallel programming models

Reference texts:

    There will *not* be any required text for this edition of the course. We will use the lecture notes available online on this website, along with lecture scribes, and a variety of online tutorials and reading materials identified by the instructor (also made available through the Lecture Notes link on this page). You will need a login/password to access the lecture materials. The instructor will provide this in class.

The following books will serve as references (no need to purchase):

• "Introduction to Parallel Computing" by A. Grama, G. Karypis, V. Kumar, A. Gupta, Addison-Wesley, 2nd Edition
• "Introduction to Parallel Programming" by Peter S. Pacheco, Morgan Kaufmman
• "Parallel Programming with MPI" by Peter S. Pacheco, Morgan Kaufmman
• "Using OpenMP" by B. Chapman, G. Jost, A.R.van der Pas, The MIT Press
• "Introduction to Parallel Algorithms and Architectures" by F.T. Leighton, Morgan Kaufmann

Course Prerequisites:

• CptS 223 (Advanced Data Structures) or equivalent is required
  
• Familiarity with design and analysis of algorithms is highly recommended but not required ( i.e., Cpt S 350/algorithm design & analysis or equivalent).
• Extensive programming experience in C or C/C++ is required.
• Basic knowledge and experience using Unix/Linux environments.

 Interested students who do not meet the above criteria are highly encouraged to contact the instructor to discuss the possibility of enrolling into the course.

Course Webpage & Blackboard:

    The course will use three web resources each for a different purpose:

• This "course website" (i.e., this page you are reading now) is where lecture notes, all assignments will be posted, and the course schedule will be maintained.
• WSU Blackboard learn (https://learn.wsu.edu/) will be used for assignment submissions and for emailing purposes.
  
• Piazza (https://piazza.com/) will be used for online discussions and course-related announcements.
  

Grading policy:

• (5%) Homeworks
• (55%) Programming projects
• (20%) 1 midterm exam
• (15%) White paper 
• (5%) Classroom participation

Policies relating to Exams and Assignments:

  (must read)

A good rule of thumb:  If you are in doubt about what constitutes cheating vs. allowed collaboration, please ask the instructor prior to performing the work.

Graduate students: please also refer to http://gradschool.wsu.edu/FacultyStaff/Committee/

Late submission policy:

• No late submissions will be allowed on homeworks unless the instructor grants an extension to the entire class.
• For programming projects, a 24-hour grace period will be provided with 10% penalty in points. Projects submitted after the 24-hour grace period will not be graded.
• Exceptions to the above rules may be made under extraordinary circumstances upon obtaining prior permission from the instructor, at least 1 week prior to the submission date. Last minute permissions will not be entertained.

Exam policy: comprehensive (more instructions will be given closer to the exam dates)

PROGRAMMING ASSIGNMENTS  - click on this link

HOMEWORKS

• All homework problems will be posted/updated in this PDF throughout the course.
  

Click here to download the cover sheet for use in all the homeworks and programming projects 

LEARNING OUTCOMES

• Obtain a conceptual understanding of the fundamental principles behind parallel computing, parallel programming models, and parallel algorithm design and analysis.

• Obtain proficiency in parallel programming using primarily MPI and OpenMP (for distributed memory and shared memory multicore machines, respectively), while also being able to identify other emerging parallel computing models and environments.

• Obtain proficiency in parallel algorithm design by demonstrating the ability to design parallel algorithms , analyze their complexities, estimate/predict performance, implement and explain empirical observations.

• Demonstrate the ability to differentiate among parallel architectures and network interconnect models.

• Obtain proficiency in reporting of empirical tests and programming exercises in a manner that is consistent with scientific literature.

SAFETY ON CAMPUS

Washington State University is committed to enhancing the safety of the students, faculty, staff, and visitors. It is highly recommended that you review the Campus Safety Plan (http://safetyplan.wsu.edu/) and visit the Office of Emergency Management web site (http://oem.wsu.edu/) for a comprehensive listing of university policies, procedures, statistics, and information related to campus safety, emergency management, and the health and welfare of the campus community

STUDENTS WITH DISABILITIES

Reasonable accommodations are available for students with a documented disability or chronic medical or psychological conditions. If you have a disability and need accommodations to fully participate in this class, please either visit or call the Access Center/Services website to follow published procedures to request accommodations. Students may also contact their campus offices to schedule an appointment with a Disability Specialist. All disability related accommodations are to be approved through the Access Center/Services on your campus. It is a university expectation that students visit with instructors (via email, Zoom, or in person - as dictated by the mode of instruction) to discuss logistics within two weeks after they have officially requested their accommodations.

For more information contact a Disability Specialist on your home campus:

• Pullman, WSU Global Campus, Everett, Bremerton, and Puyallup: 509-335-3417 Access Center (https://www.accesscenter.wsu.edu) or email at access.center@wsu.edu
• Spokane: 509-358-7816 Access Services (https://spokane.wsu.edu/studentaffairs/access-resources/) or email j.schneider@wsu.edu
• Tri-Cities: Access Services (http://www.tricity.wsu.edu/disability/) or email g.hormel@wsu.edu
• Vancouver: 360-546-9238 Access Center (https://studentaffairs.vancouver.wsu.edu/student-wellness-center/access-center) or email van.access.center@wsu.edu

• Programming Project #2 has been posted above. Please click on the Programming projects link above and scroll to the projects section.
• Programming Project #1 has been posted. Please click on the Programming Projects link above.
• Welcome all to the Fall'20 class of CptS 411!
• ALL operations in this course will be conducted via distance learning (there will be no component that requires in-person attendance).
• Our first lecture will be on Tuesday August 25, 12:05pm. The Zoom link for all lectures are available on Blackboard learn. 
• Tech ready checklist  PDF
• Academic integrity policy  PDF