Parallel Programming of High Performance Systems 2021

Topic outline

• 

  General

  

  

  This online course, a collaboration of Erlangen National High Performance Computing Center (NHR@FAU) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC hardware, specifically the large scale parallel computing systems available in Jülich, Stuttgart and Munich, but also smaller clusters in Tier-2/3 centers and departments.
  
  The exercises given below are suggestions - you are free to play with any code you like. If you are a beginner you will probably also not be able to complete all tasks.
  

  Course date & time: April 13-15, 2021, 9:30 a.m. - 4:00 p.m.

  Contact:
  

  Dr. Georg Hager (georg.hager@fau.de)
  Dr. Volker Weinberg (weinberg@lrz.de)

  • Agenda File
  • Useful links and references Page
  • Example code ZIP File
• 

  Day 1

  • Welcome and general remarks File
  • General introduction to HPC File
  • Hands-On: logging in, editing, compiling, and starting a job Page
  • Elementary MPI and OpenMP File
  • Exercise: π by the Monte Carlo method Page
  • Shared-memory computer architecture File
• 

  Day 2

  • Advanced OpenMP Programming File
  • Thread and process binding Page
  • Fixing the clock speed of the CPUs on Meggie Page
  • Exercise: Parallel histogram computation Page
  • Exercise: Parallelization of a raytracer code Page
  • Exercise: Eliminating recursion Page
  • Distributed-Memory Computer Architecture File
  • Parallel Programming with MPI in Depth File
• 

  Day 3

  • Profiling Tool: gprof File
  • Exercise: Profiling a simple CG solver Page
  • Profiling Tool: Intel Trace Collector and Analyzer (ITAC) File
  • Exercise: analyze the MPI ray tracer Page
  • OpenMP Programming: Correctnes, Tuning, Examples File
  • Some hints at code optimization File
  • Some comments on solutions to the problems File
  • Wrapup File
• 

  Evaluation

  Please fill out the course evaluation form on the last day of the course to help us to increase the quality of our trainings.

  https://survey.lrz.de/index.php/174125?lang=en

  
  

  This survey is anonymous.

  
  

  Thank you for your collaboration and thank you for joining our course!!