This course, a collaboration of Erlangen Regional Computing Center (RRZE) and Leibniz Supercomputing Center (LRZ), is targeted at students and scientists with interest in programming modern HPC hardware, specifically the large scale parallel computing systems available in Jülich, Stuttgart and Munich, but also smaller clusters in Tier-2 centers and departments.
The exercises given below are suggestions - you are free to play with any code you like. If you are a beginner you will probably also not be able to complete all tasks.
- Topics 1-5 below refer to the February 25 - March 1 course phase (taking place at LRZ)
- Topics 6-9 refer to the March 18-21 course phase ("Advanced Topics", taking place at LRZ)
LRZ Building, Boltzmannstr. 1, D-85748 Garching bei Muenchen, Kursraum 2, H.U.010
Dr. Georg Hager (email@example.com)
Dr. Volker Weinberg (firstname.lastname@example.org)
- Day 1
The lectures on day 1 cover general tools and practices that are useful for working in programming environments, and specifically when dealing with HPC systems.
- Day 2
Day 2 gives an introduction to the dominant HPC programming models (MPI and OpenMP) as well as to computer architecture on a general level.
- Day 3
On day 3 we cover the principles of serial code optimization, and in the afternoon we get an in-depth look at some features of MPI.
- Day 4
The lectures of day 4 introduce parallelism on a theoretical level (parallel patterns, performance models) and the different variants and structures of parallel computer systems.
We also cover some advanced correctness and performance issues with OpenMP.
- Day 5
Day 5 is deals with Intel tools for performance analysis, tuning and correctness checking of parallel programs. It also introduces the Scalasca tuning framework. In addition, version control with SVN and GIT is covered.
- Day 6
PRACE Course: Advanced Topics in High Performance Computing
This workshop is a PRACE Training Course courtesy the agreement of the Gauss Supercomputing Centre with PRACE with respect to Europe-wide HPC training. LRZ is obliged to PRACE for partial support of the costs for this event.
Day A1 of the advanced topics course deals with node-level code optimisation.
- Day 7
Day A2 deals with MPI-I/O, I/O on LRZ's HPC systems, as well as introducing specialised I/O libraries.
- Day 8
Day A3 continues with I/O libraries and provides a special public lecture about the Intel Xeon Scalable (Skylake) processor architecture.
- Day 9
Parallel programming with PGAS languages