• G. Hager and G. Wellein: Introduction to High Performance Computing for Scientists and Engineers, ISBN 143981192X, CRC Computational Science Series, 2010.
  • S. Goedecker and A. Hoisie: Performance Optimization of Numerically Intensive Codes. Like many HPC books, pretty outdated but still very useful. Does not cover recent developments like SIMD instruction sets or multicore.
  • K. Wadleigh and I. Crawford: Software Optimization for High Performance Computing. This is a very good book that is however slightly outdated and unfortunately out of print. You can get it at,e.g.,abebooks.com.
  • K. Dowd and C. Severance: High Performance Computing (RISC Architectures, Optimization & Benchmarks). Covers traditional optimization techniques in detail. Still available at Amazon.com etc.
  • R. Gerber: The Software Optimization Cookbook. Contains also some material on SIMD programming with SSE.
  • W. Schönauer: Scientific Supercomputing. Architecture and Use of Shared and Distributed Memory Parallel Computers. Outdated, with much information about vector supercomputers and RISC processors of the 90s. In-depth performance modeling. Still a very valuable resource. Available from the author (see website).
  • The SGI Origin 2000 and Onyx2 Performance Tuning and Optimization Guide is still a great resource for learning the basics of code optimization, although those machines have long since disappeared. Just ignore the system-specific stuff.
  • A. Grama, A. Gupta, G. Karypis, V. Kumar: Introduction to parallel computing. In-depth treatment of parallel hardware models, parallel programming paradigms and parallel algorithms. Available at Amazon.com.
  • T. Mattson, B. Sanders, B. Massingill: Patterns for Parallel Programming. A compendium of concepts required for parallel program design, accompanied by sample implementations. Available at Amazon.com.
  • The official OpenMP specification contains quite a lot of good examples and can therefore be used as a good and readable reference for more information on OpenMP.
  • R. Chapman, G. Jost and R. van der Pas: Using OpenMP. This book not only gives a thorough introduction to OpenMP but also covers the most relevant performance and correctness issues, together with best practices.
  • Introductory, very basic tutorials from Lawrence Livermore National Laboratory (LLNL):
Last modified: Tuesday, 13 August 2013, 9:18 AM