Training course "Introduction to parallel computing"
(Course no. 71/2014 in the training programme of Forschungszentrum Jülich)
Target audience: | Managers, system administrators, and application programmers new to the field of high-performance computing (HPC) and interested in an introduction to HPC systems and parallel programming. |
Contents: | |
Prerequisites: | Basic knowledge in a sequential programming language like C, C++ or Fortran is helpful to better understand the examples presented in the 2nd half of the talk |
Language: | The presentation material is in English. The presentation will be given in English or German language depending on the course final audience. |
Duration: | half a day |
Date: | Wednesday, 15 October 2014, 13:00-17:00 |
Venue: | Jülich Supercomputing Centre, Seminarraum, building 16.3, room 406, 2nd floor |
maximum number of participants: | 60 |
Instructor: | Dr. Bernd Mohr, JSC |
Contact: | Dr. Bernd Mohr Phone: +49 2461 61-3218 E-mail: b.mohr@fz-juelich.de |
Registration: | Registration is not necessary. |
This talk will present the fundamental concepts, methods, and technologies of high-performance computing systems and the necessary parallel programming associated with it. After introducing the basic terminology and vocabulary, an overview about parallel computer architectures is given introducing shared memory, distributed memory, and hybrid computer systems including latest trends like many-core CPUs and hardware acceleration via GPUs. Next, the basics of parallel programming are explained including an introduction to message-passing and multi-threaded programming with the industry standards MPI and OpenMP. Finally, it describes the basics of debugging, performance analysis, and optimization of parallel programs. The presentation closes with a summary of issues and open research topics of high-performance computing for the next decade namely heterogeneity, reliability, power consumption, and extreme concurrency.
This tutorial addresses managers, system administrators, and application programmers new to the field of high-performance computing (HPC) and interested in an introduction to HPC systems and parallel programming. It does not include any hands-on training and should be regarded as an overview on the topic to prepare for HPC courses given later this year (no. 70/2014 and 75/2014).
Basic knowledge in a sequential programming language like C, C++ or Fortran is helpful to better understand the examples presented in the 2nd half of the talk (”Introduction to parallel programming“).