November 2023

Conference Paper

Concepts for OpenMP Target Offload Resilience

By:
Engelmann, Christian ; Vallee, Geoffroy R; Pophale, Swaroop S
Page Number:
78-93
Volume:
11718
Book Title:
OpenMP: Conquering the Full Hardware Spectrum
Publication Date:
November 9, 2023
Conference Name:
15th International Workshop on OpenMP (IWOMP 2019)
Conference Location:
AUCKLAND, New Zealand
Conference Sponsor:
N/A
View DOI Listing:
https://doi.org/10.1007/978-3-030-28596-8_6

Abstract

Recent reliability issues with one of the fastest supercomputers in the world, Titan at Oak Ridge National Laboratory (ORNL), demonstrated the need for resilience in large-scale heterogeneous computing. OpenMP currently does not address error and failure behavior. This paper takes a first step toward resilience for heterogeneous systems by providing the concepts for resilient OpenMP offload to devices. Using real-world error and failure observations, the paper describes the concepts and terminology for resilient OpenMP target offload, including error and failure classes and resilience strategies. It details the experienced general-purpose computing graphics processing unit (GPGPU) errors and failures in Titan. It further proposes improvements in OpenMP, including a preliminary prototype design, to support resilient offload to devices for efficient handling of errors and failures in heterogeneous high-performance computing (HPC) systems.