M&MMs: Navigating Complex Memory Spaces with hwloc

Abstract : The complexity of the memory system has increased dramatically in the last decade. As a result, high-performance computers include multi-level, heterogeneous, and non-uniform memories, each with significantly different properties. For example, a memory system nowadays may include three types of memory: low-latency memory (DDR), high-bandwidth memory (HBM), and high-capacity memory (NVM)-not to mention multiple NUMA domains. Because of their significantly different characteristics and number, scientific application developers face a tremendous challenge: Leverage the memory system effectively to improve performance and productivity. In this work, we present M&MMs, an interface to help manage the memory system complexity. It is comprised of a set of memory attributes and an API to express and manage the diverse memory characteristics using high-level metrics that are easy to understand. Our goal is to establish a building block to enable next-generation runtime systems, computing libraries, and scientific applications to leverage the best performance attributes of each memory, e.g., leverage the bandwidth of the fastest memory with the capacity of the largest memory. We believe M&MMs is a natural extension of hwloc - that focuses on the memory system - since hwloc exposes the locality of the hardware resources and it is the de facto standard for hardware topology discovery.
Complete list of metadatas

Cited literature [19 references]  Display  Hide  Download

https://hal.inria.fr/hal-02266285
Contributor : Brice Goglin <>
Submitted on : Wednesday, August 14, 2019 - 12:09:11 PM
Last modification on : Thursday, September 26, 2019 - 3:32:02 PM

File

main.pdf
Files produced by the author(s)

Identifiers

Citation

Edgar León, Brice Goglin, Andrès Rubio Proaño. M&MMs: Navigating Complex Memory Spaces with hwloc. Fifth International Symposium on Memory Systems Proceedings (MEMSYS19), Sep 2019, Washington, DC, United States. ⟨10.1145/3357526.3357546⟩. ⟨hal-02266285⟩

Share

Metrics

Record views

115

Files downloads

713