Selecting Benchmarks Combinations for the Evaluation of Multicore Throughput

Ricardo A. Velasquez 1 Pierre Michaud 1 André Seznec 1
1 ALF - Amdahl's Law is Forever
Inria Rennes – Bretagne Atlantique , IRISA-D3 - ARCHITECTURE
Abstract : Most high-performance processors today are able to execute multiple threads of execution simultaneously. Threads share processor resources, like the last-level cache, which may decrease throughput in a non obvious way, depending on threads characteristics. Computer architects usually study multiprogrammed workloads by considering a set of benchmarks and some combinations of these benchmarks. Because cycle-accurate microarchitecture simulators are slow, we want a set of combinations that is as small as possible, yet representative. However, there is no standard method for selecting such sample, and different authors have used different methods. It is not clear how the choice of a particular sample impacts the conclusions of a study. We propose and compare different sampling methods for defining multiprogrammed workloads for computer architecture. We evaluate their effectiveness on a case study, the comparison of several multicore last-level cache replacement policies. We show that random sampling, the simplest method, is robust to define a representative sample of workloads, provided the sample is big enough. We propose a method for estimating the required sample size based on fast approximate simulation. We propose a new method, workload stratification, which is very effective at reducing the sample size in situations where random sampling would require large samples.
Document type :
Complete list of metadatas

Cited literature [16 references]  Display  Hide  Download
Contributor : Ricardo A. Velasquez <>
Submitted on : Thursday, November 8, 2012 - 10:15:27 AM
Last modification on : Friday, November 16, 2018 - 1:39:35 AM
Long-term archiving on : Saturday, February 9, 2013 - 3:42:06 AM


Files produced by the author(s)


  • HAL Id : hal-00737446, version 2


Ricardo A. Velasquez, Pierre Michaud, André Seznec. Selecting Benchmarks Combinations for the Evaluation of Multicore Throughput. [Research Report] 2012, pp.23. ⟨hal-00737446v2⟩



Record views


Files downloads