Large scale in transit computation of quantiles for ensemble runs - Archive ouverte HAL Access content directly
Reports (Research Report) Year : 2019

Large scale in transit computation of quantiles for ensemble runs

(1) , (2) , (3, 4, 5) , (1) , (6)
1
2
3
4
5
6

Abstract

The classical approach for quantiles computation requires availability of the full sample before ranking it. In uncertainty quantification of numerical simulation models, this approach is not suitable at exascale as large ensembles of simulation runs would need to gather a prohibitively large amount of data. This problem is solved thanks to an on-the-fly and iterative approach based on the Robbins-Monro algorithm. This approach relies on Melissa, a file avoiding, adaptive, fault-tolerant and elastic framework. On a validation case producing 11 TB of data, which consists in 3000 fluid dynamics parallel simulations on a 6M cell mesh, it allows on-line computation of spatio-temporal maps of percentiles.
Fichier principal
Vignette du fichier
paper.pdf (2.14 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02016828 , version 1 (12-02-2019)
hal-02016828 , version 2 (10-05-2019)

Identifiers

Cite

Alejandro Ribes, Théophile Terraz, Bertrand Iooss, Yvan Fournier, Bruno Raffin. Large scale in transit computation of quantiles for ensemble runs. [Research Report] EDF R&D. 2019. ⟨hal-02016828v2⟩
309 View
273 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More