Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Computers Année : 2021

Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation

Résumé

Modern computers keep following the traditional model of addressing memory linearly for their main memory and out-of-core storage. While this model allows efficient row access to row-major 2D matrices, it introduces complexity to perform efficient column access. A common strategy to improve these accesses is to transpose or rotate the matrix beforehand, thus the accessing complexity is centralized in one transformation operation. Further column accesses are performed as row accesses to the transposed matrix therefore they are optimized to the memory model. In this paper, we propose an efficient solution to perform in-memory or out-of-core rectangular matrix transposition and rotation by using an out-of-place strategy, reading a matrix from an input file and writing the transformed matrix to another (output) file. An originality of our processing algorithm is to rely on an optimized use of the page cache mechanism. It is parallel, optimized by several levels of tiling and independent of any disk block size. We evaluate our approach on five common storage configurations: HDD, hybrid HDD-SSD, SSD, software RAID 0 of several SSDs and NVMe. We show that it brings significant performance improvement over a hand-tuned optimized reference implementation developed by the Caldera company and we confront it against the baseline speed of a straight file copy.
Fichier principal
Vignette du fichier
IEEE_TC_GodardLoechnerBastoul.pdf (603.18 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02960539 , version 1 (08-10-2020)

Identifiants

Citer

Paul Godard, Vincent Loechner, Cédric Bastoul. Efficient Out-of-core and Out-of-place Rectangular Matrix Transposition and Rotation. IEEE Transactions on Computers, 2021, 70 (11), pp.7. ⟨10.1109/TC.2020.3030592⟩. ⟨hal-02960539⟩
165 Consultations
661 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More