Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores

Abstract

Key-value stores distribute data across several storage nodes to handle large amounts of parallel requests. Proper scheduling of these requests impacts the quality of service, as measured by achievable throughput and (tail) latencies. In addition to scheduling, performance heavily depends on the nature of the workload and the deployment environment. It is, unfortunately, difficult to evaluate different scheduling strategies consistently under the same operational conditions. Moreover, such strategies are often hard-coded in the system, limiting flexibility. We present Hector, a modular framework for implementing and evaluating scheduling policies in Apache Cassandra. Hector enables users to select among several options for key components of the scheduling workflow, from the request propagation via replica selection to the local ordering of incoming requests at a storage node. We demonstrate the capabilities of Hector by comparing strategies in various settings. For example, we find that leveraging cache locality effects may be of particular interest: we propose a new replica selection strategy, called Popularity-Aware, that can support 6 times the maximum throughput of the default algorithm under specific key access patterns. We also show that local scheduling policies have a significant effect when parallelism at each storage node is limited.
Fichier principal
Vignette du fichier
paper.pdf (673.81 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04158577 , version 1 (11-07-2023)

Identifiers

  • HAL Id : hal-04158577 , version 1

Cite

Louis-Claude Canon, Anthony Dugois, Loris Marchal, Etienne Rivière. Hector: A Framework to Design and Evaluate Scheduling Strategies in Persistent Key-Value Stores. ICPP 2023 - 52nd International Conference on Parallel Processing, Aug 2023, Salt Lake City, United States. ⟨hal-04158577⟩
39 View
84 Download

Share

Gmail Facebook X LinkedIn More