Skip to Main content Skip to Navigation
New interface
Conference papers

ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores

Abstract : Many distributed key-value storage systems employ the simple and effective Raft protocol to ensure data consistency. They usually assume a homogeneous node hardware configuration for the underlying cluster and thus adopt even data distribution schemes. However, today’s distributed systems tend to be heterogeneous in nodes’ I/O devices due to the regular worn I/O device replacement and the emergence of expensive new storage media (e.g., non-volatile memory). In this paper, we propose a new data layout scheme called Adaptive Layout Optimization of Raft groups (ALOR), considering the hardware heterogeneity of the cluster. ALOR aims to optimize the data layout of Raft groups to achieve a better practical load balance, which leads to higher performance. ALOR consists of two components: leader migration in Raft groups and skewed data layout based on cold data migration. We conducted experiments on a practical heterogeneous cluster, and the results indicate that, on average, ALOR improves throughput by 36.89%, reduces latency and 99th percentile tail latency by 24.54% and 21.32%, respectively.
Document type :
Conference papers
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download
Contributor : Hal Ifip Connect in order to contact the contributor
Submitted on : Thursday, September 5, 2019 - 1:31:07 PM
Last modification on : Thursday, September 5, 2019 - 1:35:34 PM
Long-term archiving on: : Thursday, February 6, 2020 - 8:42:34 AM


Files produced by the author(s)


Distributed under a Creative Commons Attribution 4.0 International License



Yangyang Wang, Yunpeng Chai, Xin Wang. ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores. 15th IFIP International Conference on Network and Parallel Computing (NPC), Nov 2018, Muroran, Japan. pp.13-26, ⟨10.1007/978-3-030-05677-3_2⟩. ⟨hal-02279551⟩



Record views


Files downloads