Skip to Main content Skip to Navigation
New interface
Conference papers

BMC: Accelerating Memcached using Safe In-kernel Caching and Pre-stack Processing

Abstract : In-memory key-value stores are critical components that help scale large internet services by providing low-latency access to popular data. Memcached, one of the most popular key-value stores, suffers from performance limitations inherent to the Linux networking stack and fails to achieve high performance when using high-speed network interfaces. While the Linux network stack can be bypassed using DPDK based solutions, such approaches require a complete redesign of the software stack and induce high CPU utilization even when client load is low. To overcome these limitations, we present BMC, an inkernel cache for Memcached that serves requests before the execution of the standard network stack. Requests to the BMC cache are treated as part of the NIC interrupts, which allows performance to scale with the number of cores serving the NIC queues. To ensure safety, BMC is implemented using eBPF. Despite the safety constraints of eBPF, we show that it is possible to implement a complex cache service. Because BMC runs on commodity hardware and requires modification of neither the Linux kernel nor the Memcached application, it can be widely deployed on existing systems. BMC optimizes the processing time of Facebook-like small-size requests. On this target workload, our evaluations show that BMC improves throughput by up to 18x compared to the vanilla Memcached application and up to 6x compared to an optimized version of Memcached that uses the SO_REUSEPORT socket flag. In addition, our results also show that BMC has negligible overhead and does not deteriorate throughput when treating non-target workloads.
Complete list of metadata

https://hal.inria.fr/hal-03361644
Contributor : Julien Sopena Connect in order to contact the contributor
Submitted on : Friday, October 1, 2021 - 3:06:16 PM
Last modification on : Tuesday, October 25, 2022 - 4:20:26 PM
Long-term archiving on: : Sunday, January 2, 2022 - 7:18:59 PM

File

main.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03361644, version 1

Citation

Yoann Ghigoff, Julien Sopena, Kahina Lazri, Antoine Blin, Gilles Muller. BMC: Accelerating Memcached using Safe In-kernel Caching and Pre-stack Processing. NSDI'21 - 18th USENIX Symposium on Networked Systems Design and Implementation, Apr 2021, Virtual event, United States. pp.487-501. ⟨hal-03361644⟩

Share

Metrics

Record views

111

Files downloads

165