Skip to Main content Skip to Navigation
Journal articles

Elastic Provisioning of Cloud Caches: A Cost-Aware TTL Approach

Abstract : We consider elastic resource provisioning in the cloud, focusing on in-memory key-value stores used as caches. Our goal is to dynamically scale resources to the traffic pattern minimizing the overall cost, which includes not only the storage cost, but also the cost due to misses. In fact, a small variation of the cache miss ratio may have a significant impact on user perceived performance in modern web services, which in turn has an impact on the overall revenues for the content provider using such services. We propose and study a dynamic algorithm for TTL caches, which is able to obtain close-to-minimal costs. Since high-throughput caches require low complexity operations, we discuss a practical implementation of such a scheme requiring constant overhead per request independently from the cache size. We evaluate our solution with real-world traces collected from Akamai, and show that the TTL approach is able to track the optimal cache configuration and achieve significant cost savings specially in highly dynamic settings that are likely to require elastic cloud services.
Document type :
Journal articles
Complete list of metadatas

https://hal.inria.fr/hal-03078608
Contributor : Giovanni Neglia <>
Submitted on : Wednesday, December 16, 2020 - 6:01:10 PM
Last modification on : Thursday, December 17, 2020 - 1:52:23 PM

File

carra20ton.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Damiano Carra, Giovanni Neglia, Pietro Michiardi. Elastic Provisioning of Cloud Caches: A Cost-Aware TTL Approach. IEEE/ACM Transactions on Networking, IEEE/ACM, 2020, 28 (3), pp.1283-1296. ⟨10.1109/TNET.2020.2980105⟩. ⟨hal-03078608⟩

Share

Metrics

Record views

15

Files downloads

53