Narrowing the gap between QoS metrics and Web QoE using Above-the-fold metrics

Abstract : Page load time (PLT) is still the most common application Quality of Service (QoS) metric to estimate the Quality of Experience (QoE) of Web users. Yet, recent literature abounds with proposals for alternative metrics (e.g., Above The Fold, SpeedIndex and variants) that aim at better estimating user QoE. The main purpose of this work is thus to thoroughly investigate a mapping between established and recently proposed objective metrics and user QoE. We obtain ground truth QoE via user experiments where we collect and analyze 3,400 Web accesses annotated with QoS metrics and explicit user ratings in a scale of 1 to 5, which we make available to the community. In particular, we contrast domain expert models (such as ITU-T and IQX) fed with a single QoS metric, to models trained using our ground-truth dataset over multiple QoS metrics as features. Results of our experiments show that, albeit very simple, expert models have a comparable accuracy to machine learning approaches. Furthermore, the model accuracy improves considerably when building per-page QoE models, which may raise scalability concerns as we discuss.
Document type :
Conference papers
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.inria.fr/hal-01677260
Contributor : Diego Neves da Hora <>
Submitted on : Monday, January 8, 2018 - 11:04:16 AM
Last modification on : Monday, July 1, 2019 - 4:54:03 PM

File

atfqoe18-author.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01677260, version 1

Citation

Diego da Hora, Alemnew Asrese, Vassilis Christophides, Renata Teixeira, Dario Rossi. Narrowing the gap between QoS metrics and Web QoE using Above-the-fold metrics. PAM 2018 - International Conference on Passive and Active Network Measurement, Mar 2018, Berlin, Germany. pp.1-13. ⟨hal-01677260⟩

Share

Metrics

Record views

542

Files downloads

1106