QoE; Mobile Video Streaming; Predictive Models; Machine Learning
[en] Despite the massive adoption of HTTP adaptive streaming technology, buffering is still the most harmful event for QoE in video streaming. Previous studies have shown that buffering is not only detrimental for the overall user experience, but is also highly correlated to viewer engagement. The occurrence of buffering is particularly critical in cellular networks and mobile video deployments, as network conditions are less stable and network resources more limited. In this context, monitoring and properly predicting the QoE of video streaming services becomes paramount to cellular network operators, who need to offer high quality levels to reduce the risks of customers churning for quality dissatisfaction. In this paper, we present a novel approach to multi-dimensional QoE prediction in mobile video using machine learning models. Contrary to previous models for QoE prediction in video streaming, which are generally uni- or low-dimensional and model the impact of single video descriptors independently, we use a high-dimensional input space to model the impact of buffering and initial delay on QoE.We train and test the proposed models on a publicly available mobile video dataset, generated from subjective QoE tests with real viewers. Besides improving prediction performance, the proposed models show that there is a clear influence of other buffering pattern descriptors generally neglected in previous models - in particular those linked to the occurrence of the last stalling event, shedding light on new KPIs to monitor for better QoE assessment in video streaming.
Cisco, "Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2016-2021 White Paper" 2017. [Online].
Int. Telecommunication Union, "ITU-T Rec. P.800: Methods for Subjective Determination of Transmission Quality" 1996.
M. Seufert et al., "A Survey on Quality of Experience of HTTP Adaptive Streaming", in IEEE Comm. Surveys & Tutorials, vol. 17, no. 1, 2015.
P. Casas et al., "Next to You: Monitoring Quality of Experience in Cellular Networks from the End-devices", in IEEE Transactions on Network and Service Management, vol. 13, no. 2, 2016.
B. Staehle et al., "YoMo: A YouTube Application Comfort Monitoring Tool" in QoEMCS, 2010.
H. Nam et al., "YouSlow: What Influences User Abandonment Behavior for Internet Video?" Tech. report 2017. [Online].
A. Balachandran et al., "Developing a Predictive Model of QoE for Internet Video", in ACM SIGCOMM, 2013.
Q. Chen et al., "QoE Doctor: Diagnosing Mobile App QoE with Automated UI Control and Cross-layer Analysis", in ACM IMC, 2014.
F. Dobrian et al., "Understanding the Impact of Video Quality on User Engagement", in ACM SIGCOMM, 2011.
S. Krishnan et al., "Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-experimental Designs", in ACM IMC, 2012.
P. Casas et al., "Exploring QoE in Cellular Networks: How Much Bandwidth do you Need for Popular Smartphone Apps?", in ACM All Things Cellular Workshop, 2015.
T. HoBfeld et al., "Quantification of YouTube QoE via Crowdsourcing", in IEEE International Symposium on Multimedia, 2011.
R.K.P. Mok et al., "Inferring the QoE of HTTP Video Streaming from User-Viewing Activities", in ACM W-MUST Workshop, 2011.
T. HoBfeld et al., "Initial Delay vs. Interruptions: Between the Devil and the Deep Blue Sea", in QoMEX, 2012.
T. HoBfeld et al., "Assessing Effect Sizes of Influence Factors Towards a QoE Model for HTTP Adaptive Streaming", in QoMEX, 2014.
J. Jiang et al., "Shedding Light on the Structure of Internet Video Quality Problems in the Wild", in ACM CoNEXT, 2013.
P. Casas et al., "YOUQMON: A System for On-line Monitoring of YouTube QoE in Operational 3G Networks", ACM SIGMETRICS PER, vol. 41, 2013.
P. Casas et al., "An Educated Guess on QoE in Operational Networks through Large-Scale Measurements", in ACM Internet-QoE Workshop, 2016.
F. Wamser et al., "Understanding YouTube QoE in Cellular Networks with YoMoApp-a QoE Monitoring Tool for YouTube Mobile", in ACMMOBICOM, 2015.
Y. Wang et al., "Induction of Model Trees for Predicting Continuous Classes", in ECML, 1997.
D. Ghadiyaram et al., "Study of the Effects of Stalling Events on the Quality of Experience of Mobile Streaming Videos", voIEEE GlobalSIP, 2014.
D. Ghadiyaram et al., "LIVE Mobile Stall Video Database", [online]: http://live.ece.utexas.edu/research/LIVEStallStudy/index.html, 2016.
T. HoBfield et al, "Internet Video Delivery in YouTube: From Traffic Measurements to Quality of Experience", in Data Traffic Monitoring and Analysis: From measurement, classification and anomaly detection to Quality of Experience 115A, 264-301, Springer Berlin Heidelberg, 2013.
D. Ghadiyaram et al., "A Time-varying Subjective Quality Model for Mobile Streaming Videos with Stalling Events", in SPIE Optical Engineering Applications, 2015.
H. Yeganeh et al., "Delivery Quality Score Model for Internet Video", in IEEE International Conference on Image Processing, 2014.
P. Casas et al., "Predicting QoE in Cellular Networks using Machine Learning and in-Smartphone Measurements", in QoMEX, 2017.
V. Aggarwal et al., "Prometheus: Toward Quality-of-Experience Estimation for Mobile Apps from Passive Network Measurements", in ACM HotMobile, 2014.
R.O. Duda et al., "Pattern Classification, 2nd Edition", Wiley, 2000.