ACQUA: A user friendly platform for lightweight network monitoring and QoE forecasting

International audienceACQUA, Application for prediCting QUality ofExperience at Internet Access, is an Android application tomeasure mobile network access performance and to estimatehow this performance affects main applications of interest tothe end user from Quality of Experience (QoE) viewpoint.Every application supported in ACQUA is a function, or amodel, built offline, that links the network-level and device-levelmeasurements to expected Quality of Experience. Supervisedmachine learning techniques are used to establish such link.Thanks to a lightweight measurement strategy, ACQUA canperform measurements continuously and show to the user, inaddition to QoE estimations, measurement results obtained bothactively and passively. This way we we can provide insights overtime on network performance as well as user-friendly QoE valuesthat explain the state of the network. Finally, ACQUA provides afeedback channel for end users to express themselves about theirreal QoE, a feedback that we plan to use to assess the importanceof the subjectivity of QoE in real life scenarios

Uma abordagem preditiva de DASH QoE baseada em aprendizado de máquina em multi-access edge computing

Orientador: Christian Rodolfo Esteve RothenbergDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia Elétrica e de ComputaçãoResumo: O tráfego de serviços de vídeo multimídia está crescendo rapidamente nas redes móveis nos últimos anos. Os serviços de vídeo que usam técnicas de Dynamic Adaptive Streaming sobre HTTP (DASH) dominaram o tráfego total da Internet para transportar o tráfego de vídeo. Espera-se que as operadoras de rede móvel (Mobile Network Operators - MNOs) continuem atendendo a essa demanda crescente por tráfego de vídeo suportado por DASH, ao mesmo tempo em que fornecem uma alta qualidade de experiência (Quality of Experience - QoE) aos usuários finais. Além disso, as operadoras precisam ter um conhecimento claro acerca da qualidade de vídeo percebida pelos usuários finais e relacioná-la com o monitoramento em nível de rede, ou com informações de telemetria para identificação de problemas, análise da causa raiz e predição de padrões. Para garantir um gerenciamento de tráfego de rede com reconhecimento de QoE, um pré-requisito é que os MNOs monitorem o tráfego de rede passivamente e realizem medições efetivas de indicadores-chave de desempenho (Key Performance Indicators - KPIs) de QoE, como resoluções, eventos de paralisação, entre outros, que influenciam diretamente a percepção do usuário final. Muitas abordagens da literatura foram propostas para medir os KPIs com o objetivo de fornecer uma qualidade de serviço de vídeo aceitável. A maioria das soluções exige consciência de contexto do usuário final, o que não é viável do ponto de vista do MNO. No entanto, Deep Packet Inspection (DPI), outra solução mais amplamente usada para estimar os KPIs diretamente do tráfego de rede, não é mais uma solução conveniente para as operadoras devido à adoção de criptografia de streaming de vídeo fim-a-fim sobre TCP (HTTPs) e QUIC. Portanto, o aprendizado de máquina (Machine Learning - ML) passou a ser recentemente aceito como uma solução bem reconhecida para estimar KPIs de QoE, analisando os padrões de tráfego criptografados bem como estatísticas como qualidade de serviço (Quality of Service - QoS). Este trabalho apresenta uma abordagem mais refinada e leve, baseada em aprendizado de máquina, denominada Edge QoE Probe, para estimar QoE do usuário final para o serviço de vídeo DASH, monitorando passivamente o tráfego de rede criptografado na borda da rede. Nossa abordagem pode avaliar vários KPIs de QoE, como por exemplo resolução, taxa de bits, proporção de paralisação, entre outros, tanto em tempo real quanto por sessão. Além disso, neste trabalho investigamos o desempenho do vídeo DASH sobre o protocolo de transporte tradicional TCP (HTTPs) e QUIC. Para este propósito, avaliamos experimentalmente diferentes traces de rede celular em um ambiente emulado de alta fidelidade e comparamos o desempenho comportamental de algoritmos Adaptive Bitrate Streaming (ABS) considerando KPIs de QoE sobre TCP (HTTPs) e QUIC. Nossos resultados empíricos mostram que os algoritmos tradicionais de ABS usando QUIC como transporte precisariam alterações específicas para melhorar o desempenho em termos de QoE de vídeo baseados em DASHAbstract: Multimedia video services traffic is rapidly growing in mobile networks in recent years. Video services using Dynamic Adaptive Streaming over HTTP (DASH) techniques have dominated the total internet traffic to carry video traffic. Mobile Network Operators (MNOs) are expected to run on with this growing demand for DASH-supported video traffic while providing a high Quality of Experience (QoE) to the end-users. Besides, operators need to have a crystal notion of video quality perceived by the end-users and correlate them with network-level monitoring or telemetry information for problem identification, root cause analysis, and pattern prediction. To ensure QoE–aware network traffic management, a prerequisite for the MNOs is to monitor the network traffic passively and measure objective QoE Key Performance Indicators (KPIs) (such as resolutions and stalling events) effectively that directly influence end-user subjective feedback. Many literature approaches have been proposed to measure the KPIs aimed to deliver acceptable video service quality. Most of the solutions require end-user awareness, which is not viable from the MNOs' perspective. However, Deep Packet Inspection (DPI), another most widely used solution to estimate the KPIs directly from network traffic, is not a convenient solution anymore for the operators due to the adoption of end-to-end video streaming encryption over TCP (HTTPs) and QUIC transport protocol. Hence, in recent, Machine Learning (ML) has been accepted as a well-recognized solution for estimating QoE KPIs by analyzing the encrypted traffic patterns and statistics as Quality of Service (QoS). This work presents an ML-based lightweight and fine-grained Edge QoE Probe approach to estimate the end-user QoE for DASH video service by passively monitoring the encrypted network traffic on the edge of the network. Our approach can assess numerous QoE KPIs (such as resolution, bit-rate, quality switches, startup delay, and stall ratio) both in a real-time and per-session manner. Moreover, we investigate the DASH video service performance over the traditional TCP (HTTPs) and QUIC transport protocol in this work. For this purpose, we experimentally evaluate different cellular network traces in a high-fidelity emulated testbed and compare the behavioral performance of Adaptive Bitrate Streaming (ABS) algorithms considering QoE KPIs over TCP (HTTPs) and QUIC. Our empirical results show that QUIC suffers from traditional state-of-the-art ABS algorithms' ineffectiveness to improve video streaming performance without specific changesMestradoEngenharia de ComputaçãoMestre em Engenharia ElétricaFuncam

Application-Aware Analysis of Network Neutrality: A Scalable Real-Time Method

Internet access subscribers expect a satisfying quality of experience for any accessed service, independently from time, place, and service- and content-type. Besides the everincreasing amount of Internet data, the spectrum of video service platforms offering sharing and streaming also got significantly more comprehensive. Internet access providers try to avoid the exhaustion of network bandwidth by investing in network capacity or setting up higher-level resource management within their infrastructure. The primary question in this domain is how resource management constrains the subscriber to access an arbitrary service and experience good service quality.This question directly relates to network neutrality fundamentals. This paper presents a real-time full-reference objective method to assess network neutrality. It contributes three novelties to support user-centric analysis of potential restraints affecting Internet access quality: i) the proposal supports application-specific measurements and involves real content and real traffic, ii) the measured traffic originates from the content provider’s cloud infrastructure, iii) reference is created in real time. Accordingly, the proposal introduces a novel measurement layout. The key component is the emulated client that provides the real-time reference by emulating the access properties of the real client and accessing the same content simultaneously. We demonstrate the method’s feasibility with an applicationaware proof-of-concept use case: video streaming from a public VoD provider. We have validated the method against the emulated network parameters using an extensive series of laboratory measurements

Challenges of future multimedia QoE monitoring for internet service providers

The ever-increasing network traffic and user expectations at reduced cost make the delivery of high Quality of Experience (QoE) for multimedia services more vital than ever in the eyes of Internet Service Providers (ISPs). Real-time quality monitoring, with a focus on the user, has become essential as the first step in cost-effective provisioning of high quality services. With the recent changes in the perception of user privacy, the rising level of application-layer encryption and the introduction and deployment of virtualized networks, QoE monitoring solutions need to be adapted to the fast changing Internet landscape. In this contribution, we provide an overview of state-of-the-art quality monitoring models and probing technologies, and highlight the major challenges ISPs have to face when they want to ensure high service quality for their customers

QoE over-the-top multimédia em redes sem fios

One of the goals of an operator is to improve the Quality of Experience (QoE) of a client in networks where Over-the-top (OTT) content is being delivered. The appearance of services like YouTube, Netflix or Twitch, where in the first case it contains more than 300 hours of video per minute in the platform, brings issues to the managed data networks that already exist, as well as challenges to fix them. Video traffic corresponds to 75% of the whole transmitted data on the Internet. This way, not only the Internet did become the ’de facto’ video transmission path, but also the general data traffic continues to exponentially increase, due to the desire to consume more content. This thesis presents two model proposals and architecture that aim to improve the users’ quality of experience, by predicting the amount of video in advance liable of being prefetched, as a way to optimize the delivery efficiency where the quality of service cannot be guaranteed. The prefetch is done in the clients’ closest cache server. For that, an Analytic Hierarchy Process (AHP) is used, where through a subjective method of attribute comparison, and from the application of a weighted function on the measured quality of service metrics, the amount of prefetch is achieved. Besides this method, artificial intelligence techniques are also taken into account. With neural networks, there is an attempt of selflearning with the behavior of OTT networks with more than 14.000 hours of video consumption under different quality conditions, to try to estimate the experience felt and maximize it, without the normal service delivery degradation. At last, both methods are evaluated and a proof of concept is made with users in a high speed train.Um dos objetivos de um operador é melhorar a qualidade de experiência do cliente em redes onde existem conteúdos Over-the-top (OTT) a serem entregues. O aparecimento de serviços como o YouTube, Netflix ou Twitch, onde no primeiro caso são carregadas mais de 300 horas de vídeo por minuto na plataforma, vem trazer problemas às redes de dados geridas que já existiam, assim como desafios para os resolver. O tráfego de vídeo corresponde a 75% de todos os dados transmitidos na Internet. Assim, não só a Internet se tornou o meio de transmissão de vídeo ’de facto’, como o tráfego de dados em geral continua a crescer exponencialmente, proveniente do desejo de consumir mais conteúdos. Esta tese apresenta duas propostas de modelos e arquitetura que pretendem melhorar a qualidade de experiência do utilizador, ao prever a quantidade de vídeo em avanço passível de ser précarregado, de forma a optimizar a eficiência de entrega das redes onde a qualidade de serviço não é possível de ser garantida. O pré-carregamento dos conteúdos é feito no servidor de cache mais próximo do cliente. Para tal, é utilizado um processo analítico hierárquico (AHP), onde através de um método subjetivo de comparação de atributos, e da aplicação de uma função de valores ponderados nas medições das métricas de qualidade de serviço, é obtida a quantidade a pré-carregar. Além deste método, é também proposta uma abordagem com técnicas de inteligência artificial. Através de redes neurais, há uma tentativa de auto-aprendizagem do comportamento das redes OTT com mais de 14.000 horas de consumo de vídeo sobre diferentes condições de qualidade, para se tentar estimar a experiência sentida e maximizar a mesma, sem degradação da entrega de serviço normal. No final, ambos os métodos propostos são avaliados num cenário de utilizadores num comboio a alta velocidade.Mestrado em Engenharia de Computadores e Telemátic

Real-Time Neural Video Recovery and Enhancement on Mobile Devices

As mobile devices become increasingly popular for video streaming, it's crucial to optimize the streaming experience for these devices. Although deep learning-based video enhancement techniques are gaining attention, most of them cannot support real-time enhancement on mobile devices. Additionally, many of these techniques are focused solely on super-resolution and cannot handle partial or complete loss or corruption of video frames, which is common on the Internet and wireless networks. To overcome these challenges, we present a novel approach in this paper. Our approach consists of (i) a novel video frame recovery scheme, (ii) a new super-resolution algorithm, and (iii) a receiver enhancement-aware video bit rate adaptation algorithm. We have implemented our approach on an iPhone 12, and it can support 30 frames per second (FPS). We have evaluated our approach in various networks such as WiFi, 3G, 4G, and 5G networks. Our evaluation shows that our approach enables real-time enhancement and results in a significant increase in video QoE (Quality of Experience) of 24\% - 82\% in our video streaming system

Seamless multimedia delivery within a heterogeneous wireless networks environment: are we there yet?

The increasing popularity of live video streaming from mobile devices such as Facebook Live, Instagram Stories, Snapchat, etc. pressurises the network operators to increase the capacity of their networks. However, a simple increase in system capacity will not be enough without considering the provisioning of Quality of Experience (QoE) as the basis for network control, customer loyalty and retention rate and thus increase in network operators revenue. As QoE is gaining strong momentum especially with increasing users’ quality expectations, the focus is now on proposing innovative solutions to enable QoE when delivering video content over heterogeneous wireless networks. In this context, this paper presents an overview of multimedia delivery solutions, identifies the problems and provides a comprehensive classification of related state-of-the-art approaches following three key directions: adaptation, energy efficiency and multipath content delivery. Discussions, challenges and open issues on the seamless multimedia provisioning faced by the current and next generation of wireless networks are also provided

Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet?

The increasing popularity of live video streaming from mobile devices, such as Facebook Live, Instagram Stories, Snapchat, etc. pressurizes the network operators to increase the capacity of their networks. However, a simple increase in system capacity will not be enough without considering the provisioning of quality of experience (QoE) as the basis for network control, customer loyalty, and retention rate and thus increase in network operators revenue. As QoE is gaining strong momentum especially with increasing users' quality expectations, the focus is now on proposing innovative solutions to enable QoE when delivering video content over heterogeneous wireless networks. In this context, this paper presents an overview of multimedia delivery solutions, identifies the problems and provides a comprehensive classification of related state-of-the-art approaches following three key directions: 1) adaptation; 2) energy efficiency; and 3) multipath content delivery. Discussions, challenges, and open issues on the seamless multimedia provisioning faced by the current and next generation of wireless networks are also provided