Computational inference and control of quality in multimedia services

Quality is the degree of excellence we expect of a service or a product. It is also one of the key factors that determine its value. For multimedia services, understanding the experienced quality means understanding how the delivered delity, precision and reliability correspond to the users' expectations. Yet the quality of multimedia services is inextricably linked to the underlying technology. It is developments in video recording, compression and transport as well as display technologies that enables high quality multimedia services to become ubiquitous. The constant evolution of these technologies delivers a steady increase in performance, but also a growing level of complexity. As new technologies stack on top of each other the interactions between them and their components become more intricate and obscure. In this environment optimizing the delivered quality of multimedia services becomes increasingly challenging. The factors that aect the experienced quality, or Quality of Experience (QoE), tend to have complex non-linear relationships. The subjectively perceived QoE is hard to measure directly and continuously evolves with the user's expectations. Faced with the diculty of designing an expert system for QoE management that relies on painstaking measurements and intricate heuristics, we turn to an approach based on learning or inference. The set of solutions presented in this work rely on computational intelligence techniques that do inference over the large set of signals coming from the system to deliver QoE models based on user feedback. We furthermore present solutions for inference of optimized control in systems with no guarantees for resource availability. This approach oers the opportunity to be more accurate in assessing the perceived quality, to incorporate more factors and to adapt as technology and user expectations evolve. In a similar fashion, the inferred control strategies can uncover more intricate patterns coming from the sensors and therefore implement farther-reaching decisions. Similarly to natural systems, this continuous adaptation and learning makes these systems more robust to perturbations in the environment, longer lasting accuracy and higher eciency in dealing with increased complexity. Overcoming this increasing complexity and diversity is crucial for addressing the challenges of future multimedia system. Through experiments and simulations this work demonstrates that adopting an approach of learning can improve the sub jective and objective QoE estimation, enable the implementation of ecient and scalable QoE management as well as ecient control mechanisms

Collaborative learning and co-author students in online higher education: a-REAeduca – collaborative learning and co-authors

The technologies themselves cannot be analyzed as instruments per se, nor can they be exhausted in their relation with science. There is a social and even an individual dimension that affects our own way of relating to society. It is in open education that we have been developing our educational practices. This chapter presents a collaborative learning activity, the curricular unit Materiais e Recursos para eLearning, part of an on-line Master in Pedagogy of eLearning, Universidade Aberta, Portugal. In the present work, the authors dedicate their attention to co-learning and co-research, as processes that help to exemplify some situations, the a-REAeduca. The data collection was supported essentially by the content analysis technique.info:eu-repo/semantics/publishedVersio

Systems and Methods for Measuring and Improving End-User Application Performance on Mobile Devices

In today's rapidly growing smartphone society, the time users are spending on their smartphones is continuing to grow and mobile applications are becoming the primary medium for providing services and content to users. With such fast paced growth in smart-phone usage, cellular carriers and internet service providers continuously upgrade their infrastructure to the latest technologies and expand their capacities to improve the performance and reliability of their network and to satisfy exploding user demand for mobile data. On the other side of the spectrum, content providers and e-commerce companies adopt the latest protocols and techniques to provide smooth and feature-rich user experiences on their applications. To ensure a good quality of experience, monitoring how applications perform on users' devices is necessary. Often, network and content providers lack such visibility into the end-user application performance. In this dissertation, we demonstrate that having visibility into the end-user perceived performance, through system design for efficient and coordinated active and passive measurements of end-user application and network performance, is crucial for detecting, diagnosing, and addressing performance problems on mobile devices. My dissertation consists of three projects to support this statement. First, to provide such continuous monitoring on smartphones with constrained resources that operate in such a highly dynamic mobile environment, we devise efficient, adaptive, and coordinated systems, as a platform, for active and passive measurements of end-user performance. Second, using this platform and other passive data collection techniques, we conduct an in-depth user trial of mobile multipath to understand how Multipath TCP (MPTCP) performs in practice. Our measurement study reveals several limitations of MPTCP. Based on the insights gained from our measurement study, we propose two different schemes to address the identified limitations of MPTCP. Last, we show how to provide visibility into the end- user application performance for internet providers and in particular home WiFi routers by passively monitoring users' traffic and utilizing per-app models mapping various network quality of service (QoS) metrics to the application performance.PHDComputer Science & EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/146014/1/ashnik_1.pd

User-Centric Quality of Service Provisioning in IP Networks

The Internet has become the preferred transport medium for almost every type of communication, continuing to grow, both in terms of the number of users and delivered services. Efforts have been made to ensure that time sensitive applications receive sufficient resources and subsequently receive an acceptable Quality of Service (QoS). However, typical Internet users no longer use a single service at a given point in time, as they are instead engaged in a multimedia-rich experience, comprising of many different concurrent services. Given the scalability problems raised by the diversity of the users and traffic, in conjunction with their increasing expectations, the task of QoS provisioning can no longer be approached from the perspective of providing priority to specific traffic types over coexisting services; either through explicit resource reservation, or traffic classification using static policies, as is the case with the current approach to QoS provisioning, Differentiated Services (Diffserv). This current use of static resource allocation and traffic shaping methods reveals a distinct lack of synergy between current QoS practices and user activities, thus highlighting a need for a QoS solution reflecting the user services. The aim of this thesis is to investigate and propose a novel QoS architecture, which considers the activities of the user and manages resources from a user-centric perspective. The research begins with a comprehensive examination of existing QoS technologies and mechanisms, arguing that current QoS practises are too static in their configuration and typically give priority to specific individual services rather than considering the user experience. The analysis also reveals the potential threat that unresponsive application traffic presents to coexisting Internet services and QoS efforts, and introduces the requirement for a balance between application QoS and fairness. This thesis proposes a novel architecture, the Congestion Aware Packet Scheduler (CAPS), which manages and controls traffic at the point of service aggregation, in order to optimise the overall QoS of the user experience. The CAPS architecture, in contrast to traditional QoS alternatives, places no predetermined precedence on a specific traffic; instead, it adapts QoS policies to each individual’s Internet traffic profile and dynamically controls the ratio of user services to maintain an optimised QoS experience. The rationale behind this approach was to enable a QoS optimised experience to each Internet user and not just those using preferred services. Furthermore, unresponsive bandwidth intensive applications, such as Peer-to-Peer, are managed fairly while minimising their impact on coexisting services. The CAPS architecture has been validated through extensive simulations with the topologies used replicating the complexity and scale of real-network ISP infrastructures. The results show that for a number of different user-traffic profiles, the proposed approach achieves an improved aggregate QoS for each user when compared with Best effort Internet, Traditional Diffserv and Weighted-RED configurations. Furthermore, the results demonstrate that the proposed architecture not only provides an optimised QoS to the user, irrespective of their traffic profile, but through the avoidance of static resource allocation, can adapt with the Internet user as their use of services change.France Teleco

Quality of experience characterization and provisioning in mobile cellular networks

Παραδοσιακά, οι προηγούμενες γενεές κινητών κυψελωτών δικτύων έχουν σχεδιαστεί με κριτήρια Ποιότητας Υπηρεσίας, έτσι ώστε να πληρούν συγκεκριμένες απαιτήσεις διαφόρων υπηρεσιών. Η «Ποιότητα Εμπειρίας» έχει, ωστόσο, πρόσφατα εμφανιστεί ως έννοια, επηρεάζοντας το σχεδιασμό των μελλοντικών γενεών των δικτύων, δίνοντας σαφή έμφαση στην πραγματικά επιτευχθείσα εμπειρία του τελικού χρήστη. Η εμφάνιση της έννοιας της Ποιότητας Εμπειρίας οφείλεται στην αναπόφευκτη, ισχυρή μετάβαση που βιώνει η βιομηχανία των Τηλεπικοινωνιών από συστημο-κεντρικά δίκτυα σε πιο χρηστο-κεντρικές λύσεις και στόχους. Οι πάροχοι κινητών δικτύων, οι πάροχοι υπηρεσιών, οι προγραμματιστές εφαρμογών, αλλά και άλλα ενδιαφερόμενα μέλη που εμπλέκονται στην αλυσίδα παροχής υπηρεσιών προσελκύονται από τις ευκαιρίες που μπορεί να προσφέρει η ενσωμάτωση γνώσης Ποιότητας Εμπειρίας στο επιχειρηματικό τους μοντέλο. Πράγματι, η παρεχόμενη Ποιότητα Εμπειρίας αποτελεί έναν καθοριστικό παράγοντα διαφοροποίησης μεταξύ των διαφόρων παικτών, μία τάση που αναμένεται να γίνει ακόμη πιο έντονη τα επόμενα χρόνια. Υποκινούμενη από αυτή την χρηστο-κεντρική τάση, η έρευνα που διεξάγεται σε αυτή τη διατριβή έχει ως στόχο την διερεύνηση των προκλήσεων και των ευκαιριών που προκύπτουν στα σύγχρονα κινητά κυψελωτά δίκτυα όταν λαμβάνεται υπόψιν η έννοια της Ποιότητας Εμπειρίας. Τέτοιες ευκαιρίες αφορούν, καταρχήν, τη δυνατότητα κατανόησης της Ποιότητας Εμπειρίας που επιτυγχάνει ένας πάροχος κατά την προσφορά μίας υπηρεσίας. Αυτό μπορεί να επιτευχθεί με την υλοποίηση και ενσωμάτωση μεθόδων αξιολόγησης Ποιότητας Εμπειρίας στην πραγματικού-χρόνου λειτουργία ενός δικτύου. Εν συνεχεία, ακολουθεί η εκμετάλλευση της συλλεγμένης ευφυΐας που σχετίζεται με την Ποιότητα Εμπειρίας, προκειμένου να επανεξεταστούν υφιστάμενοι μηχανισμοί επιπέδου δικτύου (π.χ., χρονο-προγραμματισμός ραδιοπόρων) ή μηχανισμοί επιπέδου εφαρμογής (π.χ., ροή βίντεο), αλλά και να προταθούν καινοτόμες διαστρωματικές προσεγγίσεις προς όφελος της Ποιότητας Εμπειρίας. Επιπλέον, υπάρχει η δυνατότητα πρότασης νέων αλγορίθμων που προκύπτουν από τα εγγενή χαρακτηριστικά της Ποιότητας Εμπειρίας, όπως η μη γραμμική επίδραση μετρικών Ποιότητας Υπηρεσίας στην Ποιότητα Εμπειρίας, με στόχο την περαιτέρω βελτίωσή της. Σε αυτή την κατεύθυνση, στην παρούσα διατριβή, διερευνώνται και αξιοποιούνται μοντέλα και μετρικές εκτίμησης Ποιότητας Εμπειρίας με στόχο την ποσοτικοποίησή της, έχοντας ως απώτερο στόχο την εισαγωγή βελτιώσεων στους υφιστάμενους μηχανισμούς κινητών κυψελωτών δικτύων. Ο πυρήνας αυτής της διατριβής είναι η πρόταση μίας κυκλικής διεργασίας παροχής Ποιότητας Εμπειρίας που επιτρέπει τον έλεγχο, την παρακολούθηση (ήτοι, τη μοντελοποίηση) και τη διαχείριση της Ποιότητας Εμπειρίας σε ένα κυψελωτό δίκτυο. Κάθε μία από αυτές τις λειτουργίες αναλύεται περαιτέρω, ενώ έμφαση δίνεται στις λειτουργίες μοντελοποίησης και διαχείρισης. Όσον αφορά τη μοντελοποίηση, γίνεται περιγραφή και ταξινόμηση των μεθόδων εκτίμησης και των δεικτών επιδόσεων Ποιότητας Εμπειρίας. Η παραμετρική εκτίμηση της ποιότητας αναδεικνύεται ως η πιο ελκυστική κατηγορία μοντελοποίησης Ποιότητας Εμπειρίας σε κινητά κυψελωτά δίκτυα, οπότε και περιγράφεται διεξοδικά για ευρέως χρησιμοποιούμενους τύπους υπηρεσιών, όπως η συνομιλία (φωνή) μέσω Internet Protocol (IP) και η μετάδοση βίντεο. Όσον αφορά τη διαχείριση Ποιότητας Εμπειρίας, προτείνονται νέοι μηχανισμοί που επιδεικνύουν βελτιώσεις στην εμπειρία των τελικών χρηστών, και συγκεκριμένα: α) ένα σχήμα ελέγχου των επικοινωνιών συσκευής-προς-συσκευή που λαμβάνει υπόψιν την εμπειρία των χρηστών, β) ένας «συνεπής» αλγόριθμος χρονο-προγραμματισμού ραδιοπόρων που βελτιώνει την Ποιότητα Εμπειρίας του χρήστη μετριάζοντας τις διακυμάνσεις της ρυθμαπόδοσης του δικτύου, και γ) ένας μηχανισμός προσαρμοστικής ροής βίντεο με γνώσεις «πλαισίου», ο οποίος επιτυγχάνει την εξάλειψη διακοπών του βίντεο σε συνθήκες χαμηλού εύρους ζώνης. Επιπλέον, προτείνεται μία εφαρμογή Ποιότητας Εμπειρίας βασισμένη στην αρχιτεκτονική Software-Defined Networking (SDN), ονόματι “QoE-SDN APP”, η οποία επιτρέπει την ανάδραση πληροφοριών δικτύου από παρόχους κινητής τηλεφωνίας σε παρόχους υπηρεσιών βίντεο, αναδεικνύοντας πλεονεκτήματα ως προς την Ποιότητα Εμπειρίας για τους πελάτες των παρόχων βίντεο αλλά και ως προς την εξοικονόμηση εύρους ζώνης για τους φορείς εκμετάλλευσης δικτύου. Εν κατακλείδι, η παρούσα διατριβή προωθεί την ενοποίηση του ερευνητικού πεδίου της Ποιότητας Εμπειρίας με τον τομέα των κινητών επικοινωνιών, καθώς και τη συνεργασία αμοιβαίου ενδιαφέροντος μεταξύ των παρόχων δικτύου (επίπεδο δικτύου) με τους παρόχους υπηρεσιών (επίπεδο εφαρμογής), αναδεικνύοντας την δυναμική από τέτοιου είδους προσεγγίσεις για όλους τους εμπλεκόμενους φορείς.Traditionally, previous generations of mobile cellular networks have been designed with Quality of Service (QoS) criteria in mind, so that they manage to meet specific service requirements. Quality of Experience (QoE) has, however, recently emerged as a concept, disrupting the design of future network generations by giving clear emphasis on the actually achieved user experience. The emergence of the QoE concept has been a result of the inevitable strong transition that the Telecom industry is currently experiencing from system-centric networks to more user-centric solutions and objectives. Mobile network operators, service providers, application developers, as well as other stakeholders involved in the service provisioning chain have been attracted by the opportunities that the integration of the QoE concept could bring to their business; indeed, the provisioned QoE constitutes a determining factor of differentiation among different stakeholders, a tendency which is expected to become even more intense in the years to come. Motivated by this boost towards user-centricity, the objective of the research conducted in this thesis is to explore the challenges and opportunities that arise in modern mobile cellular networks when QoE is considered. Such opportunities concern, first of all, the possibility to comprehend the QoE that a provider achieves when provisioning a service. This can be enabled by the implementation and integration of QoE assessment methods into the real-time operation of a network. Then, the next step is the exploitation of collected QoE-related intelligence in order to re-examine existing network-layer mechanisms (e.g., radio scheduling), or application-layer mechanisms (e.g., video streaming), as well as propose novel cross-layer approaches towards ameliorating the achieved QoE. Moreover, the opportunity emerges to propose novel algorithms that stem from the inherent idiosyncrasies of QoE, such as the non-linear impact of QoS-related parameters on QoE, as a way to further enhance the users’ QoE. In this direction, throughout this thesis, QoE estimation models and metrics are explored and exploited in order to quantify QoE and thus, to improve existing mechanisms of mobile cellular networks. The core of this thesis is the proposal of a QoE provisioning cycle that allows the control, monitoring (i.e., modeling) and management of QoE in a cellular network. Each one of these functions is further analyzed, while emphasis is given on the modeling and management operations. In terms of modeling, QoE assessment methods and QoE-related performance indicators are described and classified. Parametric quality estimation is identified as the most appealing type of QoE estimation in mobile cellular networks, thus, it is thoroughly described for widely used types of services, such as Voice over IP (VoIP) and video streaming. In terms of QoE management, novel QoE-aware mechanisms that demonstrate QoE improvements for the users are proposed, namely: a) a QoE-driven Device-to-Device (D2D) communication management scheme that enhances end-user QoE, b) a “consistent” radio scheduling algorithm that improves the end-user QoE by mitigating throughput fluctuations, and c) a context-aware HTTP Adaptive Streaming (HAS) mechanism that successfully mitigates stallings (i.e., video freezing events) in the context of bandwidth-challenging scenarios. Moreover, a programmable QoE-SDN APP into the Software-Defined Networking (SDN) architecture is introduced, which enables network feedback exposure from mobile network operators to video service providers, revealing QoE benefits for the customers of video providers and bandwidth savings for the network operators. Overall, this thesis promotes the uniting of the domain of QoE with the domain of mobile communications, as well as the collaboration of mutual-interest between mobile network operators (network layer) and service providers (application layer), presenting the high potential from such approaches for all involved stakeholders

Cross-layer optimisation of quality of experience for video traffic

Realtime video traffic is currently the dominant network traffic and is set to increase in volume for the foreseeable future. As this traffic is bursty, providing perceptually good video quality is a challenging task. Bursty traffic refers to inconsistency of the video traffic level. It is at high level sometimes while is at low level at some other times. Many video traffic measurement algorithms have been proposed for measurement-based admission control. Despite all of this effort, there is no entirely satisfactory admission algorithm for variable rate flows. Furthermore, video frames are subjected to loss and delay which cause quality degradation when sent without reacting to network congestion. The perceived Quality of Experience (QoE)-number of sessions trade-off can be optimised by exploiting the bursty nature of video traffic. This study introduces a cross-layer QoE-aware optimisation architecture for video traffic. QoE is a measure of the user's perception of the quality of a network service. The architecture addresses the problem of QoE degradation in a bottleneck network. It proposes that video sources at the application layer adapt their rate to the network environment by dynamically controlling their transmitted bit rate. Whereas the edge of the network protects the quality of active video sessions by controlling the acceptance of new sessions through a QoE-aware admission control. In particular, it seeks the most efficient way of accepting new video sessions and adapts sending rates to free up resources for more sessions whilst maintaining the QoE of the current sessions. As a pathway to the objective, the performance of the video flows that react to the network load by adapting the sending rate was investigated. Although dynamic rate adaptation enhances the video quality, accepting more sessions than a link can accommodate will degrade the QoE. The video's instantaneous aggregate rate was compared to the average aggregate rate which is a calculated rate over a measurement time window. It was found that there is no substantial difference between the two rates except for a small number of video flows, long measurement window, or fast moving contents (such as sport), in which the average is smaller than the instantaneous rate. These scenarios do not always represent the reality. The finding discussed above was the main motivation for proposing a novel video traffic measurement algorithm that is QoE-aware. The algorithm finds the upper limit of the video total rate that can exceed a specific link capacity without the QoE degradation of ongoing video sessions. When implemented in a QoE-aware admission control, the algorithm managed to maintain the QoE for a higher number of video session compared to the calculated rate-based admission controls such as the Internet Engineering Task Force (IETF) standard Pre-Congestion Notification (PCN)-based admission control. Subjective tests were conducted to involve human subjects in rating of the quality of videos delivered with the proposed measurement algorithm. Mechanisms proposed for optimising the QoE of video traffic were surveyed in detail in this dissertation and the challenges of achieving this objective were discussed. Finally, the current rate adaptation capability of video applications was combined with the proposed QoE-aware admission control in a QoE-aware cross-layer architecture. The performance of the proposed architecture was evaluated against the architecture in which video applications perform rate adaptation without being managed by the admission control component. The results showed that our architecture optimises the mean Mean Opinion Score (MOS) and number of successful decoded video sessions without compromising the delay. The algorithms proposed in this study were implemented and evaluated using Network Simulator-version 2 (NS-2), MATLAB, Evalvid and Evalvid-RA. These software tools were selected based on their use in similar studies and availability at the university. Data obtained from the simulations was analysed with analysis of variance (ANOVA) and the Cumulative Distribution Functions (CDF) for the performance metrics were calculated. The proposed architecture will contribute to the preparation for the massive growth of video traffic. The mathematical models of the proposed algorithms contribute to the research community

Contribution to quality of user experience provision over wireless networks

The widespread expansion of wireless networks has brought new attractive possibilities to end users. In addition to the mobility capabilities provided by unwired devices, it is worth remarking the easy configuration process that a user has to follow to gain connectivity through a wireless network. Furthermore, the increasing bandwidth provided by the IEEE 802.11 family has made possible accessing to high-demanding services such as multimedia communications. Multimedia traffic has unique characteristics that make it greatly vulnerable against network impairments, such as packet losses, delay, or jitter. Voice over IP (VoIP) communications, video-conference, video-streaming, etc., are examples of these high-demanding services that need to meet very strict requirements in order to be served with acceptable levels of quality. Accomplishing these tough requirements will become extremely important during the next years, taking into account that consumer video traffic will be the predominant traffic in the Internet during the next years. In wired systems, these requirements are achieved by using Quality of Service (QoS) techniques, such as Differentiated Services (DiffServ), traffic engineering, etc. However, employing these methodologies in wireless networks is not that simple as many other factors impact on the quality of the provided service, e.g., fading, interferences, etc. Focusing on the IEEE 802.11g standard, which is the most extended technology for Wireless Local Area Networks (WLANs), it defines two different architecture schemes. On one hand, the infrastructure mode consists of a central point, which manages the network, assuming network controlling tasks such as IP assignment, routing, accessing security, etc. The rest of the nodes composing the network act as hosts, i.e., they send and receive traffic through the central point. On the other hand, the IEEE 802.11 ad-hoc configuration mode is less extended than the infrastructure one. Under this scheme, there is not a central point in the network, but all the nodes composing the network assume both host and router roles, which permits the quick deployment of a network without a pre-existent infrastructure. This type of networks, so called Mobile Ad-hoc NETworks (MANETs), presents interesting characteristics for situations when the fast deployment of a communication system is needed, e.g., tactics networks, disaster events, or temporary networks. The benefits provided by MANETs are varied, including high mobility possibilities provided to the nodes, network coverage extension, or network reliability avoiding single points of failure. The dynamic nature of these networks makes the nodes to react to topology changes as fast as possible. Moreover, as aforementioned, the transmission of multimedia traffic entails real-time constraints, necessary to provide these services with acceptable levels of quality. For those reasons, efficient routing protocols are needed, capable of providing enough reliability to the network and with the minimum impact to the quality of the service flowing through the nodes. Regarding quality measurements, the current trend is estimating what the end user actually perceives when consuming the service. This paradigm is called Quality of user Experience (QoE) and differs from the traditional Quality of Service (QoS) approach in the human perspective given to quality estimations. In order to measure the subjective opinion that a user has about a given service, different approaches can be taken. The most accurate methodology is performing subjective tests in which a panel of human testers rates the quality of the service under evaluation. This approach returns a quality score, so-called Mean Opinion Score (MOS), for the considered service in a scale 1 - 5. This methodology presents several drawbacks such as its high expenses and the impossibility of performing tests at real time. For those reasons, several mathematical models have been presented in order to provide an estimation of the QoE (MOS) reached by different multimedia services In this thesis, the focus is on evaluating and understanding the multimedia-content transmission-process in wireless networks from a QoE perspective. To this end, firstly, the QoE paradigm is explored aiming at understanding how to evaluate the quality of a given multimedia service. Then, the influence of the impairments introduced by the wireless transmission channel on the multimedia communications is analyzed. Besides, the functioning of different WLAN schemes in order to test their suitability to support highly demanding traffic such as the multimedia transmission is evaluated. Finally, as the main contribution of this thesis, new mechanisms or strategies to improve the quality of multimedia services distributed over IEEE 802.11 networks are presented. Concretely, the distribution of multimedia services over ad-hoc networks is deeply studied. Thus, a novel opportunistic routing protocol, so-called JOKER (auto-adJustable Opportunistic acK/timEr-based Routing) is presented. This proposal permits better support to multimedia services while reducing the energy consumption in comparison with the standard ad-hoc routing protocols.Universidad Politécnica de CartagenaPrograma Oficial de Doctorado en Tecnologías de la Información y Comunicacione

Machine learning for Quality of Experience in real-time applications

L'abstract è presente nell'allegato / the abstract is in the attachmen