5MART: A 5G SMART scheduling framework for optimizing QoS through reinforcement learning

The massive growth in mobile data traffic and the heterogeneity and stringency of Quality of Service (QoS) requirements of various applications have put significant pressure on the underlying network infrastructure and represent an important challenge even for the very anticipated 5G networks. In this context, the solution is to employ smart Radio Resource Management (RRM) in general and innovative packet scheduling in particular in order to offer high flexibility and cope with both current and upcoming QoS challenges. Given the increasing demand for bandwidth-hungry applications, conventional scheduling strategies face significant problems in meeting the heterogeneous QoS requirements of various application classes under dynamic network conditions. This paper proposes 5MART, a 5G smart scheduling framework that manages the QoS provisioning for heterogeneous traffic. Reinforcement learning and neural networks are jointly used to find the most suitable scheduling decisions based on current networking conditions. Simulation results show that the proposed 5MART framework can achieve up to 50% improvement in terms of time fraction (in sub-frames) when the heterogeneous QoS constraints are met with respect to other state-of-the-art scheduling solutions

An innovative machine learning-based scheduling solution for improving live UHD video streaming quality in highly dynamic network environments

The latest advances in terms of network technologies open up new opportunities for high-end applications, including using the next generation video streaming technologies. As mobile devices become more affordable and powerful, an increasing range of rich media applications could offer a highly realistic and immersive experience to mobile users. However, this comes at the cost of very stringent Quality of Service (QoS) requirements, putting significant pressure on the underlying networks. In order to accommodate these new rich media applications and overcome their associated challenges, this paper proposes an innovative Machine Learning-based scheduling solution which supports increased quality for live omnidirectional (360◦) video streaming. The proposed solution is deployed in a highly dy-namic Unmanned Aerial Vehicle (UAV)-based environment to support immersive live omnidirectional video streaming to mobile users. The effectiveness of the proposed method is demonstrated through simulations and compared against three state-of-the-art scheduling solutions, such as: Static Prioritization (SP), Required Activity Detection Scheduler (RADS) and Frame Level Scheduler (FLS). The results show that the proposed solution outperforms the other schemes involved in terms of PSNR, throughput and packet loss rate

Joint Communication and Computational Resource Allocation for QoE-driven Point Cloud Video Streaming

Point cloud video is the most popular representation of hologram, which is the medium to precedent natural content in VR/AR/MR and is expected to be the next generation video. Point cloud video system provides users immersive viewing experience with six degrees of freedom and has wide applications in many fields such as online education, entertainment. To further enhance these applications, point cloud video streaming is in critical demand. The inherent challenges lie in the large size by the necessity of recording the three-dimensional coordinates besides color information, and the associated high computation complexity of encoding. To this end, this paper proposes a communication and computation resource allocation scheme for QoE-driven point cloud video streaming. In particular, we maximize system resource utilization by selecting different quantities, transmission forms and quality level tiles to maximize the quality of experience. Extensive simulations are conducted and the simulation results show the superior performance over the existing scheme

E³DOAS: balancing QoE and energy-saving for multi-device adaptation in future mobile wireless video delivery

Smart devices (e.g. smartphones, tablets, smart-home devices, etc.) have become important companions to most people in their daily activities, and are very much used for multimedia content exchange (i.e. video sharing, real-time/non-real-time multimedia streaming), contributing to the exponential increase in mobile traffic over the current wireless networks. While the next generation mobile networks will provide higher capacity than the current 4G systems, the network operators will face important challenges associated with the outstanding increase of both video traffic and user expectations in terms of their levels of perceived quality or Quality of Experience (QoE). Furthermore, the heterogeneity of mobile devices (e.g. screen resolution, battery life, hardware performance) also impacts severely the end-user QoE. In this context, this paper proposes an Evolved QoE-aware Energy-saving Device-Oriented Adaptive Scheme (E3DOAS ) for mobile multimedia delivery over future wireless networks. E3DOAS makes use of a coalition game-based rate allocation strategy within the multi-device heterogeneous environment, and optimizes the trade-off between the end-user perceived quality of the multimedia delivery and the mobile device energy-saving. Testing has involved a prototype of E3DOAS, a crowd-sourcing-based QoE assessment method to model non-reference perceptual video quality, and an energy measurement testbed introduced to collect power consumption parameters of the mobile devices. Simulation-based performance evaluation showed how E3DOAS outperformed other state of the art multimedia adaptive solutions in terms of energy saving, end-to-end Quality of Service (QoS) metrics and end-user perceived quality