Evaluation of Video Quality in Wireless Multimedia Sensor Networks

Simulating wireless sensor networks; there implementation and evaluation, require the use of a discrete event simulator. Omnet++ is quite a powerful simulator which supports concise and easy modeling of wired as well as wireless sensors environment. Scenarios involving multimedia transmissions with characteristics of video quality control and evaluation must be computed on the basis of Quality of Experience which relies on user’s perception to maintain the video quality. For the multimedia growth and awareness of future WMSNs, it is quite necessary that the performance should be tested for different types of radio models. So varying the radio parameters may allow for the optimization and improvement of the video quality. In this paper we have provided a test bench for the easy evaluation and optimization of the performance of WMSNs using different radio models. The performance is evaluated based on the QoE metrics; i.e. PSNR(Peak Signal-to-Noise ratio) and MoS(Mean Opinion Score), which depend on user’s perception to maintain the video quality

Measuring concept similarities in multimedia ontologies: analysis and evaluations

The recent development of large-scale multimedia concept ontologies has provided a new momentum for research in the semantic analysis of multimedia repositories. Different methods for generic concept detection have been extensively studied, but the question of how to exploit the structure of a multimedia ontology and existing inter-concept relations has not received similar attention. In this paper, we present a clustering-based method for modeling semantic concepts on low-level feature spaces and study the evaluation of the quality of such models with entropy-based methods. We cover a variety of methods for assessing the similarity of different concepts in a multimedia ontology. We study three ontologies and apply the proposed techniques in experiments involving the visual and semantic similarities, manual annotation of video, and concept detection. The results show that modeling inter-concept relations can provide a promising resource for many different application areas in semantic multimedia processing

SVCEval-RA: an evaluation framework for adaptive scalable video streaming

[EN] Multimedia content adaption strategies are becoming increasingly important for effective video streaming over the actual heterogeneous networks. Thus, evaluation frameworks for adaptive video play an important role in the designing and deploying process of adaptive multimedia streaming systems. This paper describes a novel simulation framework for rate-adaptive video transmission using the Scalable Video Coding standard (H.264/SVC). Our approach uses feedback information about the available bandwidth to allow the video source to select the most suitable combination of SVC layers for the transmission of a video sequence. The proposed solution has been integrated into the network simulator NS-2 in order to support realistic network simulations. To demonstrate the usefulness of the proposed solution we perform a simulation study where a video sequence was transmitted over a three network scenarios. The experimental results show that the Adaptive SVC scheme implemented in our framework provides an efficient alternative that helps to avoid an increase in the network congestion in resource-constrained networks. Improvements in video quality, in terms of PSNR (Peak Signal to Noise Ratio) and SSIM (Structural Similarity Index) are also obtained.Castellanos Hernández, WE.; Guerri Cebollada, JC.; Arce Vila, P. (2017). SVCEval-RA: an evaluation framework for adaptive scalable video streaming. Multimedia Tools and Applications. 76(1):437-461. doi:10.1007/s11042-015-3046-yS437461761Akhshabi S, Begen AC, Dovrolis C (2011) An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP. In: Proceedings of the second annual ACM conference on Multimedia systems. ACM, pp 157–168Alabdulkarim MN, Rikli N-E (2012) QoS Provisioning for H.264/SVC Streams over Ad-Hoc ZigBee Networks Using Cross-Layer Design. In: 8th International Conference on Wireless Communications, Networking and Mobile Computing (WiCOM). pp 1–8Birkos K, Tselios C, Dagiuklas T, Kotsopoulos S (2013) Peer selection and scheduling of H. 264 SVC video over wireless networks. In: Wireless Communications and Networking Conference (WCNC), 2013 IEEE. pp 1633–1638Castellanos W (2014) SVCEval-RA - An Evaluation Framework for Adaptive Scalable Video Streaming. In: SourceForge Project. http://sourceforge.net/projects/svceval-ra/ . Accessed 1 May 2015Castellanos W, Guerri JC, Arce P (2015) A QoS-aware routing protocol with adaptive feedback scheme for video streaming for mobile networks. Comput Commun. http://dx.doi.org/10.1016/j.comcom.2015.08.012Castellanos W, Arce P, Acelas P, Guerri JC (2012) Route Recovery Algorithm for QoS-Aware Routing in MANETs. Springer Berlin Heidelberg, Bilbao, pp. 81–93Chikkerur S, Sundaram V, Reisslein M, Karam LJ (2011) Objective video quality assessment methods: A classification, review, and performance comparison. Broadcast, IEEE Trans on 57:165–182Choupani R, Wong S, Tolun M (2014) Multiple description coding for SNR scalable video transmission over unreliable networks. Multimed Tools Appl 69:843–858. doi: 10.1007/s11042-012-1150-9CISCO Corp. (2014) Cisco Visual Networking Index Forecast and Methodology. In: White Paper. http://www.cisco.com/c/en/us/solutions/collateral/service-provider/ip-ngn-ip-next-generation-network/white_paper_c11-481360.pdf.Dai M, Zhang Y, Loguinov D (2009) A unified traffic model for MPEG-4 and H. 264 video traces. IEEE Trans Multimedia 11:1010–1023Detti A, Bianchi G, Pisa C, et al. (2009) SVEF: an open-source experimental evaluation framework for H.264 scalable video streaming. In: IEEE Symposium on Computers and Communications. pp 36–41Espina F, Morato D, Izal M, Magaña E (2014) Analytical model for MPEG video frame loss rates and playback interruptions on packet networks. Multimed Tools Appl 72:361–383. doi: 10.1007/s11042-012-1344-1Fiems D, Steyaert B, Bruneel H (2012) A genetic approach to Markovian characterisation of H.264 scalable video. Multimedia Tools Appl 58:125–146Floyd S, Handley M, Kohler E Datagram Congestion Control Protocol (DCCP). http://tools.ietf.org/html/rfc4340 . Accessed 17 Feb 2014Floyd S, Padhye J, Widmer J TCP Friendly Rate Control (TFRC): Protocol Specification. http://tools.ietf.org/html/rfc5348 . Accessed 17 Feb 2014Fraz M, Malkani YA, Elahi MA (2009) Design and implementation of real time video streaming and ROI transmission system using RTP on an embedded digital signal processing (DSP) platform. In: 2nd International Conference on Computer, Control and Communication, 2009. IC4 2009. pp 1–6ISO/IEC (2014) Information technology - Dynamic adaptive streaming over HTTP (DASH) - Part 1: Media presentation description and segment formats.ITU-T (2013) Rec. H.264 & ISO/IEC 14496-10 AVC. Advanced Video Coding for Generic Audiovisual Services.Ivrlač MT, Choi LU, Steinbach E, Nossek JA (2009) Models and analysis of streaming video transmission over wireless fading channels. Signal Process Image Commun 24:651–665. doi: 10.1016/j.image.2009.04.005Karki R, Seenivasan T, Claypool M, Kinicki R (2010) Performance Analysis of Home Streaming Video Using Orb. In: Proceedings of the 20th International Workshop on Network and Operating Systems Support for Digital Audio and Video. ACM, New York, NY, USA, pp 111–116Ke C-H (2012) myEvalSVC-an Integrated Simulation Framework for Evaluation of H. 264/SVC Transmission. KSII Trans Internet Inf Syst (TIIS) 6:377–392. doi: 10.3837/tiis.2012.01.021Ke C-H, Shieh C-K, Hwang W-S, Ziviani A (2008) An Evaluation Framework for More Realistic Simulations of MPEG Video Transmission. J Inf Sci Eng 24:425–440Klaue J, Rathke B, Wolisz A (2003) Evalvid–A framework for video transmission and quality evaluation. In: Computer Performance Evaluation. Modelling Techniques and Tools. Springer, pp 255–272Le TA, Nguyen H (2014) End-to-end transmission of scalable video contents: performance evaluation over EvalSVC—a new open-source evaluation platform. Multimed Tools Appl 72:1239–1256. doi: 10.1007/s11042-013-1444-6Lie A, Klaue J (2008) Evalvid-RA: trace driven simulation of rate adaptive MPEG-4 VBR video. Multimedia Systems 14:33–50. doi: 10.1007/s00530-007-0110-0Moving Pictures Experts Group and ITU-T Video Coding Experts Group (2011) H. 264/SVC reference software (JSVM 9.19.14) and Manual.Nightingale J, Wang Q, Grecos C (2014) Empirical evaluation of H.264/SVC streaming in resource-constrained multihomed mobile networks. Multimed Tools Appl 70:2011–2035. doi: 10.1007/s11042-012-1219-5Parmar H, Thornburgh M (2012) Real-Time Messaging Protocol (RTMP) Specification. AdobePolitis I, Dounis L, Dagiuklas T (2012) H. 264/SVC vs. H. 264/AVC video quality comparison under QoE-driven seamless handoff. Signal Process Image Commun 27:814–826Pozueco L, Pañeda XG, García R, et al. (2013) Adaptable system based on Scalable Video Coding for high-quality video service. Comput Electr Eng 39:775–789. doi: 10.1016/j.compeleceng.2013.01.015Pozueco L, Pañeda XG, García R, et al. (2014) Adaptation engine for a streaming service based on MPEG-DASH. Multimed Tools Appl 1–20. doi: 10.1007/s11042-014-2034-ySchwarz H, Marpe D, Wiegand T (2007) Overview of the Scalable Video Coding Extension of the H.264/AVC Standard. IEEE Trans Circ Syst Video Technol 17:1103–1120. doi: 10.1109/TCSVT.2007.905532Seo H-Y (2013) An Efficient Transmission Scheme of MPEG2-TS over RTP for a Hybrid DMB System. ETRI J 35:655–665. doi: 10.4218/etrij.13.0112.0124Sohn H, Yoo H, De Neve W, et al. (2010) Full-Reference Video Quality Metric for Fully Scalable and Mobile SVC Content. IEEE Trans Broadcast 56:269–280. doi: 10.1109/TBC.2010.2050628Sousa-Vieira M-E (2011) Suitability of the M/G/∞ process for modeling scalable H.264 video traffic. In: Analytical and Stochastic Modeling Techniques and Applications. Springer, pp 149–158Tanwir S, Perros H (2013) A Survey of VBR Video Traffic Models. IEEE Commun Surv Tutor 15:1778–1802. doi: 10.1109/SURV.2013.010413.00071Tanwir S, Perros HG (2014) VBR Video Traffic Models. Wiley, HobokenThe Network Simulator (NS-2). http://www.isi.edu/nsnam/ns . Accessed 6 Feb 2015Unanue I, Urteaga I, Husemann R, et al. (2011) A Tutorial on H. 264/SVC Scalable Video Coding and its Tradeoff between Quality, Coding Efficiency and Performance. Recent Advances on Video Coding 1–24.Van der Auwera G, David PT, Reisslein M, Karam LJ (2008) Traffic and quality characterization of the H. 264/AVC scalable video coding extension. Adv Multimedia 2008:1Wang Y, Claypool M (2005) RealTracer—Tools for Measuring the Performance of RealVideo on the Internet. Multimed Tools Appl 27:411–430. doi: 10.1007/s11042-005-3757-6Wang Z, Lu L, Bovik AC (2004) Video quality assessment based on structural distortion measurement. Signal Process Image Commun 19:121–132. doi: 10.1016/S0923-5965(03)00076–6Wien M, Schwarz H, Oelbaum T (2007) Performance Analysis of SVC. IEEE Trans Circ Syst for Video Technol 17:1194–1203. doi: 10.1109/TCSVT.2007.905530YUV video repository. ftp://ftp.tnt.uni-hannover.de/pub/svc/testsequences/ . Accessed 10 Jan 201

Analysis of Objective and Subjective Methods for Assessment of Video Streaming Service

U ovom završnom radu analizirane su metode i modeli objektivnog i subjektivnog mjerenja kvalitete usluge prijenosa videosadržaja. Također, definirani su pojmovi kvalitete usluge i iskustvene kvalitete usluge. Pojmovi su pojašnjeni koristeći različite definicije međunarodnih institucija i stručnih organizacija. Nadalje, klasificirani su parametri kvalitete usluge, dok je kod iskustvene kvalitete usluge opisano njeno vrednovanje s posebnim osvrtom na multimedijalne usluge. Naposljetku, dan je prikaz modela za analizu kvalitete videosadržaja, kao i evaluacijski rezultati pojedinih modela.In this thesis the analysis of objective and subjective methods and models for evaluation of video streaming service quality was conducted. The terms Quality of Service and Quality of Experience are defined using different definitions of international institutions and professional organizations. Furthermore, parameters of Quality of Service are classified; for Quality of Experience the evaluation process is explained with a special focus on multimedia services. Lastly, the thesis highlights the characteristics of evaluation models of video quality, as well as the evaluation results of particular models

Analysis of Objective and Subjective Methods for Assessment of Video Streaming Service

U ovom završnom radu analizirane su metode i modeli objektivnog i subjektivnog mjerenja kvalitete usluge prijenosa videosadržaja. Također, definirani su pojmovi kvalitete usluge i iskustvene kvalitete usluge. Pojmovi su pojašnjeni koristeći različite definicije međunarodnih institucija i stručnih organizacija. Nadalje, klasificirani su parametri kvalitete usluge, dok je kod iskustvene kvalitete usluge opisano njeno vrednovanje s posebnim osvrtom na multimedijalne usluge. Naposljetku, dan je prikaz modela za analizu kvalitete videosadržaja, kao i evaluacijski rezultati pojedinih modela.In this thesis the analysis of objective and subjective methods and models for evaluation of video streaming service quality was conducted. The terms Quality of Service and Quality of Experience are defined using different definitions of international institutions and professional organizations. Furthermore, parameters of Quality of Service are classified; for Quality of Experience the evaluation process is explained with a special focus on multimedia services. Lastly, the thesis highlights the characteristics of evaluation models of video quality, as well as the evaluation results of particular models

Quality of Experience (QoE)-Aware Fast Coding Unit Size Selection for HEVC Intra-prediction

The exorbitant increase in the computational complexity of modern video coding standards, such as High Efficiency Video Coding (HEVC), is a compelling challenge for resource-constrained consumer electronic devices. For instance, the brute force evaluation of all possible combinations of available coding modes and quadtree-based coding structure in HEVC to determine the optimum set of coding parameters for a given content demand a substantial amount of computational and energy resources. Thus, the resource requirements for real time operation of HEVC has become a contributing factor towards the Quality of Experience (QoE) of the end users of emerging multimedia and future internet applications. In this context, this paper proposes a content-adaptive Coding Unit (CU) size selection algorithm for HEVC intra-prediction. The proposed algorithm builds content-specific weighted Support Vector Machine (SVM) models in real time during the encoding process, to provide an early estimate of CU size for a given content, avoiding the brute force evaluation of all possible coding mode combinations in HEVC. The experimental results demonstrate an average encoding time reduction of 52.38%, with an average Bjøntegaard Delta Bit Rate (BDBR) increase of 1.19% compared to the HM16.1 reference encoder. Furthermore, the perceptual visual quality assessments conducted through Video Quality Metric (VQM) show minimal visual quality impact on the reconstructed videos of the proposed algorithm compared to state-of-the-art approaches

Visual Quality Assessment after Network Transmission Incorporating NS2 and Evalvid

On the basis of Evalvid tool integrated in NS2 (Network Simulator version 2), the paper gets new set of tools, myEvalvid, to establish the simulation and evaluation platform for multimedia transmission. Then the paper investigates the effects of various influence factors when multimedia information is transmitted in the network and the relationships among these factors. Based on the analysis, the paper gets different evaluation models, respectively. In this paper, we study the impact on performance of several basic source and network parameters of video streams, namely, GOP (Group of Pictures) pattern, compression quantitative parameters, packet length, and packet error rate. Simulation results show that different parameters lead to different distortion levels which are calculated according to the reconstruction images at the receiver and the original images. The experimental results show that the video transmission and quality evaluation model we designed can evaluate multimedia transmission performance over complex environment very well

A robust multimedia traffic SDN-Based management system using patterns and models of QoE estimation with BRNN

[EN] Nowadays, network infrastructures such as Software Defined Networks (SDN) achieve a huge computational power. This allows to add a high processing on the network nodes. In this paper, a multimedia traffic management system is presented. This system is based on estimation models of Quality of Experience (QoE) and also on the traffic patterns classification. In order to achieve this, a QoE estimation method has been modeled. This method allows for classifying the multimedia traffic from multimedia transmission patterns. In order to do this, the SDN controller gathers statistics from the network. The patterns used have been defined from a lineal combination of objective QoE measurements. The model has been defined by Bayesian regularized neural networks (BRNN). From this model, the system is able to classify several kind of traffic according to the quality perceived by the users. Then, a model has been developed to determine which video characteristics need to be changed to provide the user with the best possible quality in the critical moments of the transmission. The choice of these characteristics is based on the quality of service (QoS) parameters, such as delay, jitter, loss rate and bandwidth. Moreover, it is also based on subpatterns defined by clusters from the dataset and which represents network and video characteristics. When a critical network situation is given, the model selects, by using network parameters as entries, the subpattern with the most similar network condition. The minimum Euclidean distance between these entries and the network parameters of the subpatters is calculated to perform this selection. Both models work together to build a reliable multimedia traffic management system perfectly integrated into current network infrastructures, which is able to classify the traffic and solve critical situations changing the video characteristics, by using the SDN architecture.This work has been partially supported by the "Ministerio de Educacion, Cultura y Deporte", through the "Ayudas para contratos predoctorales de Formation del Profesorado Universitario FPU (Convocatoria 2015)", grant number FPU15/06837 and by the "Ministerio de Economia y Competitividad" in the "Programa Estatal de Fomento de la Investigation Cientffica y Tecnica de Excelencia, Subprograma Estatal de Generacion de Conocimiento" within the project under Grant TIN2017-84802-C2-1-P.Canovas Solbes, A.; Rego Mañez, A.; Romero Martínez, JO.; Lloret, J. (2020). A robust multimedia traffic SDN-Based management system using patterns and models of QoE estimation with BRNN. Journal of Network and Computer Applications. 150:1-14. https://doi.org/10.1016/j.jnca.2019.102498S114150Cánovas, A., Taha, M., Lloret, J., & Tomás, J. (2018). Smart resource allocation for improving QoE in IP Multimedia Subsystems. Journal of Network and Computer Applications, 104, 107-116. doi:10.1016/j.jnca.2017.12.020Canovas, A., Jimenez, J. M., Romero, O., & Lloret, J. (2018). Multimedia Data Flow Traffic Classification Using Intelligent Models Based on Traffic Patterns. IEEE Network, 32(6), 100-107. doi:10.1109/mnet.2018.1800121Burden, F., & Winkler, D. (2008). Bayesian Regularization of Neural Networks. Artificial Neural Networks, 23-42. doi:10.1007/978-1-60327-101-1_3Goodman, S. N. (2005). Introduction to Bayesian methods I: measuring the strength of evidence. Clinical Trials, 2(4), 282-290. doi:10.1191/1740774505cn098oaHirschen, K., & Schäfer, M. (2006). Bayesian regularization neural networks for optimizing fluid flow processes. Computer Methods in Applied Mechanics and Engineering, 195(7-8), 481-500. doi:10.1016/j.cma.2005.01.015Huang, X., Yuan, T., Qiao, G., & Ren, Y. (2018). Deep Reinforcement Learning for Multimedia Traffic Control in Software Defined Networking. IEEE Network, 32(6), 35-41. doi:10.1109/mnet.2018.1800097Lin, Y. (2002). Data Mining and Knowledge Discovery, 6(3), 259-275. doi:10.1023/a:1015469627679Lopez-Martin, M., Carro, B., Lloret, J., Egea, S., & Sanchez-Esguevillas, A. (2018). Deep Learning Model for Multimedia Quality of Experience Prediction Based on Network Flow Packets. IEEE Communications Magazine, 56(9), 110-117. doi:10.1109/mcom.2018.1701156Hagan, M. T., & Menhaj, M. B. (1994). Training feedforward networks with the Marquardt algorithm. IEEE Transactions on Neural Networks, 5(6), 989-993. doi:10.1109/72.329697Nguyen, T. T. T., & Armitage, G. (2008). A survey of techniques for internet traffic classification using machine learning. IEEE Communications Surveys & Tutorials, 10(4), 56-76. doi:10.1109/surv.2008.080406Queiroz, W., Capretz, M. A. M., & Dantas, M. (2019). An approach for SDN traffic monitoring based on big data techniques. Journal of Network and Computer Applications, 131, 28-39. doi:10.1016/j.jnca.2019.01.016Rego, A., Canovas, A., Jimenez, J. M., & Lloret, J. (2018). An Intelligent System for Video Surveillance in IoT Environments. IEEE Access, 6, 31580-31598. doi:10.1109/access.2018.2842034Seshadrinathan, K., Soundararajan, R., Bovik, A. C., & Cormack, L. K. (2010). Study of Subjective and Objective Quality Assessment of Video. IEEE Transactions on Image Processing, 19(6), 1427-1441. doi:10.1109/tip.2010.2042111Soysal, M., & Schmidt, E. G. (2010). Machine learning algorithms for accurate flow-based network traffic classification: Evaluation and comparison. Performance Evaluation, 67(6), 451-467. doi:10.1016/j.peva.2010.01.001Tan, X., Xie, Y., Ma, H., Yu, S., & Hu, J. (2019). Recognizing the content types of network traffic based on a hybrid DNN-HMM model. Journal of Network and Computer Applications, 142, 51-62. doi:10.1016/j.jnca.2019.06.004Tongaonkar, A., Torres, R., Iliofotou, M., Keralapura, R., & Nucci, A. (2015). Towards self adaptive network traffic classification. Computer Communications, 56, 35-46. doi:10.1016/j.comcom.2014.03.02