BVI-VFI: A Video Quality Database for Video Frame Interpolation

Video frame interpolation (VFI) is a fundamental research topic in video processing, which is currently attracting increased attention across the research community. While the development of more advanced VFI algorithms has been extensively researched, there remains little understanding of how humans perceive the quality of interpolated content and how well existing objective quality assessment methods perform when measuring the perceived quality. In order to narrow this research gap, we have developed a new video quality database named BVI-VFI, which contains 540 distorted sequences generated by applying five commonly used VFI algorithms to 36 diverse source videos with various spatial resolutions and frame rates. We collected more than 10,800 quality ratings for these videos through a large scale subjective study involving 189 human subjects. Based on the collected subjective scores, we further analysed the influence of VFI algorithms and frame rates on the perceptual quality of interpolated videos. Moreover, we benchmarked the performance of 33 classic and state-of-the-art objective image/video quality metrics on the new database, and demonstrated the urgent requirement for more accurate bespoke quality assessment methods for VFI. To facilitate further research in this area, we have made BVI-VFI publicly available at https://github.com/danier97/BVI-VFI-database

Visual lameness assessment in comparison to quantitative gait analysis data in horses

Background Quantitative gait analysis offers objective information to support clinical decision-making during lameness workups including advantages in terms of documentation, communication, education, and avoidance of expectation bias. Nevertheless, hardly any data exist comparing outcome of subjective scoring with the output of objective gait analysis systems. Objectives To investigate between- and within-veterinarian agreement on primary lame limb and lameness grade, and to determine relationships between subjective lameness grade and quantitative data, focusing on differences between (1) veterinarians, (2) live vs video assessment, (3) baseline assessment vs assessment following diagnostic analgesia. Study design Clinical observational study. Methods Kinematic data were compared to subjective lameness assessment by clinicians with >= 8 years of orthopaedic experience. Subjective assessments and kinematic data for baseline trot-ups and response to 48 diagnostic analgesia interventions in 23 cases were included. Between and within-veterinarian agreement was investigated using Cohen's Kappa (kappa). Asymmetry parameters for kinematic data ('forelimb lame pattern', 'hindlimb lame pattern', 'overall symmetry', 'vector sum head', 'pelvic sum') were determined, and used as outcome variables in mixed models; explanatory variables were subjective lameness grade and its interaction with (1) veterinarian, (2) live or video evaluation and (3) baseline or diagnostic analgesia assessment. Results Agreement on lame limb between live and video assessment was 'good' between and within veterinarians (median kappa = 0.64 and kappa = 0.53). There was a positive correlation between subjective scoring and measured asymmetry. The relationship between lameness grade and objective asymmetry differed slightly between (1) veterinarians (for all combined parameters, p-values between P < .001 and 0.04), (2) between live and video assessments ('forelimb lame pattern', 'overall symmetry', both P <= .001), and (3) between baseline and diagnostic analgesia assessment (all combined parameters, between P < .001 and .007). Main limitations Limited number of veterinarians (n = 4) and cases (n = 23), only straight-line soft surface data, different number of subjective assessments live vs from video. Conclusions Overall, between- and within-veterinarian agreement on lame limb was 'good', whereas agreement on lameness grade was 'acceptable' to 'poor'. Quantitative data and subjective assessments correlated well, with minor though significant differences in the number of millimetres, equivalent to one lameness grade between veterinarians, and between assessment conditions. Differences between baseline assessment vs assessment following diagnostic analgesia suggest that addition of objective data can be beneficial to reduce expectation bias. The small differences between live and video assessments support the use of high-quality videos for documentation, communication, and education, thus, complementing objective gait analysis data

An automated model for the assessment of QoE of adaptive video streaming over wireless networks

[EN] Nowadays, heterogeneous devices are widely utilizing Hypertext Transfer Protocol (HTTP) to transfer the data. Furthermore, HTTP adaptive video streaming (HAS) technology transmits the video data over wired and wireless networks. In adaptive technology services, a client's application receives a streaming video through the adaptation of its quality to the network condition. However, such a technology has increased the demand for Quality of Experience (QoE) in terms of prediction and assessment. It can also cause a challenging behavior regarding subjective and objective QoE evaluations of HTTP adaptive video over time since each Quality of Service (QoS) parameter affects the QoE of end-users separately. This paper introduces a methodology design for the evaluation of subjective QoE in adaptive video streaming over wireless networks. Besides, some parameters are considered such as video characteristics, segment length, initial delay, switch strategy, stalls, as well as QoS parameters. The experiment's evaluation demonstrated that objective metrics can be mapped to the most significant subjective parameters for user's experience. The automated model could function to demonstrate the importance of correlation for network behaviors' parameters. Consequently, it directly influences the satisfaction of the end-user's perceptual quality. In comparison with other recent related works, the model provided a positive Pearson Correlation value. Simulated results give a better performance between objective Structural Similarity (SSIM) and subjective Mean Opinion Score (MOS) evaluation metrics for all video test samples.This work has been partially supported by the "Ministerio de Economia y Competitividad" in the "Programa Estatal de Fomento de la Investigacion Cientifica y Tecnica de Excelencia, Subprograma Estatal de Generacion de Conocimiento" within the Project under Grant TIN2017-84802-C2-1-P. This study has been partially done in the computer science departments at the (University of Sulaimani and Halabja).Taha, M.; Ali, A.; Lloret, J.; Gondim, PRL.; Canovas, A. (2021). An automated model for the assessment of QoE of adaptive video streaming over wireless networks. Multimedia Tools and Applications. 80(17):26833-26854. https://doi.org/10.1007/s11042-021-10934-92683326854801

Routine tests for both planning and evaluating image quality in tele-echocardiography

Both in real-time and "store & forward" tele-echocardiography (T-E), a coding process has to be applied to the echocardiography videoclips in order to limit the bandwidth needed and adapt it to the bandwidths furnished by network providers. The compression process degrades the videoclips, affecting thus the quality of the videoclips and potentially compromising the diagnostic accuracy of the T-E. In this work the authors investigated on the use of automatic tools for the video quality assessment by means of objective methods with particular care to the role of the system administrator. As the use of tests on video quality assessment (based on subjective methods) is hampered by the high number of needed resources (persons, laboratories and time). The use of valid objective methods is thus desirable. The study reviewed different tools with this specific aim. One of the more suitable tool was found to be represented by a software package designed by the Institute of Telecommunication Sciences and the National Telecommunication and Information Administration, the NTIA/ITS VQM tool. This tool gives back objective-quantitative data as outcomes, however embeds models emulating the subjective perception. This study reviewed and analyzed in depth the functionalities of the tool to improve the image quality in TE over the network. The tool was also found suitable for a more general process of T-E assessment, from a health technology assessment (HTA) perspective

Effectiveness of slow motion video compared to real time video in improving the accuracy and consistency of subjective gait analysis in dogs

Objective measures of canine gait quality via force plates, pressure mats or kinematic analysis are considered superior to subjective gait assessment (SGA). Despite research demonstrating that SGA does not accurately detect subtle lameness, it remains the most commonly performed diagnostic test for detecting lameness in dogs. This is largely because the financial, temporal and spatial requirements for existing objective gait analysis equipment makes this technology impractical for use in general practice. The utility of slow motion video as a potential tool to augment SGA is currently untested. To evaluate a more accessible way to overcome the limitations of SGA, a slow motion video study was undertaken. Three experienced veterinarians reviewed video footage of 30 dogs, 15 with a diagnosis of primary limb lameness based on history and physical examination, and 15 with no indication of limb lameness based on history and physical examination. Four different videos were made for each dog, demonstrating each dog walking and trotting in real time, and then again walking and trotting in 50% slow motion. For each video, the veterinary raters assessed both the degree of lameness, and which limb(s) they felt represented the source of the lameness. Spearman’s rho, Cramer’s V, and t-tests were performed to determine if slow motion video increased either the accuracy or consistency of raters’ SGA relative to real time video. Raters demonstrated no significant increase in consistency or accuracy in their SGA of slow motion video relative to real time video. Based on these findings, slow motion video does not increase the consistency or accuracy of SGA values. Further research is required to determine if slow motion video will benefit SGA in other ways

Video Quality Assessment: Exploring the Impact of Frame Rate

Technology advancements in the past decades has led to an immense increase in data traffic over various networks. Videos constitute a major percentage of this traffic and their share is projected to increase at an accelerating speed in the coming years. Service providers aim to deliver videos that have high quality while at the same time keeping the data rate as low as possible. Effective and efficient objective Video Quality Assessment~(VQA) algorithms are essential in order to provide real time estimate of video quality so that the best compromise between data rate and quality can be achieved. Data rate of video transmission can be altered by controlling different parameters of the video, among which frame rate is one of the most important parameters. So far, only limited works have been done to study the impact of frame rate variations on video quality. The purpose of this work is to investigate the impact of varying frame rate on the quality of videos and to develop novel VQA models that integrate frame rate variations into the task of quality assessment. In order to achieve this goal, we first construct two new video databases that contain videos of diverse content, and spatial and temporal resolutions. We carry out subjective studies on these databases to obtain human opinions on video quality. The subjective study allows us to evaluate the performance of well known objective VQA algorithms on cross-frame rate videos. The results reveal that there is considerable disparity between the subjective scores and the predictions from state-of-the-art objective models that do not take frame rate into consideration. We explore statistical models for video quality analysis. In particular, we conduct cross-frame local phase statistical analysis, which provides new insights on video motion smoothness as an important factor that affects video quality across different frame rates. Our evaluations of the proposed motion smoothness metric using the subject-rated databases show that this novel measure provides a new means to capture the impact of frame rate on video quality, and demonstrates strong promise at improving the performance of objective video quality assessment models. We also propose the notions of perceptual temporal aliasing factor and perceptual spatiotemporal aliasing factor to incorporate the characteristics of human visual contrast sensitivity variations into the framework of spatial and temporal aliasing analysis. We incorporate the proposed aliasing factors into the VQA process to predict the quality of video under frame rate change, resolution change, and lossy compression. Our performance evaluation using the subjective database shows that the proposed perceptual aliasing factors are strong quality predictors across-frame rate, resolution, and data rate, significantly outperforming baseline VQA methods without aliasing modeling