Technical Report on Visual Quality Assessment for Frame Interpolation

Current benchmarks for optical flow algorithms evaluate the estimation quality by comparing their predicted flow field with the ground truth, and additionally may compare interpolated frames, based on these predictions, with the correct frames from the actual image sequences. For the latter comparisons, objective measures such as mean square errors are applied. However, for applications like image interpolation, the expected user's quality of experience cannot be fully deduced from such simple quality measures. Therefore, we conducted a subjective quality assessment study by crowdsourcing for the interpolated images provided in one of the optical flow benchmarks, the Middlebury benchmark. We used paired comparisons with forced choice and reconstructed absolute quality scale values according to Thurstone's model using the classical least squares method. The results give rise to a re-ranking of 141 participating algorithms w.r.t. visual quality of interpolated frames mostly based on optical flow estimation. Our re-ranking result shows the necessity of visual quality assessment as another evaluation metric for optical flow and frame interpolation benchmarks.Comment: 11 pages, 6 figure

Context-aware Synthesis for Video Frame Interpolation

Video frame interpolation algorithms typically estimate optical flow or its variations and then use it to guide the synthesis of an intermediate frame between two consecutive original frames. To handle challenges like occlusion, bidirectional flow between the two input frames is often estimated and used to warp and blend the input frames. However, how to effectively blend the two warped frames still remains a challenging problem. This paper presents a context-aware synthesis approach that warps not only the input frames but also their pixel-wise contextual information and uses them to interpolate a high-quality intermediate frame. Specifically, we first use a pre-trained neural network to extract per-pixel contextual information for input frames. We then employ a state-of-the-art optical flow algorithm to estimate bidirectional flow between them and pre-warp both input frames and their context maps. Finally, unlike common approaches that blend the pre-warped frames, our method feeds them and their context maps to a video frame synthesis neural network to produce the interpolated frame in a context-aware fashion. Our neural network is fully convolutional and is trained end to end. Our experiments show that our method can handle challenging scenarios such as occlusion and large motion and outperforms representative state-of-the-art approaches.Comment: CVPR 2018, http://graphics.cs.pdx.edu/project/ctxsy

Guidance for benthic habitat mapping: an aerial photographic approach

This document, Guidance for Benthic Habitat Mapping: An Aerial Photographic Approach, describes proven technology that can be applied in an operational manner by state-level scientists and resource managers. This information is based on the experience gained by NOAA Coastal Services Center staff and state-level cooperators in the production of a series of benthic habitat data sets in Delaware, Florida, Maine, Massachusetts, New York, Rhode Island, the Virgin Islands, and Washington, as well as during Center-sponsored workshops on coral remote sensing and seagrass and aquatic habitat assessment. (PDF contains 39 pages) The original benthic habitat document, NOAA Coastal Change Analysis Program (C-CAP): Guidance for Regional Implementation (Dobson et al.), was published by the Department of Commerce in 1995. That document summarized procedures that were to be used by scientists throughout the United States to develop consistent and reliable coastal land cover and benthic habitat information. Advances in technology and new methodologies for generating these data created the need for this updated report, which builds upon the foundation of its predecessor

Cost effectiveness of photodynamic therapy with verteporfin for age related macular degeneration: the UK case

AIM: To estimate the potential cost effectiveness of photodynamic therapy (PDT) with verteporfin in the UK setting. METHODS: Using data from a variety of sources a Markov model was built to produce estimates of the cost effectiveness (incremental cost per quality adjusted life year (QALY) and incremental cost per vision year gained) of PDT for two cohorts of patients (one with starting visual acuity (VA) of 20/40 and one at 20/100) with predominantly classic choroidal neovascular disease over a 2 year and 5 year time horizon. A government perspective and a treatment cost only perspective were considered. Probabilistic and one way sensitivity analyses were undertaken. RESULTS: From the government perspective, over the 2 year period, the expected incremental cost effectiveness ratios range from £286 000 (starting VA 20/100) to £76 000 (starting VA 20/40) per QALY gained and from £14 000 (20/100) to £34 000 (20/40) per vision year gained. A 5 year perspective yields incremental ratios less than £5000 for vision years gained and from £9000 (20/40) to £30 000 (20/100) for QALYs gained. Without societal or NHS cost offsets included, the 2 year incremental cost per vision year gained ranges from £20 000 (20/100) to £40 000 (20/40), and the 2 year incremental cost per QALY gained ranges from £412 000 (20/100) to £90 000 (20/40). The 5 year time frame shows expected costs of £7000 (20/40) to £10 000 (20/100) per vision year gained and from £38 000 (20/40) to £69 000 (20/100) per QALY gained. CONCLUSION: This evaluation suggests that early treatment (that is, treating eyes at less severe stages of disease) with PDT leads to increased efficiency. When considering only the cost of therapy, treating people at lower levels of visual acuity would probably not be considered cost effective. However, a broad perspective that incorporates other NHS treatment costs and social care costs suggests that over a long period of time, PDT may yield reasonable value for money

A novel method for subjective picture quality assessment and further studies of HDTV formats

This is the author's accepted manuscript. The final published article is available from the link below. Copyright @ IEEE 2008.This paper proposes a novel method for the assessment of picture quality, called triple stimulus continuous evaluation scale (TSCES), to allow the direct comparison of different HDTV formats. The method uses an upper picture quality anchor and a lower picture quality anchor with defined impairments. The HDTV format under test is evaluated in a subjective comparison with the upper and lower anchors. The method utilizes three displays in a particular vertical arrangement. In an initial series of tests with the novel method, the HDTV formats 1080p/50,1080i/25, and 720p/50 were compared at various bit-rates and with seven different content types on three identical 1920 times 1080 pixel displays. It was found that the new method provided stable and consistent results. The method was tested with 1080p/50,1080i/25, and 720p/50 HDTV images that had been coded with H.264/AVC High profile. The result of the assessment was that the progressive HDTV formats found higher appreciation by the assessors than the interlaced HDTV format. A system chain proposal is given for future media production and delivery to take advantage of this outcome. Recommendations for future research conclude the paper

Surface reconstruction of wear in carpets by using a wavelet edge detector

Carpet manufacturers have wear labels assigned to their products by human experts who evaluate carpet samples subjected to accelerated wear in a test device. There is considerable industrial and academic interest in going from human to automated evaluation, which should be less cumbersome and more objective. In this paper, we present image analysis research on videos of carpet surfaces scanned with a 3D laser. The purpose is obtaining good depth Images for an automated system that should have a high percentage of correct assessments for a wide variety of carpets. The innovation is the use of a wavelet edge detector to obtain a more continuously defined surface shape. The evaluation is based on how well the algorithms allow a good linear ranking and a good discriminance of consecutive wear labels. The results show an improved linear ranking for most carpet types, for two carpet types the results are quite significant