Patch-based structural masking model with an application to compression

The ability of an image region to hide or mask a given target signal continues to play a key role in the design of numerous image processing and vision systems. However, current state-of-the-art models of visual masking have been optimized for artificial targets placed upon unnatural backgrounds. In this paper, we (1) measure the ability of natural-image patches in masking distortion; (2) analyze the performance of a widely accepted standard masking model in predicting these data; and (3) report optimal model parameters for different patch types (textures, structures, and edges). Our results reveal that the standard model of masking does not generalize across image type; rather, a proper model should be coupled with a classification scheme which can adapt the model parameters based on the type of content contained in local image patches. The utility of this adaptive approach is demonstrated via a spatially adaptive compression algorithm which employs patch-based classification. Despite the addition of extra side information and the high degree of spatial adaptivity, this approach yields an efficient wavelet compression strategy that can be combined with very accurate rate-control procedures.Peer reviewedElectrical and Computer Engineerin

The first IEEE workshop on the Future of Research Curation and Research Reproducibility

This report describes perspectives from the Workshop on the Future of Research Curation and Research Reproducibility that was collaboratively sponsored by the U.S. National Science Foundation (NSF) and IEEE (Institute of Electrical and Electronics Engineers) in November 2016. The workshop brought together stakeholders including researchers, funders, and notably, leading science, technology, engineering, and mathematics (STEM) publishers. The overarching objective was a deep dive into new kinds of research products and how the costs of creation and curation of these products can be sustainably borne by the agencies, publishers, and researcher communities that were represented by workshop participants.National Science Foundation Award #164101

Robust Image Transmission using Resynchronizing Variable-Length Codes and Error Concealment

Resynchronizing variable-length codes (RVLCs) for large alphabets are designed by first creating resynchronizing Huffman codes and then adding an extended synchronizing codeword, and the RVLCs are applied to both JPEG and wavelet-based image compression. The RVLCs demonstrate the desired resynchronization properties, both at a symbol level and structurally so that decoded data can be correctly placed within an image following errors. The encoded images, when subject to both structural and statistical error detection and concealment, can tolerate BERs of up to and are very tolerant of burst errors. The RVLC-JPEG images have negligible overhead at visually lossless bit rates, while the RVLC-wavelet overhead can be adjusted based on the desired tolerance to burst errors and typically ranges from 7-18%. The tolerance to both bit and burst errors demonstrates that images coded with such RVLCs can be transmitted over imperfect channels suffering bit errors or packet losses without channel co..

System-level Issues for A Multi-Rate Video VOD System

This document describes system-level issues for incorporation of multi-rate video into a videoon-demand system. The issues are broadly separated into two classes: rate negotiation, involving selection of a rate at which the requested video will be provided, and rate delivery, involving delivery of the coded stream to the user. Requirements of the server, the network, and the set-top box are developed, and are shown to be interrelated for design of an efficient system. Additionally, constraints are imposed on the video coding algorithm. Specific research topics for further investigation are proposed. Current video-on-demand (von) systems in the trial phase are homogeneous- all set-tops are identical, the video is delivered to each set-top via the same physical medium, and each video or program is only coded at one rate. However, heterogeneity exists in the viewing device, as there are many sizes and qualities of televisions, and even computers with NTSC cards can displa

Reconstruction-Optimized Lapped Orthogonal Transforms

Packetized image communication over lossy channels presents a reconstruction problem at the decoder. To date, reconstruction algorithms have been developed for fixed coding techniques. This paper examines the dual problem --- a block-based coding technique, namely a family of lapped orthogonal transforms (LOTs), is designed to maximize the reconstruction performance of a fixed reconstruction algorithm. Mean-reconstruction, in which missing coefficient blocks are replaced with averages of their available neighbors, is selected for simplicity and implementation ease. A reconstruction criterion is defined in terms of mean-squared error, and is used to define the reconstruction gain. A family of LOTs is then designed to consider both reconstruction gain and coding gain. Reconstruction capability and compression are exchanged, and the LOT family consists of transforms that provide increasing reconstruction capability with lower coding gain. A transform can therefore be selected based on ch..