Data-Dependent Pre- and Postprocessing Multiple Description Coding of Images

Abstract—Multiple description coding can be implemented as pre- and postprocessing to all standards for image and video communications, with obvious advantages. This can be achieved by generating two subsets from the original data; a controllable amount of extra redundancy between the descriptions has to be inserted to help the estimation of the possibly lost description from the received one. This redundancy can be in the form of spatial oversampling. In this paper, we propose and develop a mathematical framework for two descriptions pre- and postprocessing methods, which exploit the correlation characteristics of the visual data in order to better implement the multiple description coding paradigm. Simulation results show a noticeable performance improvement of both the proposed methods with respect to state-of-the art algorithms, in terms of both rate/redundancy/distortion tradeoff and computational complexity. Index Terms—H.264, image coding, JPEG2000, multiple description coding (MDC). I

Multi-scale edge-guided image gap restoration

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University London.The focus of this research work is the estimation of gaps (missing blocks) in digital images. To progress the research two main issues were identified as (1) the appropriate domains for image gap restoration and (2) the methodologies for gap interpolation. Multi-scale transforms provide an appropriate framework for gap restoration. The main advantages are transformations into a set of frequency and scales and the ability to progressively reduce the size of the gap to one sample wide at the transform apex. Two types of multi-scale transform were considered for comparative evaluation; 2-dimensional (2D) discrete cosines (DCT) pyramid and 2D discrete wavelets (DWT). For image gap estimation, a family of conventional weighted interpolators and directional edge-guided interpolators are developed and evaluated. Two types of edges were considered; ‘local’ edges or textures and ‘global’ edges such as the boundaries between objects or within/across patterns in the image. For local edge, or texture, modelling a number of methods were explored which aim to reconstruct a set of gradients across the restored gap as those computed from the known neighbourhood. These differential gradients are estimated along the geometrical vertical, horizontal and cross directions for each pixel of the gap. The edge-guided interpolators aim to operate on distinct regions confined within edge lines. For global edge-guided interpolation, two main methods explored are Sobel and Canny detectors. The latter provides improved edge detection. The combination and integration of different multi-scale domains, local edge interpolators, global edge-guided interpolators and iterative estimation of edges provided a variety of configurations that were comparatively explored and evaluated. For evaluation a set of images commonly used in the literature work were employed together with simulated regular and random image gaps at a variety of loss rate. The performance measures used are the peak signal to noise ratio (PSNR) and structure similarity index (SSIM). The results obtained are better than the state of the art reported in the literature