Multiframe Adaptive Wiener Filter Super-Resolution with JPEG2000-Compressed Images

Historically, Joint Photographic Experts Group 2000 (JPEG2000) image compression and multiframe super-resolution (SR) image processing techniques have evolved separately. In this paper, we propose and compare novel processing architectures for applying multiframe SR with JPEG2000 compression. We propose a modified adaptive Wiener filter (AWF) SR method and study its performance as JPEG2000 is incorporated in different ways. In particular, we perform compression prior to SR and compare this to compression after SR. We also compare both independent-frame compression and difference-frame compression approaches. We find that some of the SR artifacts that result from compression can be reduced by decreasing the assumed global signal-to-noise ratio (SNR) for the AWF SR method. We also propose a novel spatially adaptive SNR estimate for the AWF designed to compensate for the spatially varying compression artifacts in the input frames. The experimental results include the use of simulated imagery for quantitative analysis. We also include real-video results for subjective analysis

DRAFT Arbitrarily Shaped Virtual-Object Based Video Compression

Object based compression techniques are widely believed to have the potential to give the best compression results for a given signal quality. However, true object tracking and extraction is difficult and computationally very expensive. Therefore, an arbitrarily shaped virtual-object compression method is developed. The method is similar to the object based compression methods in that it separates the changing portion of the video from the stationary portion, and encodes each independently. The changing portion of the video is grouped as a 3D arbitrarily shaped virtual object whereas the unchanged portion of the video is grouped as background. The arbitrarily shaped virtual object is coded using 3D wavelet compression whereas stationary background is coded as a single frame using 2D wavelet compression. Experimental results demonstrate that the newly developed method outperforms 3D wavelet compression and the rectangular virtual-object compression by achieving higher compression ratio at a higher PSNR. Index Terms Arbitrarily shaped virtual-object, background, shape adaptive wavelet transform, 3D wavelet compression, shape coding, texture coding, multiple virtual-objects, group of frames