1,601 research outputs found
JPEG Quantized Coefficient Recovery via DCT Domain Spatial-Frequential Transformer
JPEG compression adopts the quantization of Discrete Cosine Transform (DCT)
coefficients for effective bit-rate reduction, whilst the quantization could
lead to a significant loss of important image details. Recovering compressed
JPEG images in the frequency domain has attracted more and more attention
recently, in addition to numerous restoration approaches developed in the pixel
domain. However, the current DCT domain methods typically suffer from limited
effectiveness in handling a wide range of compression quality factors, or fall
short in recovering sparse quantized coefficients and the components across
different colorspace. To address these challenges, we propose a DCT domain
spatial-frequential Transformer, named as DCTransformer. Specifically, a
dual-branch architecture is designed to capture both spatial and frequential
correlations within the collocated DCT coefficients. Moreover, we incorporate
the operation of quantization matrix embedding, which effectively allows our
single model to handle a wide range of quality factors, and a
luminance-chrominance alignment head that produces a unified feature map to
align different-sized luminance and chrominance components. Our proposed
DCTransformer outperforms the current state-of-the-art JPEG artifact removal
techniques, as demonstrated by our extensive experiments.Comment: 13 pages, 8 figure
Non-blind Image Restoration Based on Convolutional Neural Network
Blind image restoration processors based on convolutional neural network
(CNN) are intensively researched because of their high performance. However,
they are too sensitive to the perturbation of the degradation model. They
easily fail to restore the image whose degradation model is slightly different
from the trained degradation model. In this paper, we propose a non-blind
CNN-based image restoration processor, aiming to be robust against a
perturbation of the degradation model compared to the blind restoration
processor. Experimental comparisons demonstrate that the proposed non-blind
CNN-based image restoration processor can robustly restore images compared to
existing blind CNN-based image restoration processors.Comment: Accepted by IEEE 7th Global Conference on Consumer Electronics, 201
Learning Parallax Transformer Network for Stereo Image JPEG Artifacts Removal
Under stereo settings, the performance of image JPEG artifacts removal can be
further improved by exploiting the additional information provided by a second
view. However, incorporating this information for stereo image JPEG artifacts
removal is a huge challenge, since the existing compression artifacts make
pixel-level view alignment difficult. In this paper, we propose a novel
parallax transformer network (PTNet) to integrate the information from stereo
image pairs for stereo image JPEG artifacts removal. Specifically, a
well-designed symmetric bi-directional parallax transformer module is proposed
to match features with similar textures between different views instead of
pixel-level view alignment. Due to the issues of occlusions and boundaries, a
confidence-based cross-view fusion module is proposed to achieve better feature
fusion for both views, where the cross-view features are weighted with
confidence maps. Especially, we adopt a coarse-to-fine design for the
cross-view interaction, leading to better performance. Comprehensive
experimental results demonstrate that our PTNet can effectively remove
compression artifacts and achieves superior performance than other testing
state-of-the-art methods.Comment: 11 pages, 12 figures, ACM MM202
- …