Content adaptive screen image scaling

This paper proposes an efficient content adaptive screen image scaling scheme for the real-time screen applications like remote desktop and screen sharing. In the proposed screen scaling scheme, a screen content classification step is first introduced to classify the screen image into text and pictorial regions. Afterward, we propose an adaptive shift linear interpolation algorithm to predict the new pixel values with the shift offset adapted to the content type of each pixel. The shift offset for each screen content type is offline optimized by minimizing the theoretical interpolation error based on the training samples respectively. The proposed content adaptive screen image scaling scheme can achieve good visual quality and also keep the low complexity for real-time applications.Comment: ICIP 201

REAL-TIME SCREEN IMAGE SCALING AND ITS GPU ACCELERATION

In this paper, we propose a simple and effective scheme for screen image scaling, targeting at real-time applications like remote desktop and screen sharing. To balance visual quality and complexity, we build our scheme upon bilinear interpolation and devise a content adaptive post-processing method. Our scheme keeps the text/graphics regions of screen images as sharp as the original while avoiding magnifying noise and artifacts in the picture regions. Further, the involved operations are quite suitable for hardware acceleration. When implemented on commodity GPUs, our scheme achieves a frame rate more than 300 fps, which is fast enough for practical use. Index Terms — Screen image, image scaling, GPU 1