Clustered-dot periodic halftone screen design and ICC profile color table compression

This dissertation studies image quality problems associated with rendering images in devices like printing or displaying. It mainly includes two parts: clustered-dot periodic halftone screen design, and color table compression. Screening is a widely used halftoning method. As a consequence of the lower resolution of digital presses and printers, the number of printer-addressable dots or holes in each microcell may be too few to provide the requisite number of tone lev- els between paper white and full colorant coverage. To address this limitation, the microcells can be grouped into supercells. The challenge is then to determine the desired supercell shape and the order in which dots are added to the microcell. Using DBS to determine this order results in a very homogeneous halftone pattern. To simplify the design and implementation of supercell halftone screens, it is common to repeat the supercell to yield a periodically repeating rectangular block called the basic screen block (BSB). While applying DBS to design a dot-cluster growth order- ing for the entire BSB is simpler to implement than is the application of DBS to the single non-rectangular supercell, it is computationally very inefficient. To achieve a more efficient way to apply DBS to determine the microcell sequence, we describe a procedure for design of high-quality regular screens using the non-rectangular super- cell. A novel concept the Elementary Periodicity Set is proposed to characterize how a supercell is developed. After a supercell is set, we use DBS to determine the micro-cell sequence within the supercell. We derive the DBS equations for this situation, and show that it is more efficient to implement. Then, we mainly focus on the regular and irregular screen design. With digital printing systems, the achievable screen angles and frequencies are limited by the finite addressability of the marking engine. In order for such screens to generate dot clusters in which each cluster is identical, the elements of the periodicity matrix must be integer-valued, when expressed in units of printer-addressable pixels. Good approximation of the screen sets result in better printing quality. So to achieve a better approximation to the screen sets used for commercial offset printing, irregular screens can be used. With an irregular screen, the elements of the periodicity matrix are rational numbers. In this section, first we propose a procedure to generate regular screens starting from midtone level. And then we describe a procedure for design of high-quality irregular screens based on the regular screen design method. We then propose an algorithm to determine how to add dots from midtone to shadow and how to remove dots from midtone to highlight. We present experimental results illustrating the quality of the halftones resulting from our design procedure by comparing images halftoned with irregular screens using our approach and a template-based approach. We also present the evaluation of the smoothness and improvement of the proposed methods. In the next part, we study another quality problem: ICC profile color table compression. ICC profiles are widely used to provide transformations between different color spaces in different devices. The color look-up tables (CLUTs) in the profiles will increase the file sizes when embedded in color documents. In this chapter, we discuss compression methods that decrease the storage cost of the CLUTs. For DCT compression method, a compressed color table includes quantized DCT coefficients for the color table, the additional nodes with large color difference, and the coefficients bit assignment table. For wavelet-based compression method, a compressed color table includes output of the wavelet encoding method, and the additional nodes with large color difference. These methods support lossy table compression to minimize the network traffic and delay, and also achieves relatively small maximum color difference

Efficient Halftoning via Deep Reinforcement Learning

Halftoning aims to reproduce a continuous-tone image with pixels whose intensities are constrained to two discrete levels. This technique has been deployed on every printer, and the majority of them adopt fast methods (e.g., ordered dithering, error diffusion) that fail to render structural details, which determine halftone's quality. Other prior methods of pursuing visual pleasure by searching for the optimal halftone solution, on the contrary, suffer from their high computational cost. In this paper, we propose a fast and structure-aware halftoning method via a data-driven approach. Specifically, we formulate halftoning as a reinforcement learning problem, in which each binary pixel's value is regarded as an action chosen by a virtual agent with a shared fully convolutional neural network (CNN) policy. In the offline phase, an effective gradient estimator is utilized to train the agents in producing high-quality halftones in one action step. Then, halftones can be generated online by one fast CNN inference. Besides, we propose a novel anisotropy suppressing loss function, which brings the desirable blue-noise property. Finally, we find that optimizing SSIM could result in holes in flat areas, which can be avoided by weighting the metric with the contone's contrast map. Experiments show that our framework can effectively train a light-weight CNN, which is 15x faster than previous structure-aware methods, to generate blue-noise halftones with satisfactory visual quality. We also present a prototype of deep multitoning to demonstrate the extensibility of our method

Studies on Imaging System and Machine Learning: 3D Halftoning and Human Facial Landmark Localization

In this dissertation, studies on digital halftoning and human facial landmark localization will be discussed. 3D printing is becoming increasingly popular around the world today. By utilizing 3D printing technology, customized products can be manufactured much more quickly and efficiently with much less cost. However, 3D printing still suffers from low-quality surface reproduction compared with 2D printing. One approach to improve it is to develop an advanced halftoning algorithm for 3D printing. In this presentation, we will describe a novel method to 3D halftoning that can cooperate with 3D printing technology in order to generate a high-quality surface reproduction. In the second part of this report, a new method named direct element swap to create a threshold matrix for halftoning is proposed. This method directly swaps the elements in a threshold matrix to find the best element arrangement by minimizing a designated perceived error metric. Through experimental results, the new method yields halftone quality that is competitive with the conventional level-by-level matrix design method. Besides, by using direct element swap method, for the first time, threshold matrix can be designed through being trained with real images. In the second part of the dissertation, a novel facial landmark detection system is presented. Facial landmark detection plays a critical role in many face analysis tasks. However, it still remains a very challenging problem. The challenges come from the large variations of face appearance caused by different illuminations, different facial expressions, different yaw, pitch and roll angles of heads and different image qualities. To tackle this problem, a novel coarse-to-fine cascaded convolutional neural network system for robust facial landmark detection of faces in the wild is presented. The experiment result shows our method outperforms other state-of-the-art methods on public test datasets. Besides, a frontal and profile landmark localization system is proposed and designed. By using a frontal/profile face classifier, either frontal landmark configuration or profile landmark configuration is employed in the facial landmark prediction based on the input face yaw angle

Minimization of Halftone Noise in FLAT Regions for Improved Print Quality

The work in this thesis proposes a novel algorithm for enhancing the quality of flat regions in printed color image documents. The algorithm is designed to identify the flat regions based on certain criteria and filter these regions to minimize the noise prior and post Halftoning so as to make the hard copy look visibly pleasing. Noise prior to halftone process is removed using a spatial Gaussian filter together with a Hamming window, concluded from results after implementing various filtering techniques. A clustered dithering is applied in each channel of the image as Halftoning process. Furthermore, to minimize the post halftone noise, the halftone structure of the image is manipulated according to the neighboring sub-cells in their respective channels. This is done to reduce the brightness variation (a cause for noise) between the neighboring subcells. Experimental results show that the proposed algorithm efficiently minimizes noise in flat regions of mirumal gradient change in color images

Black-box printer models and their applications

In the electrophotographic printing process, the deposition of toner within the area of a given printer addressable pixel is strongly influenced by the values of its neighboring pixels. The interaction between neighboring pixels, which is commonly referred to as dot-gain, is complicated. The printer models which are developed according to a pre-designed test page can either be embedded in the halftoning algorithm, or used to predict the printed halftone image at the input to an algorithm being used to assess print quality. In our research, we examine the potential influence of a larger neighborhood (45?45) of the digital halftone image on the measured value of a printed pixel at the center of that neighborhood by introducing a feasible strategy for the contribution. We developed a series of six models with different accuracy and computational complexity to account for local neighborhood effects and the influence of a 45?45 neighborhood of pixels on the central printer-addressable pixel tone development. All these models are referred to as Black Box Model (BBM) since they are based solely on measuring what is on the printed page, and do not incorporate any information about the marking process itself. We developed two different types of printer models Standard Definition (SD) BBM and High Definition (HD) BBM with capture device Epson Expression 10000XL (Epson America, Inc., Long Beach, CA, USA) flatbed scanner operated at 2400 dpi under different analysis resolutions. The experiment results show that the larger neighborhood models yield a significant improvement in the accuracy of the prediction of the pixel values of the printed halftone image. The sample function generation black box model (SFG-BBM) is an extension of SD-BBM that adds the printing variation to the mean prediction to improve the prediction by more accurately matching the characteristics of the actual printed image. We also followed a structure similar to that used to develop our series of BBMs to develop a two-stage toner usage predictor for electrophotographic printers. We first obtained on a pixel-by-pixel basis, the predicted absorptance of printed and scanned page with the digital input using BBM. We then form a weighted sum of these predicted pixel values to predict overall toner usage on the printed page. Our two-stage predictor significantly outperforms existing method that is based on a simple pixel counting strategy, in terms of both accuracy and robustness of the prediction

A New framework for an electrophotographic printer model

Digital halftoning is a printing technology that creates the illusion of continuous tone images for printing devices such as electrophotographic printers that can only produce a limited number of tone levels. Digital halftoning works because the human visual system has limited spatial resolution which blurs the printed dots of the halftone image, creating the gray sensation of a continuous tone image. Because the printing process is imperfect it introduces distortions to the halftone image. The quality of the printed image depends, among other factors, on the complex interactions between the halftone image, the printer characteristics, the colorant, and the printing substrate. Printer models are used to assist in the development of new types of halftone algorithms that are designed to withstand the effects of printer distortions. For example, model-based halftone algorithms optimize the halftone image through an iterative process that integrates a printer model within the algorithm. The two main goals of a printer model are to provide accurate estimates of the tone and of the spatial characteristics of the printed halftone pattern. Various classes of printer models, from simple tone calibrations, to complex mechanistic models, have been reported in the literature. Existing models have one or more of the following limiting factors: they only predict tone reproduction, they depend on the halftone pattern, they require complex calibrations or complex calculations, they are printer specific, they reproduce unrealistic dot structures, and they are unable to adapt responses to new data. The two research objectives of this dissertation are (1) to introduce a new framework for printer modeling and (2) to demonstrate the feasibility of such a framework in building an electrophotographic printer model. The proposed framework introduces the concept of modeling a printer as a texture transformation machine. The basic premise is that modeling the texture differences between the output printed images and the input images encompasses all printing distortions. The feasibility of the framework was tested with a case study modeling a monotone electrophotographic printer. The printer model was implemented as a bank of feed-forward neural networks, each one specialized in modeling a group of textural features of the printed halftone pattern. The textural features were obtained using a parametric representation of texture developed from a multiresolution decomposition proposed by other researchers. The textural properties of halftone patterns were analyzed and the key texture parameters to be modeled by the bank were identified. Guidelines for the multiresolution texture decomposition and the model operational parameters and operational limits were established. A method for the selection of training sets based on the morphological properties of the halftone patterns was also developed. The model is fast and has the capability to continue to learn with additional training. The model can be easily implemented because it only requires a calibrated scanner. The model was tested with halftone patterns representing a range of spatial characteristics found in halftoning. Results show that the model provides accurate predictions for the tone and the spatial characteristics when modeling halftone patterns individually and it provides close approximations when modeling multiple halftone patterns simultaneously. The success of the model justifies continued research of this new printer model framework

Modeling and Halftoning for Multichannel Printers: A Spectral Approach

Printing has been has been the major communication medium for many centuries. In the last twenty years, multichannel printing has brought new opportunities and challenges. Beside of extended colour gamut of the multichannel printer, the opportunity was presented to use a multichannel printer for ‘spectral printing’. The aim of spectral printing is typically the same as for colour printing; that is, to match input signal with printing specific ink combinations. In order to control printers so that the combination or mixture of inks results in specific colour or spectra requires a spectral reflectance printer model that estimates reflectance spectra from nominal dot coverage. The printer models have one of the key roles in accurate communication of colour to the printed media. Accordingly, this has been one of the most active research areas in printing. The research direction was toward improvement of the model accuracy, model simplicity and toward minimal resources used by the model in terms of computational power and usage of material. The contribution of the work included in the thesis is also directed toward improvement of the printer models but for the multichannel printing. The thesis is focused primarily on improving existing spectral printer models and developing a new model. In addition, the aim was to develop and implement a multichannel halftoning method which should provide with high image quality. Therefore, the research goals of the thesis were: maximal accuracy of printer models, optimal resource usage and maximal image quality of halftoning and whole spectral reproduction system. Maximal colour accuracy of a model but with the least resources used is achieved by optimizing printer model calibration process. First, estimation of the physical and optical dot gain is performed with newly proposed method and model. Second, a custom training target is estimated using the proposed new method. These two proposed methods and one proposed model were at the same time the means of optimal resource usage, both in computational time and material. The third goal was satisfied with newly proposed halftoning method for multichannel printing. This method also satisfies the goal of optimal computational time but with maintaining high image quality. When applied in spectral reproduction workflow, this halftoning reduces noise induced in an inversion of the printer model. Finally, a case study was conducted on the practical use of multichannel printers and spectral reproduction workflow. In addition to a gamut comparison in colour space, it is shown that otherwise limited reach of spectral printing could potentially be used to simulate spectra and colour of textile fabrics

Hardware-accelerated algorithms in visual computing

This thesis presents new parallel algorithms which accelerate computer vision methods by the use of graphics processors (GPUs) and evaluates them with respect to their speed, scalability, and the quality of their results. It covers the fields of homogeneous and anisotropic diffusion processes, diffusion image inpainting, optic flow, and halftoning. In this turn, it compares different solvers for homogeneous diffusion and presents a novel \u27extended\u27 box filter. Moreover, it suggests to use the fast explicit diffusion scheme (FED) as an efficient and flexible solver for nonlinear and in particular for anisotropic parabolic diffusion problems on graphics hardware. For elliptic diffusion-like processes, it recommends to use cascadic FED or Fast Jacobi schemes. The presented optic flow algorithm represents one of the fastest yet very accurate techniques. Finally, it presents a novel halftoning scheme which yields state-of-the-art results for many applications in image processing and computer graphics.Diese Arbeit präsentiert neue parallele Algorithmen zur Beschleunigung von Methoden in der Bildinformatik mittels Grafikprozessoren (GPUs), und evaluiert diese im Hinblick auf Geschwindigkeit, Skalierungsverhalten, und Qualität der Resultate. Sie behandelt dabei die Gebiete der homogenen und anisotropen Diffusionsprozesse, Inpainting (Bildvervollständigung) mittels Diffusion, die Bestimmung des optischen Flusses, sowie Halbtonverfahren. Dabei werden verschiedene Löser für homogene Diffusion verglichen und ein neuer \u27erweiterter\u27 Mittelwertfilter präsentiert. Ferner wird vorgeschlagen, das schnelle explizite Diffusionsschema (FED) als effizienten und flexiblen Löser für parabolische nichtlineare und speziell anisotrope Diffusionsprozesse auf Grafikprozessoren einzusetzen. Für elliptische diffusionsartige Prozesse wird hingegen empfohlen, kaskadierte FED- oder schnelle Jacobi-Verfahren einzusetzen. Der vorgestellte Algorithmus zur Berechnung des optischen Flusses stellt eines der schnellsten und dennoch äußerst genauen Verfahren dar. Schließlich wird ein neues Halbtonverfahren präsentiert, das in vielen Bereichen der Bildverarbeitung und Computergrafik Ergebnisse produziert, die den Stand der Technik repräsentieren

Visuelle Analyse großer Partikeldaten

Partikelsimulationen sind eine bewährte und weit verbreitete numerische Methode in der Forschung und Technik. Beispielsweise werden Partikelsimulationen zur Erforschung der Kraftstoffzerstäubung in Flugzeugturbinen eingesetzt. Auch die Entstehung des Universums wird durch die Simulation von dunkler Materiepartikeln untersucht. Die hierbei produzierten Datenmengen sind immens. So enthalten aktuelle Simulationen Billionen von Partikeln, die sich über die Zeit bewegen und miteinander interagieren. Die Visualisierung bietet ein großes Potenzial zur Exploration, Validation und Analyse wissenschaftlicher Datensätze sowie der zugrundeliegenden Modelle. Allerdings liegt der Fokus meist auf strukturierten Daten mit einer regulären Topologie. Im Gegensatz hierzu bewegen sich Partikel frei durch Raum und Zeit. Diese Betrachtungsweise ist aus der Physik als das lagrange Bezugssystem bekannt. Zwar können Partikel aus dem lagrangen in ein reguläres eulersches Bezugssystem, wie beispielsweise in ein uniformes Gitter, konvertiert werden. Dies ist bei einer großen Menge an Partikeln jedoch mit einem erheblichen Aufwand verbunden. Darüber hinaus führt diese Konversion meist zu einem Verlust der Präzision bei gleichzeitig erhöhtem Speicherverbrauch. Im Rahmen dieser Dissertation werde ich neue Visualisierungstechniken erforschen, welche speziell auf der lagrangen Sichtweise basieren. Diese ermöglichen eine effiziente und effektive visuelle Analyse großer Partikeldaten