Studies on Imaging System and Machine Learning: 3D Halftoning and Human Facial Landmark Localization

In this dissertation, studies on digital halftoning and human facial landmark localization will be discussed. 3D printing is becoming increasingly popular around the world today. By utilizing 3D printing technology, customized products can be manufactured much more quickly and efficiently with much less cost. However, 3D printing still suffers from low-quality surface reproduction compared with 2D printing. One approach to improve it is to develop an advanced halftoning algorithm for 3D printing. In this presentation, we will describe a novel method to 3D halftoning that can cooperate with 3D printing technology in order to generate a high-quality surface reproduction. In the second part of this report, a new method named direct element swap to create a threshold matrix for halftoning is proposed. This method directly swaps the elements in a threshold matrix to find the best element arrangement by minimizing a designated perceived error metric. Through experimental results, the new method yields halftone quality that is competitive with the conventional level-by-level matrix design method. Besides, by using direct element swap method, for the first time, threshold matrix can be designed through being trained with real images. In the second part of the dissertation, a novel facial landmark detection system is presented. Facial landmark detection plays a critical role in many face analysis tasks. However, it still remains a very challenging problem. The challenges come from the large variations of face appearance caused by different illuminations, different facial expressions, different yaw, pitch and roll angles of heads and different image qualities. To tackle this problem, a novel coarse-to-fine cascaded convolutional neural network system for robust facial landmark detection of faces in the wild is presented. The experiment result shows our method outperforms other state-of-the-art methods on public test datasets. Besides, a frontal and profile landmark localization system is proposed and designed. By using a frontal/profile face classifier, either frontal landmark configuration or profile landmark configuration is employed in the facial landmark prediction based on the input face yaw angle

The development of multi-channel inkjet printing methodologies for fine art applications

This thesis contributes to the defence of the practitioner perspective as a means of undertaking problems addressed predominantly in the field of colour science. Whilst artists have been exploring the use of colour for centuries through their personal practice and education, the rise of industrialised printing processes has generated a shift in focus away from these creative pursuits and into the computational field of colour research. It is argued here that the disposition and knowledge generated by creative practice has significant value to offer developing technologies. While creative practice has limited influence in the development of colour printing, practitioners and users of technology actively engage with the process in ways that extend beyond its intended uses in order to overcome recognised shortcomings. Here consideration is given to this creative engagement as motivation to develop bespoke printing parameters that demonstrate the effects of colour mixing through methods alternative to standard workflows. The research is undertaken incorporating both qualitative and quantitative analysis, collecting data from visual assessments and by examining spectral measurements taken from printed output. Action research is employed to directly access and act upon the constant developments in the art and science disciplines related to inkjet printing, observing and engaging with current methods and techniques employed by practitioners and developers. This method of research has strongly informed the empirical testing that has formed this thesis’s contribution to fine art inkjet printing practice. The research follows a practitioner led approach to designing and testing alternative printing methods and is aimed at expanding the number of discernible colours an inkjet printer can reproduce. The application of this methodology is evidenced through demonstrative prints and a reproduction study undertaken at the National Gallery, London. The experimentation undertaken in partnership with the National Gallery has proven the ability to increase accuracy between colour measured from the original target and reproduction, beyond the capabilities of current inkjet printing workflows

N-colour separation methods for accurate reproduction of spot colours

In packaging, spot colours are used to print key information like brand logos and elements for which the colour accuracy is critical. The present study investigates methods to aid the accurate reproduction of these spot colours with the n-colour printing process. Typical n-colour printing systems consist of supplementary inks in addition to the usual CMYK inks. Adding these inks to the traditional CMYK set increases the attainable colour gamut, but the added complexity creates several challenges in generating suitable colour separations for rendering colour images. In this project, the n-colour separation is achieved by the use of additional sectors for intermediate inks. Each sector contains four inks with the achromatic ink (black) common to all sectors. This allows the extension of the principles of the CMYK printing process to these additional sectors. The methods developed in this study can be generalised to any number of inks. The project explores various aspects of the n-colour printing process including the forward characterisation methods, gamut prediction of the n-colour process and the inverse characterisation to calculate the n-colour separation for target spot colours. The scope of the study covers different printing technologies including lithographic offset, flexographic, thermal sublimation and inkjet printing. A new method is proposed to characterise the printing devices. This method, the spot colour overprint (SCOP) model, was evaluated for the n-colour printing process with different printing technologies. In addition, a set of real-world spot colours were converted to n-colour separations and printed with the 7-colour printing process to evaluate against the original spot colours. The results show that the proposed methods can be effectively used to replace the spot coloured inks with the n-colour printing process. This can save significant material, time and costs in the packaging industry

The development of methods for the reproduction in continuous tone of digitally printed colour artworks

Advances in printing technologies in the late 19th century led to the development of half-toning techniques enabling the economical reproduction of photographic images in print. Whilst undoubtedly successful in low cost high volume image reproduction, half-toning representations are less faithful in detail when compared to continuous tone photomechanical methods in use at that time. This thesis asks the question: can the creative application of 21st century digital fabrication technologies enable the qualities of continuous tone imaging to be regained? In the 21st-century, printmaking may be seen as the interchange of ideas, experimental practice and interdisciplinary thinking. Printmaking has always been a means of combining modern technology and methods with existing traditional and commercial imaging processes. Technological advancement in print however does not always provide a finer quality of print. Qualities often attributed to pre-digital continuous tone printing can be lost in the transition to a digital half tone print workflow. This research project examines a near obsolete 19th century print process, the continuous tone Woodburytype, developed to address the issue of permanence in photography. Through a methodological approach analyses of the Woodburytype an empirical reconstruction of the process provides a comprehensive critique of its method. The Woodburytype’s surface qualities are not found in other photomechanical printing methods capable of rendering finely detailed photographic images. Its method of image translation results in the printed tonal range being directly proportional to the deposition thickness of the printing ink, however it never successfully developed into a colour process. By examining and evaluating digital imaging technology this study identifies, current computer aided design and manufacturing techniques and extends upon known models of Woodburytype printing through the development of this deposition height quality enabling a new digital polychromatic colour printing process

Adaptive Methods for Robust Document Image Understanding

A vast amount of digital document material is continuously being produced as part of major digitization efforts around the world. In this context, generic and efficient automatic solutions for document image understanding represent a stringent necessity. We propose a generic framework for document image understanding systems, usable for practically any document types available in digital form. Following the introduced workflow, we shift our attention to each of the following processing stages in turn: quality assurance, image enhancement, color reduction and binarization, skew and orientation detection, page segmentation and logical layout analysis. We review the state of the art in each area, identify current defficiencies, point out promising directions and give specific guidelines for future investigation. We address some of the identified issues by means of novel algorithmic solutions putting special focus on generality, computational efficiency and the exploitation of all available sources of information. More specifically, we introduce the following original methods: a fully automatic detection of color reference targets in digitized material, accurate foreground extraction from color historical documents, font enhancement for hot metal typesetted prints, a theoretically optimal solution for the document binarization problem from both computational complexity- and threshold selection point of view, a layout-independent skew and orientation detection, a robust and versatile page segmentation method, a semi-automatic front page detection algorithm and a complete framework for article segmentation in periodical publications. The proposed methods are experimentally evaluated on large datasets consisting of real-life heterogeneous document scans. The obtained results show that a document understanding system combining these modules is able to robustly process a wide variety of documents with good overall accuracy

Towards Better Methods of Stereoscopic 3D Media Adjustment and Stylization

Stereoscopic 3D (S3D) media is pervasive in film, photography and art. However, working with S3D media poses a number of interesting challenges arising from capture and editing. In this thesis we address several of these challenges. In particular, we address disparity adjustment and present a layer-based method that can reduce disparity without distorting the scene. Our method was successfully used to repair several images for the 2014 documentary “Soldiers’ Stories” directed by Jonathan Kitzen. We then explore consistent and comfortable methods for stylizing stereo images. Our approach uses a modified version of the layer-based technique used for disparity adjustment and can be used with a variety of stylization filters, including those in Adobe Photoshop. We also present a disparity-aware painterly rendering algorithm. A user study concluded that our layer-based stylization method produced S3D images that were more comfortable than previous methods. Finally, we address S3D line drawing from S3D photographs. Line drawing is a common art style that our layer-based method is not able to reproduce. To improve the depth perception of our line drawings we optionally add stylized shading. An expert survey concluded that our results were comfortable and reproduced a sense of depth

Colour coded

This 300 word publication to be published by the Society of Dyers and Colourists (SDC) is a collection of the best papers from a 4-year European project that has considered colour from the perspective of both the arts and sciences.The notion of art and science and the crossovers between the two resulted in application and funding for cross disciplinary research to host a series of training events between 2006 and 2010 Marie Curie Conferences & Training Courses (SCF) Call Identifier: FP6-Mobility-4, Euros 532,363.80 CREATE – Colour Research for European Advanced Technology Employment. The research crossovers between the fields of art, science and technology was also a subject that was initiated through Bristol’s Festival if Ideas events in May 2009. The author coordinated and chaired an event during which the C.P Snow lecture “On Two Cultures’ (1959) was re-presented by Actor Simon Cook and then a lecture made by Raymond Tallis on the notion of the Polymath. The CREATE project has a worldwide impact for researchers, academics and scientists. Between January and October 2009, the site has received 221, 414 visits. The most popular route into the site is via the welcome page. The main groups of visitors originate in the UK (including Northern Ireland), Italy, France, Finland, Norway, Hungary, USA, Finland and Spain. A basic percentage breakdown of the traffic over ten months indicates: USA -15%; UK - 16%; Italy - 13%; France -12%; Hungary - 10%; Spain - 6%; Finland - 9%; Norway - 5%. The remaining approximate 14% of visitors are from other countries including Belgium, The Netherlands and Germany (approx 3%). A discussion group has been initiated by the author as part of the CREATE project to facilitate an ongoing dialogue between artists and scientists. http://createcolour.ning.com/group/artandscience www.create.uwe.ac.uk.Related papers to this research: A report on the CREATE Italian event: Colour in cultural heritage.C. Parraman, A. Rizzi, ‘Developing the CREATE network in Europe’, in Colour in Art, Design and Nature, Edinburgh, 24 October 2008.C. Parraman, “Mixing and describing colour”. CREATE (Training event 1), France, 2008