35 research outputs found
Effective Geometric Restoration of Distorted Historical Document for Large-Scale Digitization
Due to storage conditions and materialβs non-planar shape, geometric distortion of the 2-D content is widely present in scanned document images. Effective geometric restoration of these distorted document images considerably increases character recognition rate in large-scale digitisation. For large-scale digitisation of historical books, geometric restoration solutions expect to be accurate, generic, robust, unsupervised and reversible. However, most methods in the literature concentrate on improving restoration accuracy for specific distortion effect, but not their applicability in large-scale digitisation. This paper proposes an effective mesh based geometric restoration system, (GRLSD), for large-scale distorted historical document digitisation. In this system, an automatic mesh generation based dewarping tool is proposed to geometrically model and correct arbitrary warping historical documents. An XML based mesh recorder is proposed to record the mesh of distortion information for reversible use. A graphic user interface toolkit is designed to visually display and manually manipulate the mesh for improving geometric restoration accuracy. Experimental results show that the proposed automatic dewarping approach efficiently corrects arbitrarily warped historical documents, with an improved performance over several state-of-the-art geometric restoration methods. By using XML mesh recorder and GUI toolkit, the GRLSD system greatly aids users to flexibly monitor and correct ambiguous points of mesh for the prevention of damaging historical document images without distortions in large-scale digitalisation
μ λ ¬ νΉμ±λ€ κΈ°λ°μ λ¬Έμ λ° μ₯λ©΄ ν μ€νΈ μμ ννν κΈ°λ²
νμλ
Όλ¬Έ (λ°μ¬)-- μμΈλνκ΅ λνμ 곡과λν μ κΈ°Β·μ»΄ν¨ν°κ³΅νλΆ, 2017. 8. μ‘°λ¨μ΅.μΉ΄λ©λΌλ‘ 촬μν ν
μ€νΈ μμμ λν΄μ, κ΄ν λ¬Έμ μΈμ(OCR)μ 촬μλ μ₯λ©΄μ λΆμνλλ° μμ΄μ λ§€μ° μ€μνλ€. νμ§λ§ μ¬λ°λ₯Έ ν
μ€νΈ μμ κ²μΆ νμλ, 촬μν μμμ λν λ¬Έμ μΈμμ μ¬μ ν μ΄λ €μ΄ λ¬Έμ λ‘ μ¬κ²¨μ§λ€. μ΄λ μ’
μ΄μ ꡬλΆλ¬μ§κ³Ό μΉ΄λ©λΌ μμ μ μν κΈ°ννμ μΈ μ곑 λλ¬Έμ΄κ³ , λ°λΌμ μ΄λ¬ν ν
μ€νΈ μμμ λν νννλ λ¬Έμ μΈμμ μμ΄μ νμμ μΈ μ μ²λ¦¬ κ³Όμ μΌλ‘ μ¬κ²¨μ§λ€. μ΄λ₯Ό μν μ곑λ 촬μ μμμ μ λ©΄ μμ μΌλ‘ 볡μνλ ν
μ€νΈ μμ ννν λ°©λ²λ€μ νλ°ν μ°κ΅¬λμ΄μ§κ³ μλ€. μ΅κ·Όμλ, νννκ° μ λ ν
μ€νΈμ μ±μ§μ μ΄μ μ λ§μΆ μ°κ΅¬λ€μ΄ μ£Όλ‘ μ§νλκ³ μλ€. μ΄λ¬ν κ΄μ μμ, λ³Έ νμ λ
Όλ¬Έμ ν
μ€νΈ μμ νννλ₯Ό μνμ¬ μλ‘μ΄ μ λ ¬ νΉμ±λ€μ λ€λ£¬λ€. μ΄λ¬ν μ λ ¬ νΉμ±λ€μ λΉμ© ν¨μλ‘ μ€κ³λμ΄μ§κ³ , λΉμ© ν¨μλ₯Ό μ΅μννλ λ°©λ²μ ν΅ν΄μ νννμ μ¬μ©λμ΄μ§λ ννν λ³μλ€μ΄ ꡬν΄μ§λ€. λ³Έ νμ λ
Όλ¬Έμ λ¬Έμ μμ ννν, μ₯λ©΄ ν
μ€νΈ ννν, μΌλ° λ°°κ²½ μμ νμ΄μ§ νλ©΄ νννμ κ°μ΄ 3κ°μ§ μΈλΆ μ£Όμ λ‘ λλ μ§λ€.
첫 λ²μ§Έλ‘, λ³Έ νμ λ
Όλ¬Έμ ν
μ€νΈ λΌμΈλ€κ³Ό μ λΆλ€μ μ λ ¬ νΉμ±μ κΈ°λ°μ λ¬Έμ μμ ννν λ°©λ²μ μ μνλ€. κΈ°μ‘΄μ ν
μ€νΈ λΌμΈ κΈ°λ°μ λ¬Έμ μμ ννν λ°©λ²λ€μ κ²½μ°, λ¬Έμκ° λ³΅μ‘ν λ μ΄μμ ννμ΄κ±°λ μ μ μμ ν
μ€νΈ λΌμΈμ ν¬ν¨νκ³ μμ λ λ¬Έμ κ° λ°μνλ€. μ΄λ λ¬Έμμ ν
μ€νΈ λμ κ·Έλ¦Ό, κ·Έλν νΉμ νμ κ°μ μμμ΄ λ§μ κ²½μ°μ΄λ€. λ°λΌμ λ μ΄μμμ κ°μΈν λ¬Έμ μμ νννλ₯Ό μνμ¬ μ μνλ λ°©λ²μ μ λ ¬λ ν
μ€νΈ λΌμΈλΏλ§ μλλΌ μ λΆλ€λ μ΄μ©νλ€. μ¬λ°λ₯΄κ² ννν λ μ λΆλ€μ μ¬μ ν μΌμ§μ μ ννμ΄κ³ , λλΆλΆ κ°λ‘ νΉμ μΈλ‘ λ°©ν₯μΌλ‘ μ λ ¬λμ΄ μλ€λ κ°μ λ° κ΄μΈ‘μ κ·Όκ±°νμ¬, μ μνλ λ°©λ²μ μ΄λ¬ν μ±μ§λ€μ μμννκ³ μ΄λ₯Ό ν
μ€νΈ λΌμΈ κΈ°λ°μ λΉμ© ν¨μμ κ²°ν©νλ€. κ·Έλ¦¬κ³ λΉμ© ν¨μλ₯Ό μ΅μν νλ λ°©λ²μ ν΅ν΄, μ μνλ λ°©λ²μ μ’
μ΄μ ꡬλΆλ¬μ§, μΉ΄λ©λΌ μμ , μ΄μ 거리μ κ°μ ννν λ³μλ€μ μΆμ νλ€. λν, μ€κ²μΆλ ν
μ€νΈ λΌμΈλ€κ³Ό μμμ λ°©ν₯μ κ°μ§λ μ λΆλ€κ³Ό κ°μ μ΄μμ (outlier)μ κ³ λ €νμ¬, μ μνλ λ°©λ²μ λ°λ³΅μ μΈ λ¨κ³λ‘ μ€κ³λλ€. κ° λ¨κ³μμ, μ λ ¬ νΉμ±μ λ§μ‘±νμ§ μλ μ΄μμ λ€μ μ κ±°λκ³ , μ κ±°λμ§ μμ ν
μ€νΈ λΌμΈ λ° μ λΆλ€λ§μ΄ λΉμ©ν¨μ μ΅μ νμ μ΄μ©λλ€. μνν μ€ν κ²°κ³Όλ€μ μ μνλ λ°©λ²μ΄ λ€μν λ μ΄μμμ λνμ¬ κ°μΈν¨μ 보μ¬μ€λ€.
λ λ²μ§Έλ‘λ, λ³Έ λ
Όλ¬Έμ μ₯λ©΄ ν
μ€νΈ ννν λ°©λ²μ μ μνλ€. κΈ°μ‘΄ μ₯λ©΄ ν
μ€νΈ ννν λ°©λ²λ€μ κ²½μ°, κ°λ‘/μΈλ‘ λ°©ν₯μ ν, λμΉ ννμ κ°μ λ¬Έμκ° κ°μ§λ κ³ μ μ μκΉμμ κ΄λ ¨λ νΉμ±μ μ΄μ©νλ€. νμ§λ§, μ΄λ¬ν λ°©λ²λ€μ λ¬Έμλ€μ μ λ ¬ ννλ κ³ λ €νμ§ μκ³ , κ°κ° κ°λ³ λ¬Έμμ λν νΉμ±λ€λ§μ μ΄μ©νκΈ° λλ¬Έμ μ¬λ¬ λ¬Έμλ€λ‘ ꡬμ±λ ν
μ€νΈμ λν΄μ μ μ λ ¬λμ§ μμ κ²°κ³Όλ₯Ό μΆλ ₯νλ€. μ΄λ¬ν λ¬Έμ μ μ ν΄κ²°νκΈ° μνμ¬, μ μνλ λ°©λ²μ λ¬Έμλ€μ μ λ ¬ μ 보λ₯Ό μ΄μ©νλ€. μ ννκ²λ, λ¬Έμ κ³ μ μ λͺ¨μλΏλ§ μλλΌ μ λ ¬ νΉμ±λ€λ ν¨κ» λΉμ©ν¨μλ‘ μμνλκ³ , λΉμ©ν¨μλ₯Ό μ΅μννλ λ°©λ²μ ν΅ν΄μ νννκ° μ§νλλ€. λν, λ¬Έμλ€μ μ λ ¬ νΉμ±μ μμννκΈ° μνμ¬, μ μνλ λ°©λ²μ ν
μ€νΈλ₯Ό κ°κ° κ°λ³ λ¬Έμλ€λ‘ λΆλ¦¬νλ λ¬Έμ λΆλ¦¬ λν μννλ€. κ·Έ λ€, ν
μ€νΈμ μ, μλ μ λ€μ RANSAC μκ³ λ¦¬μ¦μ μ΄μ©ν μ΅μ μ κ³±λ²μ ν΅ν΄ μΆμ νλ€. μ¦, μ 체 μκ³ λ¦¬μ¦μ λ¬Έμ λΆλ¦¬μ μ μΆμ , νννκ° λ°λ³΅μ μΌλ‘ μνλλ€. μ μνλ λΉμ©ν¨μλ λ³Όλ‘(convex)ννκ° μλκ³ λν λ§μ λ³μλ€μ ν¬ν¨νκ³ μκΈ° λλ¬Έμ, μ΄λ₯Ό μ΅μ ννκΈ° μνμ¬ Augmented Lagrange Multiplier λ°©λ²μ μ΄μ©νλ€. μ μνλ λ°©λ²μ μΌλ° 촬μ μμκ³Ό ν©μ±λ ν
μ€νΈ μμμ ν΅ν΄ μ€νμ΄ μ§νλμκ³ , μ€ν κ²°κ³Όλ€μ μ μνλ λ°©λ²μ΄ κΈ°μ‘΄ λ°©λ²λ€μ λΉνμ¬ λμ μΈμ μ±λ₯μ 보μ΄λ©΄μ λμμ μκ°μ μΌλ‘λ μ’μ κ²°κ³Όλ₯Ό 보μμ 보μ¬μ€λ€.
λ§μ§λ§μΌλ‘, μ μνλ λ°©λ²μ μΌλ° λ°°κ²½ μμ νμ΄μ§ νλ©΄ ννν λ°©λ²μΌλ‘λ νμ₯λλ€. μΌλ° λ°°κ²½μ λν΄μ, μ½λ³μ΄λ μλ£μ μΊκ³Ό κ°μ΄ μν΅ ννμ 물체λ λ§μ΄ μ‘΄μ¬νλ€. κ·Έλ€μ νλ©΄μ μΌλ° μν΅ νλ©΄(GCS)μΌλ‘ λͺ¨λΈλ§μ΄ κ°λ₯νλ€. μ΄λ¬ν νμ΄μ§ νλ©΄λ€μ λ§μ λ¬Έμμ κ·Έλ¦Όλ€μ ν¬ν¨νκ³ μμ§λ§, ν¬ν¨λ λ¬Έμλ λ¬Έμμ λΉν΄μ λ§€μ° λΆκ·μΉμ μΈ κ΅¬μ‘°λ₯Ό κ°μ§κ³ μλ€. λ°λΌμ κΈ°μ‘΄μ λ¬Έμ μμ ννν λ°©λ²λ€λ‘λ μΌλ° λ°°κ²½ μ νμ΄μ§ νλ©΄ μμμ ννννκΈ° νλ€λ€. λ§μ νμ΄μ§ νλ©΄μ μ μ λ ¬λ μ λΆλ€ (ν
λ리 μ νΉμ λ°μ½λ)μ ν¬ν¨νκ³ μλ€λ κ΄μΈ‘μ κ·Όκ±°νμ¬, μ μνλ λ°©λ²μ μμ μ μν μ λΆλ€μ λν ν¨μλ₯Ό μ΄μ©νμ¬ νμ΄μ§ νλ©΄μ ννννλ€. λ€μν λ₯κ·Ό 물체μ νμ΄μ§ νλ©΄ μμλ€μ λν μ€ν κ²°κ³Όλ€μ μ μνλ λ°©λ²μ΄ νννλ₯Ό μ ννκ² μνν¨μ 보μ¬μ€λ€.The optical character recognition (OCR) of text images captured by cameras plays an important role for scene understanding.
However, the OCR of camera-captured image is still considered a challenging problem, even after the text detection (localization).
It is mainly due to the geometric distortions caused by page curve and perspective view, therefore their rectification has been an essential pre-processing step for their recognition.
Thus, there have been many text image rectification methods which recover the fronto-parallel view image from a single distorted image.
Recently, many researchers have focused on the properties of the well-rectified text.
In this respect, this dissertation presents novel alignment properties for text image rectification, which are encoded into the proposed cost functions.
By minimizing the cost functions, the transformation parameters for rectification are obtained.
In detail, they are applied to three topics: document image dewarping, scene text rectification, and curved surface dewarping in real scene.
First, a document image dewarping method is proposed based on the alignments of text-lines and line segments.
Conventional text-line based document dewarping methods have problems when handling complex layout and/or very few text-lines. When there are few aligned text-lines in the image, this usually means that photos, graphics and/or tables take large portion of the input instead.
Hence, for the robust document dewarping, the proposed method uses line segments in the image in addition to the aligned text-lines.
Based on the assumption and observation that all the transformed line segments are still straight (line to line mapping), and many of them are horizontally or vertically aligned in the well-rectified images, the proposed method encodes this properties into the cost function in addition to the text-line based cost.
By minimizing the function, the proposed method can obtain transformation parameters for page curve, camera pose, and focal length, which are used for document image rectification. Considering that there are many outliers in line segment directions and miss-detected text-lines in some cases, the overall algorithm is designed in an iterative manner. At each step, the proposed method removes the text-lines and line segments that are not well aligned, and then minimizes the cost function with the updated information.
Experimental results show that the proposed method is robust to the variety of page layouts.
This dissertation also presents a method for scene text rectification. Conventional methods for scene text rectification mainly exploited the glyph property, which means that the characters in many language have horizontal/vertical strokes and also some symmetric shapes.
However, since they consider the only shape properties of individual character, without considering the alignments of characters, they work well for only images with a single character, and still yield mis-aligned results for images with multiple characters.
In order to alleviate this problem, the proposed method explicitly imposes alignment constraints on rectified results. To be precise, character alignments as well as glyph properties are encoded in the proposed cost function, and the transformation parameters are obtained by minimizing the function.
Also, in order to encode the alignments of characters into the cost function, the proposed method separates the text into individual characters using a projection profile method before optimizing the cost function. Then, top and bottom lines are estimated using a least squares line fitting with RANSAC. Overall algorithm is designed to perform character segmentation, line fitting, and rectification iteratively.
Since the cost function is non-convex and many variables are involved in the function, the proposed method also develops an optimization method using Augmented Lagrange Multiplier method.
This dissertation evaluates the proposed method on real and synthetic text images and experimental results show that the proposed method achieves higher OCR accuracy than the conventional approach and also yields visually pleasing results.
Finally, the proposed method can be extended to the curved surface dewarping in real scene.
In real scene, there are many circular objects such as medicine bottles or cans of drinking water, and their curved surfaces can be modeled as Generalized Cylindrical Surfaces (GCS). These curved surfaces include many significant text and figures, however their text has irregular structure compared to documents. Therefore, the conventional dewarping methods based on the properties of well-rectified text have problems in their rectification.
Based on the observation that many curved surfaces include well-aligned line segments (boundary lines of objects or barcode), the proposed method rectifies the curved surfaces by exploiting the proposed line segment terms.
Experimental results on a range of images with curved surfaces of circular objects show that the proposed method performs rectification robustly.1 Introduction 1
1.1 Document image dewarping 3
1.2 Scene text rectification 5
1.3 Curved surface dewarping in real scene 7
1.4 Contents 8
2 Related work 9
2.1 Document image dewarping 9
2.1.1 Dewarping methods using additional information 9
2.1.2 Text-line based dewarping methods 10
2.2 Scene text rectification 11
2.3 Curved surface dewarping in real scene 12
3 Document image dewarping 15
3.1 Proposed cost function 15
3.1.1 Parametric model of dewarping process 15
3.1.2 Cost function design 18
3.1.3 Line segment properties and cost function 19
3.2 Outlier removal and optimization 26
3.2.1 Jacobian matrix of the proposed cost function 27
3.3 Document region detection and dewarping 31
3.4 Experimental results 32
3.4.1 Experimental results on text-abundant document images 33
3.4.2 Experimental results on non conventional document images 34
3.5 Summary 47
4 Scene text rectification 49
4.1 Proposed cost function for rectification 49
4.1.1 Cost function design 49
4.1.2 Character alignment properties and alignment terms 51
4.2 Overall algorithm 54
4.2.1 Initialization 55
4.2.2 Character segmentation 56
4.2.3 Estimation of the alignment parameters 57
4.2.4 Cost function optimization for rectification 58
4.3 Experimental results 63
4.4 Summary 66
5 Curved surface dewarping in real scene 73
5.1 Proposed curved surface dewarping method 73
5.1.1 Pre-processing 73
5.1 Experimental results 74
5.2 Summary 76
6 Conclusions 83
Bibliography 85
Abstract (Korean) 93Docto
A Book Reader Design for Persons with Visual Impairment and Blindness
The objective of this dissertation is to provide a new design approach to a fully automated book reader for individuals with visual impairment and blindness that is portable and cost effective. This approach relies on the geometry of the design setup and provides the mathematical foundation for integrating, in a unique way, a 3-D space surface map from a low-resolution time of flight (ToF) device with a high-resolution image as means to enhance the reading accuracy of warped images due to the page curvature of bound books and other magazines. The merits of this low cost, but effective automated book reader design include: (1) a seamless registration process of the two imaging modalities so that the low resolution (160 x 120 pixels) height map, acquired by an Argos3D-P100 camera, accurately covers the entire book spread as captured by the high resolution image (3072 x 2304 pixels) of a Canon G6 Camera; (2) a mathematical framework for overcoming the difficulties associated with the curvature of open bound books, a process referred to as the dewarping of the book spread images, and (3) image correction performance comparison between uniform and full height map to determine which map provides the highest Optical Character Recognition (OCR) reading accuracy possible. The design concept could also be applied to address the challenging process of book digitization. This method is dependent on the geometry of the book reader setup for acquiring a 3-D map that yields high reading accuracy once appropriately fused with the high-resolution image. The experiments were performed on a dataset consisting of 200 pages with their corresponding computed and co-registered height maps, which are made available to the research community (cate-book3dmaps.fiu.edu). Improvements to the characters reading accuracy, due to the correction steps, were quantified and measured by introducing the corrected images to an OCR engine and tabulating the number of miss-recognized characters. Furthermore, the resilience of the book reader was tested by introducing a rotational misalignment to the book spreads and comparing the OCR accuracy to those obtained with the standard alignment. The standard alignment yielded an average reading accuracy of 95.55% with the uniform height map (i.e., the height values of the central row of the 3-D map are replicated to approximate all other rows), and 96.11% with the full height maps (i.e., each row has its own height values as obtained from the 3D camera). When the rotational misalignments were taken into account, the results obtained produced average accuracies of 90.63% and 94.75% for the same respective height maps, proving added resilience of the full height map method to potential misalignments
ν μ€νΈμ νΉμ§μ κΈ°λ°μ λͺ©μ ν¨μ μ΅μ νλ₯Ό μ΄μ©ν λ¬Έμμ ν μ€νΈ ννν κΈ°λ²
νμλ
Όλ¬Έ (λ°μ¬)-- μμΈλνκ΅ λνμ : μ κΈ°Β·μ»΄ν¨ν°κ³΅νλΆ, 2014. 8. μ‘°λ¨μ΅.There are many techniques and applications that detect and recognize text information in the images, e.g., document retrieval using the camera-captured document image, book reader for visually impaired, and augmented reality based on text recognition. In these applications, the planar surfaces which contain the text are often distorted in the captured image due to the perspective view (e.g., road signs), curvature (e.g., unfolded books), and wrinkles (e.g., old documents). Specifically, recovering the original document texture by removing these distortions from the camera-captured document images is called the document rectification. In this dissertation, new text surface rectification algorithms are proposed, for improving text recognition accuracy and visual quality. The proposed methods are categorized into 3 types depending on the types of the input. The contributions of the proposed methods can be summarized as follows.
In the first rectification algorithm, the dense text-lines in the documents are employed to rectify the images. Unlike the conventional approaches, the proposed method does not directly use the text-line. Instead, the proposed method use the discrete representation of text-lines and text-blocks which are the sets of connected components. Also, the geometric distortion caused by page curl and perspective view are modeled as generalized cylindrical surfaces and camera rotation respectively. With these distortion model and discrete representation of the features, a cost function whose minimization yields parameters of the distortion model is developed. In the cost function, the properties of the pages such as text-block alignment, line-spacing, and the straightness of text-lines are encoded. By describing the text features using the sets of discrete points, the cost function can be easily defined and well solved by Levenberg-Marquadt algorithm. Experiments show that the proposed method works well for the various layouts and curved surfaces, and compares favorably with the conventional methods on the standard dataset.
The second algorithm is a unified framework to rectify and stitch multiple document images using visual feature points instead of text lines. This is similar to the method employed in general image stitching algorithm. However, the general image stitching algorithm usually assumes fixed center of camera, which is not taken for granted in capturing the document. To deal with the camera motion between images, a new parametric family of motion model is proposed in this dissertation. Besides, to remove the ambiguity in the reference plane, a new cost function is developed to impose the constraints on the reference plane. This enables the estimation of physically correct reference plane without prior knowledge. The estimated reference plane can also be used to rectify the stitching result. Furthermore, the proposed method can be applied to any other planar object such as building facades or mural paintings as well as the camera-captured document image since it employs the general features.
The third rectification method is based on scene text detection algorithm, which is independent from the language model. The conventional methods assume that a character consists of a single connected component (CC) like English alphabet. However, this assumption is brittle in the Asian characters such as Korean, Chinese, and Japanese, where a single character consists of several CCs. Therefore, it is difficult to divide CCs into text lines without language model. To alleviate this problem, the proposed method clusters the candidate regions based on the similarity measure considering inter-character relation. The adjacency measure is trained on the data set labeled with the bounding box of text region. Non-text regions that remain after clustering are filtered out in text/non-text classification step. Final text regions are merged or divided into each text line considering the orientation and location. The detected text is rectified using the orientation of text-line and vertical strokes. The proposed method outperforms state-of-the-art algorithms in English as well as Asian characters in the extensive experiments.1 Introduction 1
1.1 Document rectification via text-line based optimization . . . . . . . 2
1.2 A unified approach of rectification and stitching for document images 4
1.3 Rectification via scene text detection . . . . . . . . . . . . . . . . . . 5
1.4 Contents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
2 Related work 9
2.1 Document rectification . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2.1.1 Document dewarping without text-lines . . . . . . . . . . . . 9
2.1.2 Document dewarping with text-lines . . . . . . . . . . . . . . 10
2.1.3 Text-block identification and text-line extraction . . . . . . . 11
2.2 Document stitching . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
2.3 Scene text detection . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
3 Document rectification based on text-lines 15
3.1 Proposed approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
3.1.1 Image acquisition model . . . . . . . . . . . . . . . . . . . . . 16
3.1.2 Proposed approach to document dewarping . . . . . . . . . . 18
3.2 Proposed cost function and its optimization . . . . . . . . . . . . . . 22
3.2.1 Design of Estr(Β·) . . . . . . . . . . . . . . . . . . . . . . . . . 22
3.2.2 Minimization of Estr(Β·) . . . . . . . . . . . . . . . . . . . . . 23
3.2.3 Alignment type classification . . . . . . . . . . . . . . . . . . 28
3.2.4 Design of Ealign(Β·) . . . . . . . . . . . . . . . . . . . . . . . . 29
3.2.5 Design of Espacing(Β·) . . . . . . . . . . . . . . . . . . . . . . . 31
3.3 Extension to unfolded book surfaces . . . . . . . . . . . . . . . . . . 32
3.4 Experimental result . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
3.4.1 Experiments on synthetic data . . . . . . . . . . . . . . . . . 36
3.4.2 Experiments on real images . . . . . . . . . . . . . . . . . . . 39
3.4.3 Comparison with existing methods . . . . . . . . . . . . . . . 43
3.4.4 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
4 Document rectification based on feature detection 49
4.1 Proposed approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
4.2 Proposed cost function and its optimization . . . . . . . . . . . . . . 51
4.2.1 Notations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
4.2.2 Homography between the i-th image and E . . . . . . . . . 52
4.2.3 Proposed cost function . . . . . . . . . . . . . . . . . . . . . . 53
4.2.4 Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
4.2.5 Relation to the model in [17] . . . . . . . . . . . . . . . . . . 55
4.3 Post-processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
4.3.1 Classification of two cases . . . . . . . . . . . . . . . . . . . . 56
4.3.2 Skew removal . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
4.4 Experimental results . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
4.4.1 Quantitative evaluation on metric reconstruction performance 57
4.4.2 Experiments on real images . . . . . . . . . . . . . . . . . . . 58
5 Scene text detection and rectification 67
5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
5.1.1 Contribution . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
5.1.2 Proposed approach . . . . . . . . . . . . . . . . . . . . . . . . 69
5.2 Candidate region detection . . . . . . . . . . . . . . . . . . . . . . . 70
5.2.1 CC extraction . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
5.2.2 Computation of similarity between CCs . . . . . . . . . . . . 70
5.2.3 CC clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
5.3 Rectification of candidate region . . . . . . . . . . . . . . . . . . . . 73
5.4 Text/non-text classification . . . . . . . . . . . . . . . . . . . . . . . 76
5.5 Experimental result . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
5.5.1 Experimental results on ICDAR 2011 dataset . . . . . . . . . 80
5.5.2 Experimental results on the Asian character dataset . . . . . 80
6 Conclusion 83
Bibliography 87
Abstract (Korean) 97Docto