Optimization for automated assembly of puzzles

The puzzle assembly problem has many application areas such as restoration and reconstruction of archeological findings, repairing of broken objects, solving jigsaw type puzzles, molecular docking problem, etc. The puzzle pieces usually include not only geometrical shape information but also visual information such as texture, color, and continuity of lines. This paper presents a new approach to the puzzle assembly problem that is based on using textural features and geometrical constraints. The texture of a band outside the border of pieces is predicted by inpainting and texture synthesis methods. Feature values are derived from these original and predicted images of pieces. An affinity measure of corresponding pieces is defined and alignment of the puzzle pieces is formulated as an optimization problem where the optimum assembly of the pieces is achieved by maximizing the total affinity measure. An fft based image registration technique is used to speed up the alignment of the pieces. Experimental results are presented on real and artificial data sets

Registration of holographic images based on the integral transformation

The paper describes the possibilities of using Fourier-Mellin transform for registering images of holographic interferograms. Registered holographic images will then allow automating their evaluation. Registration based on changes in image intensities using the discrete integral transforms was selected of the methods of registration. Whereas it was necessary to register the images, which are not only translated, but also rotated and with the changed of scale, the Fourier-Mellin transform was used. Use of the image discrete transforms is original in this field, proposed processing algorithm contains also simplified mean of calculating the angle of rotation of the test image instead of common Fourier-Mellin transformation method sequence

Registration of Brain Images using Fast Walsh Hadamard Transform

A lot of image registration techniques have been developed with great significance for data analysis in medicine, astrophotography, satellite imaging and few other areas. This work proposes a method for medical image registration using Fast Walsh Hadamard transform. This algorithm registers images of the same or different modalities. Each image bit is lengthened in terms of Fast Walsh Hadamard basis functions. Each basis function is a notion of determining various aspects of local structure, e.g., horizontal edge, corner, etc. These coefficients are normalized and used as numerals in a chosen number system which allows one to form a unique number for each type of local structure. The experimental results show that Fast Walsh Hadamard transform accomplished better results than the conventional Walsh transform in the time domain. Also Fast Walsh Hadamard transform is more reliable in medical image registration consuming less time.Comment: 10 pages, 37 figures, 12 table

Eccentricity Compensator for Log-Polar Sensor

his paper aims at acquiring robust rotation, scale, and translation-invariant feature from a space-variant image by a fovea sensor. A proposed model of eccentricity compensator corrects deformation that occurs in a log-polar image when the fovea sensor is not centered at a target, that is, when eccentricity exists. An image simulator in discrete space remaps a compensated log-polar image using this model. This paper proposes unreliable feature omission (UFO) that reduces local high frequency noise in the space-variant image using discrete wavelet transform. It discards coefficients when they are regarded as unreliable based on digitized errors of the input image. The first simulation mainly tests geometric performance of the compensator, in case without noise. This result shows the compensator performs well and its root mean square error (RMSE) changes only by up to 2.54 [%] in condition of eccentricity within 34.08[deg]. The second simulation applies UFO to the log-polar image remapped by the compensator, taking its space-variant resolution into account. The result draws a conclusion that UFO performs better in case with more white Gaussian noise (WGN), even if the resolution of the compensated log-polar image is not isotropic

Surgical Tool Segmentation with Pose-Informed Morphological Polar Transform of Endoscopic Images

This paper presents a tool-pose-informed variable center morphological polar transform to enhance segmentation of endoscopic images. The representation, while not loss-less, transforms rigid tool shapes into morphologies consistently more rectangular that may be more amenable to image segmentation networks. The proposed method was evaluated using the U-Net convolutional neural network, and the input images from endoscopy were represented in one of the four different coordinate formats (1) the original rectangular image representation, (2) the morphological polar coordinate transform, (3) the proposed variable center transform about the tool-tip pixel and (4) the proposed variable center transform about the tool vanishing point pixel. Previous work relied on the observations that endoscopic images typically exhibit unused border regions with content in the shape of a circle (since the image sensor is designed to be larger than the image circle to maximize available visual information in the constrained environment) and that the region of interest (ROI) was most ideally near the endoscopic image center. That work sought an intelligent method for, given an input image, carefully selecting between methods (1) and (2) for best image segmentation prediction. In this extension, the image center reference constraint for polar transformation in method (2) is relaxed via the development of a variable center morphological transformation. Transform center selection leads to different spatial distributions of image loss, and the transform-center location can be informed by robot kinematic model and endoscopic image data. In particular, this work is examined using the tool-tip and tool vanishing point on the image plane as candidate centers. The experiments were conducted for each of the four image representations using a data set of 8360 endoscopic images from real sinus surgery. The segmentation performance was evaluated with standard metrics, and some insight about loss and tool location effects on performance are provided. Overall, the results are promising, showing that selecting a transform center based on tool shape features using the proposed method can improve segmentation performance