Analysis of the image moments sensitivity for the application in pattern recognition problems

Momenti slike su numerički deskriptori koji sadrže informaciju o svojstvima invarijantnim na translaciju, rotaciju, promjenu skale i neke oblike distorzije, a njihova analiza je jedna od metoda koje se često koriste pri analizi slika i raspoznavanju uzoraka. U okviru ove radnje razvijeni su algoritmi za računanje geometrijskih, Legendreovih, Zernikeovih, Fourier – Mellinovih te tri tipa Fourier – Jacobijevih momenata, kao i iz njih definiranih invarijanti slike u programskom jeziku MatLab uz rješavanje inverznog problema rekonstrukcije početnog ulaza. Za sve tipove momenata osim najjednostavnijih geometrijskih definirani su vektori osjetljivosti na rotaciju i promjenu skale čije su komponente oni članovi skupa koji nose značajnije informacije o ulaznoj slici. Primjenom novih deskriptora na klasifikaciju rukom pisanih slova i identifikacijskih fotografija osoba pokazano je da je relevantna informacija o ulazu na taj način sačuvana, a njihov je izračun znatno brži i jednostavniji uz zadržanu sposobnost jednoznačnog raspoznavanja uzoraka. Korištenjem momenata slike i vektora osjetljivosti analizirani su znakovi s dvaju glagoljskih spomenika te utvrđeno postojanje mješavine znakova trokutastog i okruglog modela glagoljice. Metoda je primijenjena i na klasifikaciju tragova puzanja ličinki mutanata vinske mušice za potrebe proučavanja odgovora živčanog sustava na različite podražaje.Image moments are numerical descriptors invariant to translation, rotation, change of scale and some types of image distortion and their analysis is one of the most often used methods in image processing and pattern recognition. In this work, algorithms for calculation of geometric, Legendre, Zernike, Fourier – Mellin and three types of Fourier – Jacobi moments were implemented in MatLab. Hu's, affine and blur invariants were also obtained as well as inverse problem of input image reconstruction solved. For each type of image moments exept geometric ones the set of sensitivity vectors for rotation and scale were defined. Their components are those image moments which describe more important features of the input image. These new descriptors were applied for classification of handwritten letters and identifying personal photos. It was shown that the process of such descriptor calculation is much faster and simpler while preserving all the relevant information about input image. Using this method, the signs carved in two glagolitic inscriptions were analyzed and the mixture of triangular and round glagolitic letters found. The method was also applied to classification of the mutant fruit fly larvae crawling trails which is needed in studying responses of the nervous system to different stimuli

Analysis of the image moments sensitivity for the application in pattern recognition problems

Momenti slike su numerički deskriptori koji sadrže informaciju o svojstvima invarijantnim na translaciju, rotaciju, promjenu skale i neke oblike distorzije, a njihova analiza je jedna od metoda koje se često koriste pri analizi slika i raspoznavanju uzoraka. U okviru ove radnje razvijeni su algoritmi za računanje geometrijskih, Legendreovih, Zernikeovih, Fourier – Mellinovih te tri tipa Fourier – Jacobijevih momenata, kao i iz njih definiranih invarijanti slike u programskom jeziku MatLab uz rješavanje inverznog problema rekonstrukcije početnog ulaza. Za sve tipove momenata osim najjednostavnijih geometrijskih definirani su vektori osjetljivosti na rotaciju i promjenu skale čije su komponente oni članovi skupa koji nose značajnije informacije o ulaznoj slici. Primjenom novih deskriptora na klasifikaciju rukom pisanih slova i identifikacijskih fotografija osoba pokazano je da je relevantna informacija o ulazu na taj način sačuvana, a njihov je izračun znatno brži i jednostavniji uz zadržanu sposobnost jednoznačnog raspoznavanja uzoraka. Korištenjem momenata slike i vektora osjetljivosti analizirani su znakovi s dvaju glagoljskih spomenika te utvrđeno postojanje mješavine znakova trokutastog i okruglog modela glagoljice. Metoda je primijenjena i na klasifikaciju tragova puzanja ličinki mutanata vinske mušice za potrebe proučavanja odgovora živčanog sustava na različite podražaje.Image moments are numerical descriptors invariant to translation, rotation, change of scale and some types of image distortion and their analysis is one of the most often used methods in image processing and pattern recognition. In this work, algorithms for calculation of geometric, Legendre, Zernike, Fourier – Mellin and three types of Fourier – Jacobi moments were implemented in MatLab. Hu's, affine and blur invariants were also obtained as well as inverse problem of input image reconstruction solved. For each type of image moments exept geometric ones the set of sensitivity vectors for rotation and scale were defined. Their components are those image moments which describe more important features of the input image. These new descriptors were applied for classification of handwritten letters and identifying personal photos. It was shown that the process of such descriptor calculation is much faster and simpler while preserving all the relevant information about input image. Using this method, the signs carved in two glagolitic inscriptions were analyzed and the mixture of triangular and round glagolitic letters found. The method was also applied to classification of the mutant fruit fly larvae crawling trails which is needed in studying responses of the nervous system to different stimuli

Expansion of the 4D XCAT Phantom Library with Anatomical Texture

<p>Computational phantoms are set to play an important role in imaging research. As medicine moves increasingly towards providing individualized, patient-specific care, it is imperative that simulations be completed on patient-specific anatomy, rather than a reference standard. To that end, there is need for a variety of realistic phantoms for clinical studies.</p><p> This work adds to the existing extended cardiac and torso (XCAT) adult phantom series (two phantoms based on visual human data) by building new models based on adult patient computed tomography (CT) image data. These CT datasets were obtained from Duke University's patient CT database. </p><p>Each image-set was segmented using in-house segmentation software, defining bony structures and large organs within the field of view. 3D non-uniform rational b-spline (NURBS) surfaces were fitted to the segmented data. Using the multi-channel large diffeomorphic deformation metric mapping (MC-LDDMM) network, a transform was calculated to morph an existing XCAT model to the segmented patient geometry. Fifty-eight adult XCAT models were added to the phantom library. </p><p>In addition to the expanding the XCAT library, the feasibility of incorporating texture was investigated. Currently, the XCAT phantom structures are assumed to be homogeneous. This can lead to unrealistic appearance when the phantoms are combined with imaging simulations, particularly in CT. The purpose of this project was to capture anatomical texture and test it in a simulated phantom. Image data from the aforementioned patient CT database served as the source of anatomical texture. </p><p>The images were de-noised using anisotropic diffusion. Next, several regions of interest (ROIs) were taken from the liver and lungs of CT images. Using the ROIs as a source of texture, a larger stochastic texture image-set was created using the Image Quilting algorithm. </p><p>The visual human adult male XCAT phantom was voxelized at the same resolution as the texture image. The voxels inside the liver were directly replaced by the corresponding voxels of texture. Similarly for the lung, the voxels between the existing lung bronchi/blood vessels and the lung wall were replaced by texture voxels. This procedure was performed using ten different patient CT image-sets as sources of texture. </p><p>To validate the similarity of the artificial textures to the source textures, reconstructions of the adult male XCAT phantom with added textures were compared to the clinical images via receiver operator characteristic (ROC) analysis, a two-sample t-test, equivalence test, and through comparing absolute differences between scores. </p><p>It was concluded that this framework provides a valuable tool in which anatomical texture can be incorporated into computational phantoms. It is anticipated that this step towards making many anatomically variable virtual models indicative of a patient populace and making these models more realistic will be useful in medical imaging research, especially for studies relating to image quality.</p>Thesi

Protein contour modelling and computation for complementarity detection and docking

The aim of this thesis is the development and application of a model that effectively and efficiently integrates the evaluation of geometric and electrostatic complementarity for the protein-protein docking problem. Proteins perform their biological roles by interacting with other biomolecules and forming macromolecular complexes. The structural characterization of protein complexes is important to understand the underlying biological processes. Unfortunately, there are several limitations to the available experimental techniques, leaving the vast majority of these complexes to be determined by means of computational methods such as protein-protein docking. The ultimate goal of the protein-protein docking problem is the in silico prediction of the three-dimensional structure of complexes of two or more interacting proteins, as occurring in living organisms, which can later be verified in vitro or in vivo. These interactions are highly specific and take place due to the simultaneous formation of multiple weak bonds: the geometric complementarity of the contours of the interacting molecules is a fundamental requirement in order to enable and maintain these interactions. However, shape complementarity alone cannot guarantee highly accurate docking predictions, as there are several physicochemical factors, such as Coulomb potentials, van der Waals forces and hydrophobicity, affecting the formation of protein complexes. In order to set up correct and efficient methods for the protein-protein docking, it is necessary to provide a unique representation which integrates geometric and physicochemical criteria in the complementarity evaluation. To this end, a novel local surface descriptor, capable of capturing both the shape and electrostatic distribution properties of macromolecular surfaces, has been designed and implemented. The proposed methodology effectively integrates the evaluation of geometrical and electrostatic distribution complementarity of molecular surfaces, while maintaining efficiency in the descriptor comparison phase. The descriptor is based on the 3D Zernike invariants which possess several attractive features, such as a compact representation, rotational and translational invariance and have been shown to adequately capture global and local protein surface shape similarity and naturally represent physicochemical properties on the molecular surface. Locally, the geometric similarity between two portions of protein surface implies a certain degree of complementarity, but the same cannot be stated about electrostatic distributions. Complementarity in electrostatic distributions is more complex to handle, as charges must be matched with opposite ones even if they do not have the same magnitude. The proposed method overcomes this limitation as follows. From a unique electrostatic distribution function, two separate distribution functions are obtained, one for the positive and one for the negative charges, and both functions are normalised in [0, 1]. Descriptors are computed separately for the positive and negative charge distributions, and complementarity evaluation is then done by cross-comparing descriptors of distributions of charges of opposite signs. The proposed descriptor uses a discrete voxel-based representation of the Connolly surface on which the corresponding electrostatic potentials have been mapped. Voxelised surface representations have received a lot of interest in several bioinformatics and computational biology applications as a simple and effective way of jointly representing geometric and physicochemical properties of proteins and other biomolecules by mapping auxiliary information in each voxel. Moreover, the voxel grid can be defined at different resolutions, thus giving the means to effectively control the degree of detail in the discrete representation along with the possibility of producing multiple representations of the same molecule at different resolutions. A specific algorithm has been designed for the efficient computation of voxelised macromolecular surfaces at arbitrary resolutions, starting from experimentally-derived structural data (X-ray crystallography, NMR spectroscopy or cryo-electron microscopy). Fast surface generation is achieved by adapting an approximate Euclidean Distance Transform algorithm in the Connolly surface computation step and by exploiting the geometrical relationship between the latter and the Solvent Accessible surface. This algorithm is at the base of VoxSurf (Voxelised Surface calculation program), a tool which can produce discrete representations of macromolecules at very high resolutions starting from the three-dimensional information of their corresponding PDB files. By employing compact data structures and implementing a spatial slicing protocol, the proposed tool can calculate the three main molecular surfaces at high resolutions with limited memory demands. To reduce the surface computation time without affecting the accuracy of the representation, two parallel algorithms for the computation of voxelised macromolecular surfaces, based on a spatial slicing procedure, have been introduced. The molecule is sliced in a user-defined number of parts and the portions of the overall surface can be calculated for each slice in parallel. The molecule is sliced with planes perpendicular to the abscissa axis of the Cartesian coordinate system defined in the molecule's PDB entry. The first algorithms uses an overlapping margin of one probe-sphere radius length among slices in order to guarantee the correctness of the Euclidean Distance Transform. Because of this margin, the Connolly surface can be computed nearly independently for each slice. Communications among processes are necessary only during the pocket identification procedure which ensures that pockets spanning through more than one slice are correctly identified and discriminated from solvent-excluded cavities inside the molecule. In the second parallel algorithm the size of the overlapping margin between slices has been reduced to a one-voxel length by adapting a multi-step region-growing Euclidean Distance Transform algorithm. At each step, distance values are first calculated independently for every slice, then, a small portion of the borders' information is exchanged between adjacent slices. The proposed methodologies will serve as a basis for a full-fledged protein-protein docking protocol based on local feature matching. Rigorous benchmark tests have shown that the combined geometric and electrostatic descriptor can effectively identify shape and electrostatic distribution complementarity in the binding sites of protein-protein complexes, by efficiently comparing circular surface patches and significantly decreasing the number of false positives obtained when using a purely-geometric descriptor. In the validation experiments, the contours of the two interacting proteins are divided in circular patches: all possible patch pairs from the two proteins are then evaluated in terms of complementarity and a general ranking is produced. Results show that native patch pairs obtain higher ranks when using the newly proposed descriptor, with respect to the ranks obtained when using the purely-geometric one