313 research outputs found

    Fast Jacket-Haar Transform with Any Size

    Get PDF

    QUANTITATIVE METHODS AND DETECTION TECHNIQUES IN HYPERSPECTRAL IMAGING INVOLVING MEDICAL AND OTHER APPLICATIONS

    Get PDF
    This research using Hyperspectral imaging involves recognizing targets through spatial and spectral matching and spectral un-mixing of data ranging from remote sensing to medical imaging kernels for clinical studies based on Hyperspectral data-sets generated using the VFTHSI [Visible Fourier Transform Hyperspectral Imager], whose high resolution Si detector makes the analysis achievable. The research may be broadly classified into (I) A Physically Motivated Correlation Formalism (PMCF), which places both spatial and spectral data on an equivalent mathematical footing in the context of a specific Kernel and (II) An application in RF plasma specie detection during carbon nanotube growing process. (III) Hyperspectral analysis for assessing density and distribution of retinopathies like age related macular degeneration (ARMD) and error estimation enabling the early recognition of ARMD, which is treated as an ill-conditioned inverse imaging problem. The broad statistical scopes of this research are two fold- target recognition problems and spectral unmixing problems. All processes involve experimental and computational analysis of Hyperspectral data sets is presented, which is based on the principle of a Sagnac Interferometer, calibrated to obtain high SNR levels. PMCF computes spectral/spatial/cross moments and answers the question of how optimally the entire hypercube should be sampled and finds how many spatial-spectral pixels are required precisely for a particular target recognition. Spectral analysis of RF plasma radicals, typically Methane plasma and Argon plasma using VFTHSI has enabled better process monitoring during growth of vertically aligned multi-walled carbon nanotubes by instant registration of the chemical composition or density changes temporally, which is key since a significant correlation can be found between plasma state and structural properties. A vital focus of this thesis is towards medical Hyperspectral imaging applied to retinopathies like age related macular degeneration targets taken with a Fundus imager, which is akin to the VFTHSI. Detection of the constituent components in the diseased hyper-pigmentation area is also computed. The target or reflectance matrix is treated as a highly ill-conditioned spectral un-mixing problem, to which methodologies like inverse techniques, principal component analysis (PCA) and receiver operating curves (ROC) for precise spectral recognition of infected area. The region containing ARMD was easily distinguishable from the spectral mesh plots over the entire band-pass area. Once the location was detected the PMCF coefficients were calculated by cross correlating a target of normal oxygenated retina with the de-oxygenated one. The ROCs generated using PMCF shows 30% higher detection probability with improved accuracy than ROCs based on Spectral Angle Mapper (SAM). By spectral unmixing methods, the important endmembers/carotenoids of the MD pigment were found to be Xanthophyl and lutein, while ฮฒ-carotene which showed a negative correlation in the unconstrained inverse problem is a supplement given to ARMD patients to prevent the disease and does not occur in the eye. Literature also shows degeneration of meso-zeaxanthin. Ophthalmologists may assert the presence of ARMD and commence the diagnosis process if the Xanthophyl pigment have degenerated 89.9%, while the lutein has decayed almost 80%, as found deduced computationally. This piece of current research takes it to the next level of precise investigation in the continuing process of improved clinical findings by correlating the microanatomy of the diseased fovea and shows promise of an early detection of this disease

    ๊ธฐํ•˜ํ•™์ ์œผ๋กœ ์ •๋ฐ€ํ•œ ๋น„์„ ํ˜• ๊ตฌ์กฐ๋ฌผ์˜ ์•„์ด์†Œ-์ง€์˜ค๋ฉ”ํŠธ๋ฆญ ํ˜•์ƒ ์„ค๊ณ„ ๋ฏผ๊ฐ๋„ ํ•ด์„

    Get PDF
    ํ•™์œ„๋…ผ๋ฌธ (๋ฐ•์‚ฌ)-- ์„œ์šธ๋Œ€ํ•™๊ต ๋Œ€ํ•™์› : ๊ณต๊ณผ๋Œ€ํ•™ ์กฐ์„ ํ•ด์–‘๊ณตํ•™๊ณผ, 2019. 2. ์กฐ์„ ํ˜ธ.In this thesis, a continuum-based analytical adjoint configuration design sensitivity analysis (DSA) method is developed for gradient-based optimal design of curved built-up structures undergoing finite deformations. First, we investigate basic invariance property of linearized strain measures of a planar Timoshenko beam model which is combined with the selective reduced integration and B-bar projection method to alleviate shear and membrane locking. For a nonlinear structural analysis, geometrically exact beam and shell structural models are basically employed. A planar Kirchhoff beam problem is solved using the rotation-free discretization capability of isogeometric analysis (IGA) due to higher order continuity of NURBS basis function whose superior per-DOF(degree-of-freedom) accuracy over the conventional finite element analysis using Hermite basis function is verified. Various inter-patch continuity conditions including rotation continuity are enforced using Lagrage multiplier and penalty methods. This formulation is combined with a phenomenological constitutive model of shape memory polymer (SMP), and shape programming and recovery processes of SMP structures are simulated. Furthermore, for shear-deformable structures, a multiplicative update of finite rotations by an exponential map of a skew-symmetric matrix is employed. A procedure of explicit parameterization of local orthonormal frames in a spatial curve is presented using the smallest rotation method within the IGA framework. In the configuration DSA, the material derivative is applied to a variational equation, and an orientation design variation of curved structure is identified as a change of embedded local orthonormal frames. In a shell model, we use a regularized variational equation with a drilling rotational DOF. The material derivative of the orthogonal transformation matrix can be evaluated at final equilibrium configuration, which enables to compute design sensitivity using the tangent stiffness at the equilibrium without further iterations. A design optimization method for a constrained structure in a curved domain is also developed, which focuses on a lattice structure design on a specified surface. We define a lattice structure and its design variables on a rectangular plane, and utilize a concept of free-form deformation and a global curve interpolation to obtain an analytical expression for the control net of the structure on curved surface. The material derivative of the analytical expression eventually leads to precise design velocity field. Using this method, the number of design variables is reduced and design parameterization becomes more straightforward. In demonstrative examples, we verify the developed analytical adjoint DSA method in beam and shell structural problems undergoing finite deformations with various kinematic and force boundary conditions. The method is also applied to practical optimal design problems of curved built-up structures. For example, we extremize auxeticity of lattice structures, and experimentally verify nearly constant negative Poisson's ratio during large tensile and compressive deformations by using the 3-D printing and optical deformation measurement technologies. Also, we architect phononic band gap structures having significantly large band gap for mitigating noise in low audible frequency ranges.๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ๋Œ€๋ณ€ํ˜•์„ ๊ณ ๋ คํ•œ ํœ˜์–ด์ง„ ์กฐ๋ฆฝ ๊ตฌ์กฐ๋ฌผ์˜ ์—ฐ์†์ฒด ๊ธฐ๋ฐ˜ ํ•ด์„์  ์• ์กฐ์ธ ํ˜•์ƒ ์„ค๊ณ„ ๋ฏผ๊ฐ๋„ ํ•ด์„ ๊ธฐ๋ฒ•์„ ๊ฐœ๋ฐœํ•˜์˜€๋‹ค. ํ‰๋ฉด Timoshenko ๋น”์˜ ์„ ํ˜•ํ™”๋œ ๋ณ€ํ˜•๋ฅ ์˜ invariance ํŠน์„ฑ์„ ๊ณ ์ฐฐํ•˜์˜€๊ณ  invariant ์ •์‹ํ™”๋ฅผ ์„ ํƒ์  ์ถ•์†Œ์ ๋ถ„(selective reduced integration) ๊ธฐ๋ฒ• ๋ฐ B-bar projection ๊ธฐ๋ฒ•๊ณผ ๊ฒฐํ•ฉํ•˜์—ฌ shear ๋ฐ membrane ์ž ๊น€ ํ˜„์ƒ์„ ํ•ด์†Œํ•˜์˜€๋‹ค. ๋น„์„ ํ˜• ๊ตฌ์กฐ ๋ชจ๋ธ๋กœ์„œ ๊ธฐํ•˜ํ•™์ ์œผ๋กœ ์ •๋ฐ€ํ•œ ๋น” ๋ฐ ์‰˜ ๋ชจ๋ธ์„ ํ™œ์šฉํ•˜์˜€๋‹ค. ํ‰๋ฉด Kirchhoff ๋น” ๋ชจ๋ธ์„ NURBS ๊ธฐ์ €ํ•จ์ˆ˜์˜ ๊ณ ์ฐจ ์—ฐ์†์„ฑ์— ๋”ฐ๋ฅธ ์•„์ด์†Œ-์ง€์˜ค๋ฉ”ํŠธ๋ฆญ ํ•ด์„ ๊ธฐ๋ฐ˜ rotation-free ์ด์‚ฐํ™”๋ฅผ ํ™œ์šฉํ•˜์—ฌ ๋‹ค๋ฃจ์—ˆ์œผ๋ฉฐ, ๊ธฐ์กด์˜ Hermite ๊ธฐ์ €ํ•จ์ˆ˜ ๊ธฐ๋ฐ˜์˜ ์œ ํ•œ์š”์†Œ๋ฒ•์— ๋น„ํ•ด ์ž์œ ๋„๋‹น ํ•ด์˜ ์ •ํ™•๋„๊ฐ€ ๋†’์Œ์„ ๊ฒ€์ฆํ•˜์˜€๋‹ค. ๋ผ๊ทธ๋ž‘์ง€ ์Šน์ˆ˜๋ฒ• ๋ฐ ๋ฒŒ์น™ ๊ธฐ๋ฒ•์„ ๋„์ž…ํ•˜์—ฌ ํšŒ์ „์˜ ์—ฐ์†์„ฑ์„ ํฌํ•จํ•œ ๋‹ค์–‘ํ•œ ๋‹ค์ค‘ํŒจ์น˜๊ฐ„ ์—ฐ์† ์กฐ๊ฑด์„ ๊ณ ๋ คํ•˜์˜€๋‹ค. ์ด๋Ÿฌํ•œ ๊ธฐ๋ฒ•์„ ํ˜„์ƒํ•™์  (phenomenological) ํ˜•์ƒ๊ธฐ์–ตํด๋ฆฌ๋จธ (SMP) ์žฌ๋ฃŒ ๊ตฌ์„ฑ๋ฐฉ์ •์‹๊ณผ ๊ฒฐํ•ฉํ•˜์—ฌ ํ˜•์ƒ์˜ ํ”„๋กœ๊ทธ๋ž˜๋ฐ๊ณผ ํšŒ๋ณต ๊ณผ์ •์„ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ํ•˜์˜€๋‹ค. ์ „๋‹จ๋ณ€ํ˜•์„ ๊ฒช๋Š” (shear-deformable) ๊ตฌ์กฐ ๋ชจ๋ธ์— ๋Œ€ํ•˜์—ฌ ๋Œ€ํšŒ์ „์˜ ๊ฐฑ์‹ ์„ ๊ต๋Œ€ ํ–‰๋ ฌ์˜ exponential map์— ์˜ํ•œ ๊ณฑ์˜ ํ˜•ํƒœ๋กœ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ๊ณต๊ฐ„์ƒ์˜ ๊ณก์„  ๋ชจ๋ธ์—์„œ ์ตœ์†ŒํšŒ์ „ (smallest rotation) ๊ธฐ๋ฒ•์„ ํ†ตํ•ด ๊ตญ์†Œ ์ •๊ทœ์ง๊ต์ขŒํ‘œ๊ณ„์˜ ๋ช…์‹œ์  ๋งค๊ฐœํ™”๋ฅผ ์ˆ˜ํ–‰ํ•˜์˜€๋‹ค. ํ˜•์ƒ ์„ค๊ณ„ ๋ฏผ๊ฐ๋„ ํ•ด์„์„ ์œ„ํ•˜์—ฌ ์ „๋ฏธ๋ถ„์„ ๋ณ€๋ถ„ ๋ฐฉ์ •์‹์— ์ ์šฉํ•˜์˜€์œผ๋ฉฐ ํœ˜์–ด์ง„ ๊ตฌ์กฐ๋ฌผ์˜ ๋ฐฐํ–ฅ ์„ค๊ณ„ ๋ณ€ํ™”๋Š” ๊ตญ์†Œ ์ •๊ทœ์ง๊ต์ขŒํ‘œ๊ณ„์˜ ํšŒ์ „์— ์˜ํ•˜์—ฌ ๊ธฐ์ˆ ๋œ๋‹ค. ์ตœ์ข… ๋ณ€ํ˜• ํ˜•์ƒ์—์„œ ์ง๊ต ๋ณ€ํ™˜ ํ–‰๋ ฌ์˜ ์ „๋ฏธ๋ถ„์„ ๊ณ„์‚ฐํ•จ์œผ๋กœ์จ ๋Œ€ํšŒ์ „ ๋ฌธ์ œ์—์„œ ์ถ”๊ฐ€์ ์ธ ๋ฐ˜๋ณต ๊ณ„์‚ฐ์—†์ด ๋ณ€ํ˜• ํ•ด์„์—์„œ์˜ ์ ‘์„ ๊ฐ•์„ฑํ–‰๋ ฌ์— ์˜ํ•ด ํ•ด์„์  ์„ค๊ณ„ ๋ฏผ๊ฐ๋„๋ฅผ ๊ณ„์‚ฐํ•  ์ˆ˜ ์žˆ๋‹ค. ์‰˜ ๊ตฌ์กฐ๋ฌผ์˜ ๊ฒฝ์šฐ ๋ฉด๋‚ด ํšŒ์ „ ์ž์œ ๋„ ๋ฐ ์•ˆ์ •ํ™”๋œ ๋ณ€๋ถ„ ๋ฐฉ์ •์‹์„ ํ™œ์šฉํ•˜์—ฌ ๋ณด๊ฐ•์žฌ(stiffener)์˜ ๋ชจ๋ธ๋ง์„ ์šฉ์ดํ•˜๊ฒŒ ํ•˜์˜€๋‹ค. ๋˜ํ•œ ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ํœ˜์–ด์ง„ ์˜์—ญ์— ๊ตฌ์†๋˜์–ด์žˆ๋Š” ๊ตฌ์กฐ๋ฌผ์— ๋Œ€ํ•œ ์„ค๊ณ„ ์†๋„์žฅ ๊ณ„์‚ฐ ๋ฐ ์ตœ์  ์„ค๊ณ„๊ธฐ๋ฒ•์„ ์ œ์•ˆํ•˜๋ฉฐ ํŠนํžˆ ๊ณก๋ฉด์— ๊ตฌ์†๋œ ๋น” ๊ตฌ์กฐ๋ฌผ์˜ ์„ค๊ณ„๋ฅผ ์ง‘์ค‘์ ์œผ๋กœ ๋‹ค๋ฃฌ๋‹ค. ์ž์œ ํ˜•์ƒ๋ณ€ํ˜•(Free-form deformation)๊ธฐ๋ฒ•๊ณผ ์ „์—ญ ๊ณก์„  ๋ณด๊ฐ„๊ธฐ๋ฒ•์„ ํ™œ์šฉํ•˜์—ฌ ์ง์‚ฌ๊ฐ ํ‰๋ฉด์—์„œ ํ˜•์ƒ ๋ฐ ์„ค๊ณ„ ๋ณ€์ˆ˜๋ฅผ ์ •์˜ํ•˜๊ณ  ๊ณก๋ฉด์ƒ์˜ ๊ณก์„  ํ˜•์ƒ์„ ๋‚˜ํƒ€๋‚ด๋Š” ์กฐ์ •์  ์œ„์น˜๋ฅผ ํ•ด์„์ ์œผ๋กœ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ ์ด์˜ ์ „๋ฏธ๋ถ„์„ ํ†ตํ•ด ์ •ํ™•ํ•œ ์„ค๊ณ„์†๋„์žฅ์„ ๊ณ„์‚ฐํ•œ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์„ค๊ณ„ ๋ณ€์ˆ˜์˜ ๊ฐœ์ˆ˜๋ฅผ ์ค„์ผ ์ˆ˜ ์žˆ๊ณ  ์„ค๊ณ„์˜ ๋งค๊ฐœํ™”๊ฐ€ ๊ฐ„ํŽธํ•ด์ง„๋‹ค. ๊ฐœ๋ฐœ๋œ ๋ฐฉ๋ฒ•๋ก ์€ ๋‹ค์–‘ํ•œ ํ•˜์ค‘ ๋ฐ ์šด๋™ํ•™์  ๊ฒฝ๊ณ„์กฐ๊ฑด์„ ๊ฐ–๋Š” ๋น”๊ณผ ์‰˜์˜ ๋Œ€๋ณ€ํ˜• ๋ฌธ์ œ๋ฅผ ํ†ตํ•ด ๊ฒ€์ฆ๋˜๋ฉฐ ์—ฌ๋Ÿฌ๊ฐ€์ง€ ํœ˜์–ด์ง„ ์กฐ๋ฆฝ ๊ตฌ์กฐ๋ฌผ์˜ ์ตœ์  ์„ค๊ณ„์— ์ ์šฉ๋œ๋‹ค. ๋Œ€ํ‘œ์ ์œผ๋กœ, ์ „๋‹จ ๊ฐ•์„ฑ ๋ฐ ์ถฉ๊ฒฉ ํก์ˆ˜ ํŠน์„ฑ๊ณผ ๊ฐ™์€ ๊ธฐ๊ณ„์  ๋ฌผ์„ฑ์น˜์˜ ๊ฐœ์„ ์„ ์œ„ํ•ด ํ™œ์šฉ๋˜๋Š” ์˜ค๊ทธ์ œํ‹ฑ (auxetic) ํŠน์„ฑ์ด ๊ทน๋Œ€ํ™”๋œ ๊ฒฉ์ž ๊ตฌ์กฐ๋ฅผ ์„ค๊ณ„ํ•˜๋ฉฐ ์ธ์žฅ ๋ฐ ์••์ถ• ๋Œ€๋ณ€ํ˜• ๋ชจ๋‘์—์„œ ์ผ์ •ํ•œ ์Œ์˜ ํฌ์•„์†ก๋น„๋ฅผ ๋‚˜ํƒ€๋ƒ„์„ 3์ฐจ์› ํ”„๋ฆฐํŒ…๊ณผ ๊ด‘ํ•™์  ๋ณ€ํ˜• ์ธก์ • ๊ธฐ์ˆ ์„ ์ด์šฉํ•˜์—ฌ ์‹คํ—˜์ ์œผ๋กœ ๊ฒ€์ฆํ•œ๋‹ค. ๋˜ํ•œ ์šฐ๋ฆฌ๋Š” ์†Œ์Œ์˜ ์ €๊ฐ์„ ์œ„ํ•ด ํ™œ์šฉ๋˜๋Š” ๊ฐ€์ฒญ ์ €์ฃผํŒŒ์ˆ˜ ์˜์—ญ๋Œ€์—์„œ์˜ ๋ฐด๋“œ๊ฐญ์ด ๊ทน๋Œ€ํ™”๋œ ๊ฒฉ์ž ๊ตฌ์กฐ๋ฅผ ์ œ์‹œํ•œ๋‹ค.Abstract 1. Introduction 2. Isogeometric analysis of geometrically exact nonlinear structures 3. Isogeometric confinguration DSA of geometrically exact nonlinear structures 4. Numerical examples 5. Conclusions and future works A. Supplements to the geometrically exact Kirchhoff beam model B. Supplements to the geometrically exact shear-deformable beam model C. Supplements to the geometrically exact shear-deformable shell model D. Supplements to the invariant formulations E. Supplements to the geometric constraints in design optimization F. Supplements to the design of auxetic structures ์ดˆ๋กDocto

    Recent Progress in Optical Fiber Research

    Get PDF
    This book presents a comprehensive account of the recent progress in optical fiber research. It consists of four sections with 20 chapters covering the topics of nonlinear and polarisation effects in optical fibers, photonic crystal fibers and new applications for optical fibers. Section 1 reviews nonlinear effects in optical fibers in terms of theoretical analysis, experiments and applications. Section 2 presents polarization mode dispersion, chromatic dispersion and polarization dependent losses in optical fibers, fiber birefringence effects and spun fibers. Section 3 and 4 cover the topics of photonic crystal fibers and a new trend of optical fiber applications. Edited by three scientists with wide knowledge and experience in the field of fiber optics and photonics, the book brings together leading academics and practitioners in a comprehensive and incisive treatment of the subject. This is an essential point of reference for researchers working and teaching in optical fiber technologies, and for industrial users who need to be aware of current developments in optical fiber research areas

    Modelaรงรฃo e simulaรงรฃo de fenรณmenos nรฃo-lineares em fibras รณpticas microestruturadas

    Get PDF
    This Ph.D. embraced the study of the nonlinear optical phenomena occurring in microstructured optical _bres (MOFs), also called photonic crystal fibres (PCFs). In these fibres, there are the solid-core MOFs (SC-MOFs) and the hollow-core MOFs (HC-MOFs), which allow guided propagation of light in a diversity of conditions that are not possible with conventional fibres. The mechanisms of guidance of these fibres were studied, which for SC-MOFs and HC-MOFs included the computation of the guided modes, and for the latter included also the calculation of photonic bands, bandgaps, and density of states. In addition, the dispersion curves and the nonlinearity coefficients of SC-MOFs and of gas-filled HC-MOFs were calculated. The nonlinear propagation of ultra-short pulses of light in those fibres was modeled and simulated. With the simulations of this work, the supercontinuum generation, and the UV-light generation were predicted in certain conditions. In the last part of this work the electromagnetically induced transparency effect in hollow core fibres was investigated in detail.Este trabalho de doutoramento englobou o estudo de fenรณmenos รณpticos nรฃo-lineares que ocorrem em fibras รณpticas microestruturadas (MOFs), tambรฉm chamadas fibras de cristais fotรณnicos (PCFs). Nestas fibras, temos as fibras microestruturadas de nรบcleo solido (SC-MOFs) e as fibras microestruturadas de nรบcleo oco (HC-MOFs), que permitem a guiagem de luz numa diversidade de condiรงรตes nรฃo atingidas com as fibras convencionais. Estudou-se os mecanismos de guiagem de luz nestas fibras, o que quer para as SC-MOFs quer para as HC-MOFs incluiu a obtenรงรฃo dos modos de propagacรฃo, e para estas รบltimas incluiu ainda o calculo das bandas fotรณnicas, bandas proรญbidas, e densidade de estados. Por outro lado, as curvas de dispersรฃo e os coeficientes nรฃo-lineares de SC-MOFs e HC-MOFs preenchidas com gases foram calculados. Tambรฉm se efectuou a modelaรงรฃo e a simulaรงรฃo da propagaรงรฃo nรฃo-linear de impulsos ultra-curtos nestas fibras. Com as simulaรงรตes deste trabalho, foi prevista a geraรงรฃo do supercontรญnuo e de luz ultravioleta em certas condiรงรตes. Na ultima parte deste trabalho o efeito da transparรชncia electromagneticamente induzida em fibras de nรบcleo oco foi investigado em detalhe.Programa Doutoral em Fรญsic

    Nonlinear Frequency Conversion of Photons for Quantum Networks

    Get PDF

    The Fifth Annual Thermal and Fluids Analysis Workshop

    Get PDF
    The Fifth Annual Thermal and Fluids Analysis Workshop was held at the Ohio Aerospace Institute, Brook Park, Ohio, cosponsored by NASA Lewis Research Center and the Ohio Aerospace Institute, 16-20 Aug. 1993. The workshop consisted of classes, vendor demonstrations, and paper sessions. The classes and vendor demonstrations provided participants with the information on widely used tools for thermal and fluid analysis. The paper sessions provided a forum for the exchange of information and ideas among thermal and fluids analysts. Paper topics included advances and uses of established thermal and fluids computer codes (such as SINDA and TRASYS) as well as unique modeling techniques and applications

    Automatic video segmentation employing object/camera modeling techniques

    Get PDF
    Practically established video compression and storage techniques still process video sequences as rectangular images without further semantic structure. However, humans watching a video sequence immediately recognize acting objects as semantic units. This semantic object separation is currently not reflected in the technical system, making it difficult to manipulate the video at the object level. The realization of object-based manipulation will introduce many new possibilities for working with videos like composing new scenes from pre-existing video objects or enabling user-interaction with the scene. Moreover, object-based video compression, as defined in the MPEG-4 standard, can provide high compression ratios because the foreground objects can be sent independently from the background. In the case that the scene background is static, the background views can even be combined into a large panoramic sprite image, from which the current camera view is extracted. This results in a higher compression ratio since the sprite image for each scene only has to be sent once. A prerequisite for employing object-based video processing is automatic (or at least user-assisted semi-automatic) segmentation of the input video into semantic units, the video objects. This segmentation is a difficult problem because the computer does not have the vast amount of pre-knowledge that humans subconsciously use for object detection. Thus, even the simple definition of the desired output of a segmentation system is difficult. The subject of this thesis is to provide algorithms for segmentation that are applicable to common video material and that are computationally efficient. The thesis is conceptually separated into three parts. In Part I, an automatic segmentation system for general video content is described in detail. Part II introduces object models as a tool to incorporate userdefined knowledge about the objects to be extracted into the segmentation process. Part III concentrates on the modeling of camera motion in order to relate the observed camera motion to real-world camera parameters. The segmentation system that is described in Part I is based on a background-subtraction technique. The pure background image that is required for this technique is synthesized from the input video itself. Sequences that contain rotational camera motion can also be processed since the camera motion is estimated and the input images are aligned into a panoramic scene-background. This approach is fully compatible to the MPEG-4 video-encoding framework, such that the segmentation system can be easily combined with an object-based MPEG-4 video codec. After an introduction to the theory of projective geometry in Chapter 2, which is required for the derivation of camera-motion models, the estimation of camera motion is discussed in Chapters 3 and 4. It is important that the camera-motion estimation is not influenced by foreground object motion. At the same time, the estimation should provide accurate motion parameters such that all input frames can be combined seamlessly into a background image. The core motion estimation is based on a feature-based approach where the motion parameters are determined with a robust-estimation algorithm (RANSAC) in order to distinguish the camera motion from simultaneously visible object motion. Our experiments showed that the robustness of the original RANSAC algorithm in practice does not reach the theoretically predicted performance. An analysis of the problem has revealed that this is caused by numerical instabilities that can be significantly reduced by a modification that we describe in Chapter 4. The synthetization of static-background images is discussed in Chapter 5. In particular, we present a new algorithm for the removal of the foreground objects from the background image such that a pure scene background remains. The proposed algorithm is optimized to synthesize the background even for difficult scenes in which the background is only visible for short periods of time. The problem is solved by clustering the image content for each region over time, such that each cluster comprises static content. Furthermore, it is exploited that the times, in which foreground objects appear in an image region, are similar to the corresponding times of neighboring image areas. The reconstructed background could be used directly as the sprite image in an MPEG-4 video coder. However, we have discovered that the counterintuitive approach of splitting the background into several independent parts can reduce the overall amount of data. In the case of general camera motion, the construction of a single sprite image is even impossible. In Chapter 6, a multi-sprite partitioning algorithm is presented, which separates the video sequence into a number of segments, for which independent sprites are synthesized. The partitioning is computed in such a way that the total area of the resulting sprites is minimized, while simultaneously satisfying additional constraints. These include a limited sprite-buffer size at the decoder, and the restriction that the image resolution in the sprite should never fall below the input-image resolution. The described multisprite approach is fully compatible to the MPEG-4 standard, but provides three advantages. First, any arbitrary rotational camera motion can be processed. Second, the coding-cost for transmitting the sprite images is lower, and finally, the quality of the decoded sprite images is better than in previously proposed sprite-generation algorithms. Segmentation masks for the foreground objects are computed with a change-detection algorithm that compares the pure background image with the input images. A special effect that occurs in the change detection is the problem of image misregistration. Since the change detection compares co-located image pixels in the camera-motion compensated images, a small error in the motion estimation can introduce segmentation errors because non-corresponding pixels are compared. We approach this problem in Chapter 7 by integrating risk-maps into the segmentation algorithm that identify pixels for which misregistration would probably result in errors. For these image areas, the change-detection algorithm is modified to disregard the difference values for the pixels marked in the risk-map. This modification significantly reduces the number of false object detections in fine-textured image areas. The algorithmic building-blocks described above can be combined into a segmentation system in various ways, depending on whether camera motion has to be considered or whether real-time execution is required. These different systems and example applications are discussed in Chapter 8. Part II of the thesis extends the described segmentation system to consider object models in the analysis. Object models allow the user to specify which objects should be extracted from the video. In Chapters 9 and 10, a graph-based object model is presented in which the features of the main object regions are summarized in the graph nodes, and the spatial relations between these regions are expressed with the graph edges. The segmentation algorithm is extended by an object-detection algorithm that searches the input image for the user-defined object model. We provide two objectdetection algorithms. The first one is specific for cartoon sequences and uses an efficient sub-graph matching algorithm, whereas the second processes natural video sequences. With the object-model extension, the segmentation system can be controlled to extract individual objects, even if the input sequence comprises many objects. Chapter 11 proposes an alternative approach to incorporate object models into a segmentation algorithm. The chapter describes a semi-automatic segmentation algorithm, in which the user coarsely marks the object and the computer refines this to the exact object boundary. Afterwards, the object is tracked automatically through the sequence. In this algorithm, the object model is defined as the texture along the object contour. This texture is extracted in the first frame and then used during the object tracking to localize the original object. The core of the algorithm uses a graph representation of the image and a newly developed algorithm for computing shortest circular-paths in planar graphs. The proposed algorithm is faster than the currently known algorithms for this problem, and it can also be applied to many alternative problems like shape matching. Part III of the thesis elaborates on different techniques to derive information about the physical 3-D world from the camera motion. In the segmentation system, we employ camera-motion estimation, but the obtained parameters have no direct physical meaning. Chapter 12 discusses an extension to the camera-motion estimation to factorize the motion parameters into physically meaningful parameters (rotation angles, focal-length) using camera autocalibration techniques. The speciality of the algorithm is that it can process camera motion that spans several sprites by employing the above multi-sprite technique. Consequently, the algorithm can be applied to arbitrary rotational camera motion. For the analysis of video sequences, it is often required to determine and follow the position of the objects. Clearly, the object position in image coordinates provides little information if the viewing direction of the camera is not known. Chapter 13 provides a new algorithm to deduce the transformation between the image coordinates and the real-world coordinates for the special application of sport-video analysis. In sport videos, the camera view can be derived from markings on the playing field. For this reason, we employ a model of the playing field that describes the arrangement of lines. After detecting significant lines in the input image, a combinatorial search is carried out to establish correspondences between lines in the input image and lines in the model. The algorithm requires no information about the specific color of the playing field and it is very robust to occlusions or poor lighting conditions. Moreover, the algorithm is generic in the sense that it can be applied to any type of sport by simply exchanging the model of the playing field. In Chapter 14, we again consider panoramic background images and particularly focus ib their visualization. Apart from the planar backgroundsprites discussed previously, a frequently-used visualization technique for panoramic images are projections onto a cylinder surface which is unwrapped into a rectangular image. However, the disadvantage of this approach is that the viewer has no good orientation in the panoramic image because he looks into all directions at the same time. In order to provide a more intuitive presentation of wide-angle views, we have developed a visualization technique specialized for the case of indoor environments. We present an algorithm to determine the 3-D shape of the room in which the image was captured, or, more generally, to compute a complete floor plan if several panoramic images captured in each of the rooms are provided. Based on the obtained 3-D geometry, a graphical model of the rooms is constructed, where the walls are displayed with textures that are extracted from the panoramic images. This representation enables to conduct virtual walk-throughs in the reconstructed room and therefore, provides a better orientation for the user. Summarizing, we can conclude that all segmentation techniques employ some definition of foreground objects. These definitions are either explicit, using object models like in Part II of this thesis, or they are implicitly defined like in the background synthetization in Part I. The results of this thesis show that implicit descriptions, which extract their definition from video content, work well when the sequence is long enough to extract this information reliably. However, high-level semantics are difficult to integrate into the segmentation approaches that are based on implicit models. Intead, those semantics should be added as postprocessing steps. On the other hand, explicit object models apply semantic pre-knowledge at early stages of the segmentation. Moreover, they can be applied to short video sequences or even still pictures since no background model has to be extracted from the video. The definition of a general object-modeling technique that is widely applicable and that also enables an accurate segmentation remains an important yet challenging problem for further research
    • โ€ฆ
    corecore