Alakzatok lineáris deformációinak becslése és orvosi alkalmazásai = Estimation of Linear Shape Deformations and its Medical Applications

A projekt fő eredménye egy általánosan használható, teljesen automatikus alakzat regisztrációs módszer, amely az alábbi tulajdonságokkal rendelkezik: • nincs szükség pontmegfeleltetésekre illetve iteratív optimalizáló algoritmusokra; • képes 2D lineáris és (invertálható) projektív deformációk, valamint 3D affin deformációk meghatározására; • robusztus a geometriai és szegmentálási hibákra; • lineáris időkomplexitású, ami lehetővé teszi nagy felbontású képek közel valós idejű illesztését. Publikusan elérhetővé tettünk 3 demó programot, amelyek a 2D és 3D affin, valamint síkhomográfia regisztrációs algoritmusainkat implementálják. Továbbá kifejlesztettünk egy prototípus szoftvert csípőprotézis röntgenképek illesztésére, amit átadtunk a projektben közreműködő radiológusoknak további felhasználásra. Az eredményeinket a terület vezető konferenciáin ( pl. ICCV, ECCV) illetve vezető folyóiratokban (pl. IEEE Transactions on Pattern Analysis and Machine Intelligence, Pattern Recognition). A projekten dolgozó egyik MSc hallgató második helyezést ért el az OTDK-n. Domokos Csaba PhD fokozatot szerzett, továbbá munkáját Kuba Attila díjjal ismerte el a Képfeldolgozók és Alakfelismerők Társasága. A projekt eredményeiről részletesebb információ a projekt honlapokon található: • http://www.inf.u-szeged.hu/ipcg/projects/AFFSHAPE.html • http://www.inf.u-szeged.hu/ipcg/projects/AffinePuzzle.html • http://www.inf.u-szeged.hu/ipcg/projects/diffeoshape.html | The main achievement of the project is a fully functional automatic shape registration method with the following properties: • it doesn’t need established point correspondences nor the use of iterative optimization algorithms; • capable of recovering 2D linear and (invertible) projective shape deformations as well as affine distortions of 3D shapes; • robust in the presence of geometric noise and segmentation errors; • has a linear time complexity allowing near real-time registration of high resolution images. 3 demo programs are publicly available implementing our affine 2D, 3D and planar homography registration algorithms. Furthermore, we have developed a prototype software for aligning hip prosthesis X-ray images, which has been transfered to collaborating radiologists for further exploitation. Our results have been presented at top conferences (e.g. ICCV, ECCV) and in leading journals (e.g. IEEE Trans. on Patt. Anal. & Mach. Intell., Patt. Rec.). An MSc student working on the project received the second price of the National Scientific Student Conference. Csaba Domokos obtained his PhD degree and his work has been awarded the Attila Kuba Prize of the Hungarian Association for Image Processing and Pattern Recognition. More details about our results can be found at: • http://www.inf.u-szeged.hu/ipcg/projects/AFFSHAPE.html • http://www.inf.u-szeged.hu/ipcg/projects/AffinePuzzle.html • http://www.inf.u-szeged.hu/ipcg/projects/diffeoshape.htm

Online Mutual Foreground Segmentation for Multispectral Stereo Videos

The segmentation of video sequences into foreground and background regions is a low-level process commonly used in video content analysis and smart surveillance applications. Using a multispectral camera setup can improve this process by providing more diverse data to help identify objects despite adverse imaging conditions. The registration of several data sources is however not trivial if the appearance of objects produced by each sensor differs substantially. This problem is further complicated when parallax effects cannot be ignored when using close-range stereo pairs. In this work, we present a new method to simultaneously tackle multispectral segmentation and stereo registration. Using an iterative procedure, we estimate the labeling result for one problem using the provisional result of the other. Our approach is based on the alternating minimization of two energy functions that are linked through the use of dynamic priors. We rely on the integration of shape and appearance cues to find proper multispectral correspondences, and to properly segment objects in low contrast regions. We also formulate our model as a frame processing pipeline using higher order terms to improve the temporal coherence of our results. Our method is evaluated under different configurations on multiple multispectral datasets, and our implementation is available online.Comment: Preprint accepted for publication in IJCV (December 2018

Feature-Based Probabilistic Data Association for Video-Based Multi-Object Tracking

This work proposes a feature-based probabilistic data association and tracking approach (FBPDATA) for multi-object tracking. FBPDATA is based on re-identification and tracking of individual video image points (feature points) and aims at solving the problems of partial, split (fragmented), bloated or missed detections, which are due to sensory or algorithmic restrictions, limited field of view of the sensors, as well as occlusion situations

Segmentation mutuelle d'objets d'intérêt dans des séquences d'images stéréo multispectrales

Les systèmes de vidéosurveillance automatisés actuellement déployés dans le monde sont encore bien loin de ceux qui sont représentés depuis des années dans les oeuvres de sciencefiction. Une des raisons derrière ce retard de développement est le manque d’outils de bas niveau permettant de traiter les données brutes captées sur le terrain. Le pré-traitement de ces données sert à réduire la quantité d’information qui transige vers des serveurs centralisés, qui eux effectuent l’interprétation complète du contenu visuel capté. L’identification d’objets d’intérêt dans les images brutes à partir de leur mouvement est un exemple de pré-traitement qui peut être réalisé. Toutefois, dans un contexte de vidéosurveillance, une méthode de pré-traitement ne peut généralement pas se fier à un modèle d’apparence ou de forme qui caractérise ces objets, car leur nature exacte n’est pas connue d’avance. Cela complique donc l’élaboration des méthodes de traitement de bas niveau. Dans cette thèse, nous présentons différentes méthodes permettant de détecter et de segmenter des objets d’intérêt à partir de séquences vidéo de manière complètement automatisée. Nous explorons d’abord les approches de segmentation vidéo monoculaire par soustraction d’arrière-plan. Ces approches se basent sur l’idée que l’arrière-plan d’une scène peut être modélisé au fil du temps, et que toute variation importante d’apparence non prédite par le modèle dévoile en fait la présence d’un objet en intrusion. Le principal défi devant être relevé par ce type de méthode est que leur modèle d’arrière-plan doit pouvoir s’adapter aux changements dynamiques des conditions d’observation de la scène. La méthode conçue doit aussi pouvoir rester sensible à l’apparition de nouveaux objets d’intérêt, malgré cette robustesse accrue aux comportements dynamiques prévisibles. Nous proposons deux méthodes introduisant différentes techniques de modélisation qui permettent de mieux caractériser l’apparence de l’arrière-plan sans que le modèle soit affecté par les changements d’illumination, et qui analysent la persistance locale de l’arrière-plan afin de mieux détecter les objets d’intérêt temporairement immobilisés. Nous introduisons aussi de nouveaux mécanismes de rétroaction servant à ajuster les hyperparamètres de nos méthodes en fonction du dynamisme observé de la scène et de la qualité des résultats produits.----------ABSTRACT: The automated video surveillance systems currently deployed around the world are still quite far in terms of capabilities from the ones that have inspired countless science fiction works over the past few years. One of the reasons behind this lag in development is the lack of lowlevel tools that allow raw image data to be processed directly in the field. This preprocessing is used to reduce the amount of information transferred to centralized servers that have to interpret the captured visual content for further use. The identification of objects of interest in raw images based on motion is an example of a reprocessing step that might be required by a large system. However, in a surveillance context, the preprocessing method can seldom rely on an appearance or shape model to recognize these objects since their exact nature cannot be known exactly in advance. This complicates the elaboration of low-level image processing methods. In this thesis, we present different methods that detect and segment objects of interest from video sequences in a fully unsupervised fashion. We first explore monocular video segmentation approaches based on background subtraction. These approaches are based on the idea that the background of an observed scene can be modeled over time, and that any drastic variation in appearance that is not predicted by the model actually reveals the presence of an intruding object. The main challenge that must be met by background subtraction methods is that their model should be able to adapt to dynamic changes in scene conditions. The designed methods must also remain sensitive to the emergence of new objects of interest despite this increased robustness to predictable dynamic scene behaviors. We propose two methods that introduce different modeling techniques to improve background appearance description in an illumination-invariant way, and that analyze local background persistence to improve the detection of temporarily stationary objects. We also introduce new feedback mechanisms used to adjust the hyperparameters of our methods based on the observed dynamics of the scene and the quality of the generated output

가상수술계획을 이용한 턱교정 수술의 정확도에 대한 연구

학위논문(박사) -- 서울대학교대학원 : 치과대학 치의과학과, 2021.8. 서병무.연구 목적: 최근 3차원 가상수술계획을 이용하여 턱교정 수술을 시행한 결과로서 수술 정확도에 대한 연구들이 보고되고 있다. 하지만 수술 정확도를 평가하기 위한 표준화된 방법이 없는 실정이며, 하악 과두를 포함하여 해부학적 위치별로 정확도를 분석한 연구는 거의 이루어지지 않았다. 본 연구의 목적은 계측점을 한번만 설정하면 되는 수학적 방법을 검증하고, 가상 계획과 수술 결과 간 오차의 정도와 분포를 각 해부학적 위치에 따라 분석함으로써 임상적 의미를 도출하는 것이다. 연구 방법: 본 연구는 한 명의 술자에 의해 상악과 하악을 함께 수술 받은 골격성 III 급 부정교합 환자들을 대상으로 하였다. 본 연구에서 사용한 가상수술계획은 콘빔 전산화 단층촬영 (cone beam computed tomography)과 치아 모델 스캔을 기반으로 하였다. 악안면 급속 조형 (rapid prototyping) 모델과 수술용 스플린트 (splint)를 3차원 프린팅을 이용하여 제작하였다. 급속 조형 모델 상에서 골절단을 위한 수술용 가이드를 제작하고 금속판을 미리 구부려 사용하였다. 수술 결과를 평가하기 위해 술후 콘빔 전산화 단층촬영을 시행하였다. 하악 우측 과두, 하악 좌측 과두, 상악 및 하악 원심 골편의 네 가지 해부학적 위치들을 10개의 계측점을 이용하여 분석하였다. 각 계측점은 어파인 (affine) 변환에 기반한 수학적 방법을 이용하여 일회 계측점 설정 방식으로 측정하였다. 이 수학적 방법으로 계측한 측정치 간의 일치도를 평가하였다. 수술 정확도는 가상 계획과 수술 결과의 차이로 정의하였다. 정확도는 1) 3차원 데카르트 공간에서 평균 3차원 거리 오차, 2) 수평축, 수직축 및 전후축 평균 절대 오차, 3) 수평축, 수직축 및 전후축 평균 부호 오차의 3가지로 분석하였다. 다차원 산점도를 이용하여 평균 부호 오차를 도시하였다. 해부학적 위치와 수술 정확도 간 연관성을 측정하기 위해 이변량 분석과 회귀 분석을 시행하였다. 수술 정확도에 영향을 미치는 요인을 규명하기 위해, 상악의 수술 계획에 따른 정확도와 상악의 오차에 따른 정확도를 분석하였다. 결과: 본 연구는 남성 26명, 여성 26의 총 52명의 환자를 대상으로 하였고, 평균 나이 21세 3개월이었다. 일회 계측점 설정을 위한 수학적 방법은 측정치 간 뛰어난 일치도를 보였다. 하악 우측 과두, 하악 좌측 과두, 상악 및 하악 원심 골편의 평균 3차원 거리 오차는 각각 0.95, 1.12, 1.25 및 2.24 mm 였다. 세 좌표축 중 최대 오차를 보인 좌표축의 평균 절대 오차는, 하악 우측 과두, 하악 좌측 과두 및 하악 원심 골편은 모두 수직 성분으로 각각 0.51, 0.66 및 1.40 mm 였고, 상악은 전후방 성분으로 0.68 mm 였다. 세 좌표축 중 최대 오차를 보인 좌표축의 평균 부호 오차는, 하악 우측 과두, 하악 좌측 과두 및 하악 원심 골편은 모두 계획한 위치보다 하방 성분으로 각각 0.42, 0.57 및 1.25 mm 였고, 상악은 계획한 위치보다 전방 성분으로 0.28 mm 였다. 하악 원심 골편의 오차 분포가 과두와 상악보다 더 넓은 분포를 보였다. 상악과 과두의 오차는 상악을 전진시킬 때 보다 후퇴시킬 때 오차가 더 증가하였다. 하악 원심 골편의 오차는 상악의 상방 이동량이 계획량보다 작은 경우 더 증가하였다. 결론: 턱교정 수술의 정확도 분석에 본 연구의 계측점 설정 방법을 신뢰성 있게 사용할 수 있다. 가상수술계획을 이용한 턱교정 수술의 정확도는 해부학적 위치 중 하악 우측 과두와 좌측 과두가 가장 정확했고, 이어서 상악, 그리고 하악 원심 골편 순으로 정확했다. 수술 정확도는 상악의 수술 계획과 상악의 오차에 영향을 받았다. 정확한 턱교정 수술을 위해서는 각 해부학적 위치에서 수술 오차의 경향성을 고려하는 것이 중요하다.Purpose: In orthognathic surgery with three-dimensional virtual surgical planning, surgical accuracy has been investigated. However, there is no standardized method for assessing surgical accuracy, and detailed analysis of accuracy according to anatomic locations including the mandibular condyle, remains insufficient. The purpose of this study was to validate a computational method for one-time landmark setting and to analyze the degree and distribution of errors between the virtual plans and surgical outcomes according to anatomic locations. Patients and Methods: This study included skeletal class III patients treated with both maxillary and mandibular surgeries by one operator. Virtual surgical planning in this study was based on cone beam computerized tomography (CBCT) and dental model scan. Maxillofacial rapid prototyping (RP) models and surgical splints were fabricated using three-dimensional (3D) printing. Surgical guides for jaw osteotomy and pre-bent plates for fixation were fabricated on the RP models. Post-operative CBCT scans were obtained to evaluate surgical outcomes. Four anatomic locations consisting of the mandibular right and left condyles, maxilla, and distal segment of the mandible were analyzed using 10 landmarks. Landmarks were identified using the computational method based on affine transformation with one-time landmark setting. Agreement among measurements using the computational method was evaluated. Surgical accuracy was defined as the difference between the virtual plans and surgical outcomes. The accuracy was assessed using three kinds of errors: 1) a mean 3D distance error in the 3D Euclidean space, 2) mean absolute errors along the horizontal, vertical, and anteroposterior axes, and 3) mean signed errors along the three axes. The mean signed errors were visualized with multi-dimensional scattergrams. Bivariate and regression statistics were computed to measure the association between the anatomic location and surgical accuracy. Surgical accuracy according to the surgical plan for the maxilla and the accuracy according to the error in the maxilla were analyzed to investigate the factors affecting the accuracy. Results: This study included 52 patients, 26 men and 26 women, with a mean age of 21 years and 3 months. The computational method for one-time landmark setting demonstrated excellent agreement among the measurements. The mean 3D distance errors for the mandibular right and left condylar landmarks, maxillary landmarks, and landmarks on the distal segment of the mandible were 0.95, 1.12, 1.25, and 2.24 mm, respectively. The largest mean absolute errors among the three axes for the mandibular right and left condylar landmarks and the landmarks on the distal segment of the mandible were 0.51, 0.66, and 1.40 mm along the vertical axis, respectively. The largest mean absolute errors among the three axes for maxillary landmarks was 0.68 mm along the anteroposterior axis. The mean signed errors showed that the mandibular right and left condylar landmarks and the landmarks on the distal segment of the mandible were positioned 0.42, 0.57, and 1.25 mm inferior, respectively, and the maxillary landmarks were positioned 0.28 mm anterior to the planned position. The landmark errors for the distal segment of the mandible exhibited wider distributions compared to those for the condylar and maxillary landmarks. The errors for the condyles and maxilla were higher in maxillary setback than in maxillary advancement. The errors for the distal segment of the mandible were higher in cases where the amount of the maxillary impaction was smaller than the amount planned. Conclusion: The landmark setting method in this study can be applied reliably for assessment of surgical accuracy in orthognathic surgery. Among the anatomic locations, the mandibular right and left condyles were the most accurate in orthognathic surgery using virtual surgical planning, followed by the maxilla, and the distal segment of the mandible. The accuracy was affected by the surgical plan for the maxilla and the error in the maxilla. For accurate orthognathic surgery, it is important to consider the tendency for surgical errors in each anatomic location.Abstract 1 Contents 4 I. Introduction 5 II. Patients and Methods 7 1. Study design and subjects 7 2. Anatomic locations and landmarks 8 3. Protocol of virtual surgical planning, operation, and analysis 9 4. Computational method for one-time landmark setting 11 5. Error definition 13 6. Accuracy according to surgical plan for maxilla and error in maxilla 15 7. Statistical analysis 16 III. Results 18 1. Detailed description of study subjects 18 2. Validation for landmark setting method 19 3. Accuracy according to anatomic location 20 3.1 Mean 3D distance error 20 3.2 Mean absolute error 20 3.3 Mean signed error 21 3.4 Multi-dimensional scattergram for mean signed error 22 3.5 Multiple linear regression for mean 3D distance error 23 4. Accuracy according to surgical plan for maxilla 24 5. Accuracy according to error in maxilla 26 IV. Discussion 28 1. Accuracy according to anatomic location 28 2. Accuracy criteria 32 3. Comparison with recent studies 33 4. Effects of surgical plan for maxilla and error in maxilla 38 5. Accurate condylar position 40 V. Conclusions 42 References 43 Tables 50 Figures 60 국문 초록 83박

Grammalepsy

This book is available as open access through the Bloomsbury Open Access programme and is available on www.bloomsburycollections.com. Collecting and recontextualizing writings from the last twenty years of John Cayley's research-based practice of electronic literature, Grammalepsy introduces a theory of aesthetic linguistic practice developed specifically for the making and critical appreciation of language art in digital media. As he examines the cultural shift away from traditional print literature and the changes in our culture of reading, Cayley coins the term “grammalepsy” to inform those processes by which we make, understand, and appreciate language. Framing his previous writings within the overall context of this theory, Cayley eschews the tendency of literary critics and writers to reduce aesthetic linguistic making-even when it has multimedia affordances-to “writing.” Instead, Cayley argues that electronic literature and digital language art allow aesthetic language makers to embrace a compositional practice inextricably involved with digital media, which cannot be reduced to print-dependent textuality

Computational Intelligence and Human- Computer Interaction: Modern Methods and Applications

The present book contains all of the articles that were accepted and published in the Special Issue of MDPI’s journal Mathematics titled "Computational Intelligence and Human–Computer Interaction: Modern Methods and Applications". This Special Issue covered a wide range of topics connected to the theory and application of different computational intelligence techniques to the domain of human–computer interaction, such as automatic speech recognition, speech processing and analysis, virtual reality, emotion-aware applications, digital storytelling, natural language processing, smart cars and devices, and online learning. We hope that this book will be interesting and useful for those working in various areas of artificial intelligence, human–computer interaction, and software engineering as well as for those who are interested in how these domains are connected in real-life situations

Sacramental Magic and Animate Statues in Edmund Spenser, William Shakespeare, and John Milton

"Sacramental Magic" explores the animate statue in early modem romance as an emblem of the potential spiritually transformative power of objects. The tendency of New Historicism to "empty out" theology from Catholicism overlooks the continued power of sacred objects in Reformation literature. My dissertation joins the recent turn to religion in early modern studies--Catholic doctrine and religious experience explain the startling presence of benevolent animate statues in Spenser, Shakespeare, and Milton; one would expect these statues to be empty idols, but instead they animate, revealing a real presence of the divine. I first investigate Spenser's Egyptian lexicon for the Catholic veneration of sacred images in the Temple of Isis in the Faerie Queene. Embedding Britomart's dream vision of an English empire in Egyptian mythology creates a translatio imperii from Egypt to Rome to England, transferring not only political but also religious power. The Isis statue's transformation of Britomart bears striking textual and visual correlations to John Dee's hermetic Monas Hieroglyphica. For Shakespeare, ermetic magic emblematizes the sacrament of penance. Shakespeare's claim "to make men glorious" suggests that Pericles transforms its audience by effecting, not merely signifying, grace. The play emblematizes the restorative aspects of reconciliation, the antidote to the seven deadly sins, with alchemical and medical imagery, culminating in Cerimon's reanimation of Thaisa through an Egyptian magic based on the hermetic ritual to ensoul statues. The Winter's Tale continues Shakespeare's meditation upon the emotional metamorphoses produced by reconciliation. I argue that Shakespeare creates an affective communion among the audience members and the characters, an effect similar to the workings of the Holy Spirit in a Mass, emblematized by the hermetic animation of Hermione. The final chapter examines the Catholic and hermetic parallels in Milton's "Il Penseroso" and Comus. In both works, Milton traces a shared system of correspondences underlying Catholicism and hermeticism in order to explore the relationship between objects and the immaterial, through angelology, Ficinian music theory, the contemplative lives of nuns, the Catholic sacrament of Extreme Unction, and ritual exorcism

Aerial Vehicles

This book contains 35 chapters written by experts in developing techniques for making aerial vehicles more intelligent, more reliable, more flexible in use, and safer in operation.It will also serve as an inspiration for further improvement of the design and application of aeral vehicles. The advanced techniques and research described here may also be applicable to other high-tech areas such as robotics, avionics, vetronics, and space