PERANCANGAN VISUALISASI KERIS 3D DENGAN LAYANAN AUGMENTED REALITY CLOUD-RECOGNITION

Salah satu obyek budaya tradisional yang populer adalah keris. Senjata tradisional ini memiliki bentuk yang indah. Pengetahuan masyarakat mengenai keris semakin berkurang, hal ini karena media yang digunakan untuk memperkenalkan keris yang kurang menarik dan sulit diperoleh. Oleh karena itu dibutuhkan suatu media baru untuk memperkenalkan keris kepada masyarakat luas. Pengguna dapat dengan mudah memindai ponsel mereka pada media yang disediakan dan memperoleh data tentang keris. Obyek keris akan dibuat virtual sehingga dapat dikenal dengan cukup menarik oleh masyarakat. Obyek keris akan dimodelkan secara 3 dimensi, lalu digabungkan dengan pola penanda. Dengan menggunakan teknologi Augmented Reality maka diharapkan dapat menggabungkan obyek keris secara virtual dengan pola penanda pada media promosi. Pembuatan Augmented Reality obyek keris ini memanfaatkan fitur-fitur dari layanan Vuforia, AutoCad123D, dan Unity Game Designer. Vuforia menyediakan fitur pengenalan pola Augmented Reality secara remote. Autocad123D menyediakan layanan pemodelan 3D dengan baik. Unity game designer menyediakan layanan untuk menggabungkan kedua layanan Vuforia dan Autocad123D. Dengan menggunakan layanan tersebut maka akan didapatkan aplikasi yang cukup ringan, mengurangi beban komputasi pada client, menjadi lebih ramah memori, dan kemudahan dalam memperbarui aplikasi di pihak client

PERANCANGAN VISUALISASI KERIS 3D DENGAN LAYANAN AUGMENTED REALITY CLOUD-RECOGNITION

Salah satu obyek budaya tradisional yang populer adalah keris. Senjata tradisional ini memiliki bentuk yang indah. Pengetahuan masyarakat mengenai keris semakin berkurang, hal ini karena media yang digunakan untuk memperkenalkan keris yang kurang menarik dan sulit diperoleh. Oleh karena itu dibutuhkan suatu media baru untuk memperkenalkan keris kepada masyarakat luas. Pengguna dapat dengan mudah memindai ponsel mereka pada media yang disediakan dan memperoleh data tentang keris. Obyek keris akan dibuat virtual sehingga dapat dikenal dengan cukup menarik oleh masyarakat. Obyek keris akan dimodelkan secara 3 dimensi, lalu digabungkan dengan pola penanda. Dengan menggunakan teknologi Augmented Reality maka diharapkan dapat menggabungkan obyek keris secara virtual dengan pola penanda pada media promosi. Pembuatan Augmented Reality obyek keris ini memanfaatkan fitur-fitur dari layanan Vuforia, AutoCad123D, dan Unity Game Designer. Vuforia menyediakan fitur pengenalan pola Augmented Reality secara remote. Autocad123D menyediakan layanan pemodelan 3D dengan baik. Unity game designer menyediakan layanan untuk menggabungkan kedua layanan Vuforia dan Autocad123D. Dengan menggunakan layanan tersebut maka akan didapatkan aplikasi yang cukup ringan, mengurangi beban komputasi pada client, menjadi lebih ramah memori, dan kemudahan dalam memperbarui aplikasi di pihak client

Fuzzy-Logic Based Detection and Characterization of Junctions and Terminations in Fluorescence Microscopy Images of Neurons

Digital reconstruction of neuronal cell morphology is an important step toward understanding the functionality of neuronal networks. Neurons are tree-like structures whose description depends critically on the junctions and terminations, collectively called critical points, making the correct localization and identification of these points a crucial task in the reconstruction process. Here we present a fully automatic method for the integrated detection and characterization of both types of critical points in fluorescence microscopy images of neurons. In view of the majority of our current studies, which are based on cultured neurons, we describe and evaluate the method for application to two-dimensional (2D) images. The method relies on directional filtering and angular profile analysis to extract essential features about the main streamlines at any location in an image, and employs fuzzy logic with carefully designed rules to reason about the feature values in order to make well-informed decisions about the presence of a critical point and its type. Experiments on simulated as well as real images of neurons demonstrate the detection performance of our method. A comparison with the output of two existing neuron reconstruction methods reveals that our method achieves substantially higher detection rates and could provide beneficial information to the reconstruction process

Automated Neuron Reconstruction from 3D Fluorescence Microscopy Images Using Sequential Monte Carlo Estimation

Microscopic images of neuronal cells provide essential structural information about the key constituents of the brain and form the basis of many neuroscientific studies. Computational analyses of the morphological properties of the captured neurons require first converting the structural information into digital tree-like reconstructions. Many dedicated computational methods and corresponding software tools have been and are continuously being developed with the aim to automate this step while achieving human-comparable reconstruction accuracy. This pursuit is hampered by the immense diversity and intricacy of neuronal morphologies as well as the often low quality and ambiguity of the images. Here we present a novel method we developed in an effort to improve the robustness of digital reconstruction against these complicating factors. The method is based on probabilistic filtering by sequential Monte Carlo estimation and uses prediction and update models designed specifically for tracing neuronal branches in microscopic image stacks. Moreover, it uses multiple probabilistic traces to arrive at a more robust, ensemble reconstruction. The proposed method was evaluated on fluorescence microscopy image stacks of single neurons and dense neuronal networks with expert manual annotations serving as the gold standard, as well as on synthetic images with known ground truth. The results indicate that our method performs well under varying experimental conditions and compares favorably to state-of-the-art alternative methods

Methods for Automated Neuron Image Analysis

Knowledge of neuronal cell morphology is essential for performing specialized analyses in the endeavor to understand neuron behavior and unravel the underlying principles of brain function. Neurons can be captured with a high level of detail using modern microscopes, but many neuroscientific studies require a more explicit and accessible representation than offered by the resulting images, underscoring the need for digital reconstruction of neuronal morphology from the images into a tree-like graph structure. This thesis proposes new computational methods for automated detection and reconstruction of neurons from fluorescence microscopy images. Specifically, the successive chapters describe and evaluate original solutions to problems such as the detection of landmarks (critical points) of the neuronal tree, complete tracing and reconstruction of the tree, and the detection of regions containing neurons in high-content screens

Tracing biofilaments from images : analysis of existing methods to quantify the three-dimensional growth of filamentous fungi on solid substrates

Orientador: Prof. Dr. David Alexander MitchellCoorientadora: Prof. Dr. Maura Harumi Sugai-GuériosDissertação (mestrado) - Universidade Federal do Paraná, Setor de Tecnologia, Programa de Pós-Graduação em Engenharia Química. Defesa : Curitiba, 29/05/2018Inclui referências: p.100-113Área de concentração: Engenharia QuímicaResumo: Análise de imagens de biofilamentos tem se tornado uma parte importante na pesquisa em biologia e biotecnologia, pois ela não só elucida a morfologia destas estruturas, mas também fornece ideias sobre o desenvolvimento destas estruturas. Além disso, a morfologia pode ser correlacionada com outras variáveis. Por exemplo, análise de imagem de fungos filamentosos permite correlacionar produtividade de enzimas com diferentes morfologias. Há um interesse em compreender como o micélio de um fungo filamentoso se desevolve ao crescer em substratos sólidos. Para estudar isso, foram obtidas imagens 3D do fungo em crescimento em diversos tempos, objetivando computar dados da morfologia e dinâmica de crescimento: velocidades de extensão da colônia e de pontas, número e posição de ramificações e pontas, comprimentos de segmentos, entre outros dados. Porém, antes de computar estes dados, foi feita uma análise da literatura de métodos de traçado de biofilamentos. A análise foi realizada para facilitar a compreensão do vasto número de métodos disponíveis, desde componentes individuais (e.g. técnicas de realçe de filamentos) a workflows completas de traçado de biofilamentos. Também há muitas opções de implementações de software. Na análise, foram incluídas 87 publicações envolvendo workflows de traçado de filamentos ou componentes. Para a análise, criou-se uma classificação (10 classes, que incluem interação com o usuário, abordagem teórica, técnica de imageamento, entre outras classes e 120 sub-classes) para apoiar a análise com o uso de conceitos de teoria de grafos. A metodologia proposta poderá ser utilizada no futuro com ferramentas de semântica web e uma base de dados e permitirá analisar um número maior de dados. Desta análise, identificaram-se os métodos mais comuns de melhoramento de imagem (Realçe de filamentos, 44.9%, suavização, 16.3% e Subtração de background 14.3%) e as tendências em abordagens teóricas (e.g. abordagens baseadas em grafos juntas à algoritmos de aprendizado de máquina, realçe de filamentos como o gradient vector flow seguidos de abordagem Levei-set fast-marching). Após a análise da literatura, foram selecionados os métodos de melhoramento mais comuns e avaliados segundo seu impacto na qualidade da imagem. Os testes foram realizados em duas amostras de imagem (experimentos do crescimento de Aspergillus niger de microscopia confocal de varredura a laser) através de um planejamento fatorial completo e análise do índice de similaridade estrutural, SSIM, e razão sinal-ruído, SNR. Resultados mostraram que o algoritmo rolling bali de subtração de background com raio 20 pixels teve o maior efeito positivo em SSIM e SNR no geral. Então, ao utilizar as imagens melhoradas como entrada, foram testados 5 métodos de traçado de filamentos (APP, APP2, NeuTube, NeuronStudio e NeuroGPS-Tree). Os resultados do traçado foram avaliados qualitativamente: O método NeuTube mostrou os resultados visualmente mais acurados. Definiu-se então o método e foram traçadas as imagens completas 3D e no tempo e obtivemos parâmetros morfométricos e da dinâmica do crescimento do fungo (perfis de biomassa e comprimentos totais, por exemplo). Embora se observe que o uso de traçado de filamentos é promisor para obter mais dados do crescimento de fungos filamentosos, discutiu-se a necessidade de aprimorar as técnicas de preparo de amostra e das configurações na aquisição das imagens, de maneira a aumentar a qualidade final das imagens e fornecer resultados mais confiáveis e concretos após o traçado para então tirar conclusões dos dados. Palavras-chave: fungos filamentosos, filamentos biológicos, análise de imagem, traçado de filamentos, melhoramento de imagem.Abstract: Image analysis of biofilaments is becoming an important part of research on biology and biotechnology because it does not only elucidates the morphology of such structures but also gives insights into their development. Additionally, the morphology can be correlated with other variables. For example, image analysis of filamentous fungi allows the correlation of enzyme productivity with different morphologies. We are interested in understanding how the mycelium of a filamentous fungus develops during growth on solid substrates. In order to study that, time-lapsed 3D images of the fungus during growth were obtained, with the intention of computing growth dynamics and morphometric data: colony and tip extension rates, number and positions of branches and tips, segment lengths, among others. However, prior to computing this data, we analysed the literature of biofilament tracing methods. The analysis was done to facilitate the understanding of the vast number of methods available, from single components (e.g. filament enhancement techniques, and specialized model-based approaches) to complete biofilament tracing workflows. There were also many software implementations options. The analysis comprised 87 publications proposing complete biofilament tracing workflows or workflow components. For the analysis, we created a classification methodology (10 main classes, including user interaction, theoretical approach, imaging technique, among other classes and 120 sub-classes) and analysed the publications using graph theory concepts. The proposed methodology could be used in the future with semantic web tools and crowd-sourced web-based databases, allowing the analysis of greater number of data. Out of this analysis, we identified the most common image enhancement methods (Filament enhancement 44.9%, smoothing 16.3%, background subtraction 14.3%) and the theoretical approach trends for biofilament tracing (e.g. graph-based approaches coupled with machine learning algorithms, image enhancement such as gradient vector flows followed by model-based fast marching approach). Following the literature analysis, we selected the most common image enhancement methods to be used prior to biofilament tracing and evaluated their impact on image quality. The tests were done on two sample images (experiments of the growth of Aspergillus niger on two different carbon sources obtained by confocal laser scanning microscopy) through a full factorial design of experiments and analysis of the structural similarity index, SSIM and signal-to-noise ratio, SNR. Results show that background subtraction (Rolling-ball algorithm, 20 pixels radius) had the most positive effect on SSIM and SNR. Then, using the enhanced images as input, we tested 5 different biofilament tracing methods (APP1, APP2, NeuTube, NeuronStudio and NeuroGPS-Tree). We evaluated the tracing results visually and qualitatively: NeuTube was the method with the most visually accurate results. After choosing NeuTube as the best method, we applied it to our complete 3D time-lapsed images and computed some growth dynamics and morphmetric parameters (e.g. biomass profiles, segment and total lengths). Although we indicate that biofilament tracing methods are a promising approach to obtain more data on the growth of the filamentous fungi, we discuss the need to improve the sample preparation techniques and image acquisition set-up in order to increase the quality of the images so the tracing results provide more reliable and concrete results to draw conclusions. Keywords: filamentous fungi, biological filaments, image analysis, filament tracing, image enhancement