66 research outputs found
Spectral methods for multimodal data analysis
Spectral methods have proven themselves as an important and versatile tool in a wide range of problems in the fields of computer graphics, machine learning, pattern recognition, and computer vision, where many important problems boil down to constructing a Laplacian operator and finding a few of its eigenvalues and eigenfunctions. Classical examples include the computation of diffusion distances on manifolds in computer graphics, Laplacian eigenmaps, and spectral clustering in machine learning. In many cases, one has to deal with multiple data spaces simultaneously. For example, clustering multimedia data in machine learning applications involves various modalities or ``views'' (e.g., text and images), and finding correspondence between shapes in computer graphics problems is an operation performed between two or more modalities. In this thesis, we develop a generalization of spectral methods to deal with multiple data spaces and apply them to problems from the domains of computer graphics, machine learning, and image processing. Our main construction is based on simultaneous diagonalization of Laplacian operators. We present an efficient numerical technique for computing joint approximate eigenvectors of two or more Laplacians in challenging noisy scenarios, which also appears to be the first general non-smooth manifold optimization method. Finally, we use the relation between joint approximate diagonalizability and approximate commutativity of operators to define a structural similarity measure for images. We use this measure to perform structure-preserving color manipulations of a given image
wEscore: quality assessment method of multichannel image visualization with regard to angular resolution
This work considers the problem of quality assessment of multichannel image visualization methods. One approach to such an assessment, the Escore quality measure, is studied. This measure, initially proposed for decolorization methods evaluation, can be generalized for the assessment of hyperspectral image visualization methods. It is shown that Escore does not account for the loss of local contrast at the supra-pixel scale. The sensitivity to the latter in humans depends on the observation conditions, so we propose a modified wEscore measure which includes the parameters allowing for the adjustment of the local contrast scale based on the angular resolution of the images. We also describe the adjustment of wEscore parameters for the evaluation of known decolorization algorithms applied to the images from the COLOR250 and the Cadik datasets with given observational conditions. When ranking the results of these algorithms and comparing it to the ranking based on human perception, wEscore turned out to be more accurate than Escore.This work was supported by Russian Science Foundation (Project No. 20-61-47089)
Color2Hatch: conversion of color to hatching for low-cost printing
In this paper, we propose Color2Hatch, a decolorization method for business/presentation graphics. In Color2Hatch, each region represented as a closed path and uniformly colored in scalable vector graphics (SVG) is converted to a region hatched in black and white. From the characteristics of business graphics, the hatching patterns are designed to represent mainly the hue in the region; additionally, lightness and saturation can also be reflected. To discriminate subtle differences between colors, attached short line segments, zigzag lines, and wave lines are used in hatching by analogy to a clock. Compared with the existing decolorization methods, for example, grayscale conversion and texturing, our method is superior in the discrimination of regions, suitable for low-cost black and white printing that meets real-world needs
GRAPHOS - open-source software for photogrammetric applications
open11siThis work has been supported by ISPRS through the 2016 Scientific Initiative entitled Advances in the Development of an Open-source Photogrammetric Tool.This paper reports the latest developments for the photogrammetric open-source tool called GRAPHOS (inteGRAted PHOtogrammetric Suite). GRAPHOS includes some recent innovations in the image-based 3D reconstruction pipeline, from automatic feature detection/description and network orientation to dense image matching and quality control. GRAPHOS also has a strong educational component beyond its automated processing functions, reinforced with tutorials and didactic explanations about algorithms and performance. The paper highlights recent developments carried out at different levels: graphical user interface (GUI), didactic simulators for image processing, photogrammetric processing with weight parameters, dataset creation and system evaluation.embargoed_20190221Gonzalez-Aguilera, D.*; López-Fernández, L.; Rodriguez-Gonzalvez, P.; Hernandez-Lopez, D.; Guerrero, D.; Remondino, F.; Menna, F.; Nocerino, E.; Toschi, I.; Ballabeni, A.; Gaiani, M.Gonzalez-Aguilera, D.*; López-Fernández, L.; Rodriguez-Gonzalvez, P.; Hernandez-Lopez, D.; Guerrero, D.; Remondino, F.; Menna, F.; Nocerino, E.; Toschi, I.; Ballabeni, A.; Gaiani, M
GRAPHOS – An open-source software for photogrammetric applications
19 p.This paper reports the latest developments for the photogrammetric open‐source tool called GRAPHOS (inteGRAted PHOtogrammetric Suite). GRAPHOS includes some recent innovations in the image‐based 3D reconstruction pipeline, from automatic feature detection/description and network orientation to dense image matching and quality control. GRAPHOS also has a strong educational component beyond its automated processing functions, reinforced with tutorials and didactic explanations about algorithms and performance. The paper highlights recent developments carried out at different levels: graphical user interface (GUI), didactic simulators for image processing, photogrammetric processing with weight parameters, dataset creation and system evaluationS
Scalable three-dimensional intact human organs labeling and clearing by tissue clearing technologies
Graphos – Open - Source Software for photogrammetric applications
This paper reports the latest developments for the photogrammetric opensource tool alled GRAPHOS (inteGRAted PHOtogrammetric Suite). GRAPHOS includes some recent innovations in the image-based 3D reconstruction pipeline, from automatic feature detection/description and network orientation to dense image matching and quality control. GRAPHOS also has a strong educational component beyond its automated processing functions, reinforced with tutorials and didactic explanations about algorithms and performance. The paper highlights recent developments carried out at different levels: graphical user interface (GUI), didactic simulators for image processing, photogrammetric processing with weight parameters, dataset creation and system evaluatio
3D imaging and quantitative analysis of intact tissues and organs
Embryonic development and tumor growth are highly complex and dynamic processes that
exist in both time and space. To fully understand the molecular mechanisms that control these
processes, it is crucial to study RNA expression and protein translation with single-cell
spatiotemporal resolution. This is feasible by microscopic imaging that enables
multidimensional assessments of cells, tissues, and organs. Here, a time-lapse calcium
imaging and three-dimensional imaging was used to study physiological development of the
brain or pathological development of cancer, respectively.
In Paper I, spatiotemporal calcium imaging revealed a new mechanism of neurogenesis
during brain development.
In Paper II, a new clearing method of clinically stored specimens, DIPCO (diagnosing
immunolabeled paraffin-embedded cleared organs), was developed that allows better
characterization and staging of intact human tumors.
In Paper III, the DIPCO method was applied to determine tumor stage and characterize the
microlymphatic system in bladder cancer.
In Paper IV, a novel method for RNA labeling of volumetric specimens, DIIFCO (diagnosing
in situ and immunofluorescence-labeled cleared onco-sample) was developed to study RNAs
expression and localization in intact tumors.
Overall, the aim of the thesis was to demonstrate that multidimensional imaging extends the
understanding of both physiological and pathological biological developmental processes
- …