Improving statistics for hybrid segmentation of high-resolution multichannel images

High-resolution multichannel textures are difficult to characterize with simple statistics and the high level of detail makes the selection of a particular contour using classical gradient-based methods not effective. We have developed a hybrid method that combines fuzzy connectedness and Voronoi diagram classification for the segmentation of color and multichannel objects. The multi-step classification process relies on homogeneity measures derived from moment statistics and histogram information. These color features have been optimized to best combine individual channel information in the classification process. The segmentation initialization requires only a set of interior and exterior seed points, minimizing user intervention and the influence of the initialization on the overall quality of the results. The method was tested on volumes from the Visible Human and on brain multi-protocol MRI data sets. The hybrid segmentation produced robust, rapid and finely detailed contours with good visual accuracy. The addition of quantized statistics and color histogram distances as classification features improved the robustness of the method with regards to initialization when compared to our original implementation

Estimation of physical variables from multichannel remotely sensed imagery using a neural network: Application to rainfall estimation

Satellite-based remotely sensed data have the potential to provide hydrologically relevant information about spatially and temporally varying physical variables. A methodology for estimating such variables from multichannel remotely sensed data is presented; the approach is based on a modified counterpropagation neural network (MCPN) and is both effective and efficient at building complex nonlinear input-output function mappings from large amounts of data. An application to high-resolution estimation of the spatial and temporal variation of surface rainfall using geostationary satellite infrared and visible imagery is presented. Test results also indicate that spatially and temporally sparse ground-based observations can be assimilated via an adaptive implementation of the MCPN method, thereby allowing on-line improvement of the estimates

High Data Output and Automated 3D Correlative Light–Electron Microscopy Method

Correlative light/electron microscopy (CLEM) allows the simultaneous observation of a given subcellular structure by fluorescence light microscopy (FLM) and electron microscopy. The use of this approach is becoming increasingly frequent in cell biology. In this study, we report on a new high data output CLEM method based on the use of cryosections. We successfully applied the method to analyze the structure of rough and smooth Russell bodies used as model systems. The major advantages of our method are (i) the possibility to correlate several hundreds of events at the same time, (ii) the possibility to perform three-dimensional (3D) correlation, (iii) the possibility to immunolabel both endogenous and recombinantly expressed proteins at the same time and (iv) the possibility to combine the high data analysis capability of FLM with the high precision–accuracy of transmission electron microscopy in a CLEM hybrid morphometry analysis. We have identified and optimized critical steps in sample preparation, defined routines for sample analysis and retracing of regions of interest, developed software for semi/fully automatic 3D reconstruction and defined preliminary conditions for an hybrid light/electron microscopy morphometry approach

Semi-supervised learning for joint SAR and multispectral land cover classification

Semi-supervised learning techniques are gaining popularity due to their capability of building models that are effective, even when scarce amounts of labeled data are available. In this paper, we present a framework and specific tasks for self-supervised pretraining of \textit{multichannel} models, such as the fusion of multispectral and synthetic aperture radar images. We show that the proposed self-supervised approach is highly effective at learning features that correlate with the labels for land cover classification. This is enabled by an explicit design of pretraining tasks which promotes bridging the gaps between sensing modalities and exploiting the spectral characteristics of the input. In a semi-supervised setting, when limited labels are available, using the proposed self-supervised pretraining, followed by supervised finetuning for land cover classification with SAR and multispectral data, outperforms conventional approaches such as purely supervised learning, initialization from training on ImageNet and other recent self-supervised approaches.Comment: IEEE Geoscience and Remote Sensing Letter

Segmentation and Evaluation of Adipose Tissue from Whole Body MRI Scans

Accurate quantification of total body and the distribution of regional adipose tissue using manual segmentation is a challenging problem due to the high variation between manual delineations. Manual segmentation also requires highly trained experts with knowledge of anatomy. We present a hybrid segmentation method that provides robust delineation results for adipose tissue from whole body MRI scans. A formal evaluation of accuracy of the segmentation method is performed. This semi-automatic segmentation algorithm reduces significantly the time required for quantification of adipose tissue, and the accuracy measurements show that the results are close to the ground truth obtained from manual segmentations

Enhanced hyperspectral tomography for bioimaging by spatiospectral reconstruction.

From Europe PMC via Jisc Publications RouterHistory: ppub 2021-10-01, epub 2021-10-21Publication status: PublishedHere we apply hyperspectral bright field imaging to collect computed tomographic images with excellent energy resolution (~ 1 keV), applying it for the first time to map the distribution of stain in a fixed biological sample through its characteristic K-edge. Conventionally, because the photons detected at each pixel are distributed across as many as 200 energy channels, energy-selective images are characterised by low count-rates and poor signal-to-noise ratio. This means high X-ray exposures, long scan times and high doses are required to image unique spectral markers. Here, we achieve high quality energy-dispersive tomograms from low dose, noisy datasets using a dedicated iterative reconstruction algorithm. This exploits the spatial smoothness and inter-channel structural correlation in the spectral domain using two carefully chosen regularisation terms. For a multi-phase phantom, a reduction in scan time of 36 times is demonstrated. Spectral analysis methods including K-edge subtraction and absorption step-size fitting are evaluated for an ex vivo, single (iodine)-stained biological sample, where low chemical concentration and inhomogeneous distribution can affect soft tissue segmentation and visualisation. The reconstruction algorithms are available through the open-source Core Imaging Library. Taken together, these tools offer new capabilities for visualisation and elemental mapping, with promising applications for multiply-stained biological specimens

Integrating light-sheet imaging with virtual reality to recapitulate developmental cardiac mechanics

Currently, there is a limited ability to interactively study developmental cardiac mechanics and physiology. We therefore combined light-sheet fluorescence microscopy (LSFM) with virtual reality (VR) to provide a hybrid platform for 3D architecture and time-dependent cardiac contractile function characterization. By taking advantage of the rapid acquisition, high axial resolution, low phototoxicity, and high fidelity in 3D and 4D (3D spatial + 1D time or spectra), this VR-LSFM hybrid methodology enables interactive visualization and quantification otherwise not available by conventional methods, such as routine optical microscopes. We hereby demonstrate multiscale applicability of VR-LSFM to (a) interrogate skin fibroblasts interacting with a hyaluronic acid–based hydrogel, (b) navigate through the endocardial trabecular network during zebrafish development, and (c) localize gene therapy-mediated potassium channel expression in adult murine hearts. We further combined our batch intensity normalized segmentation algorithm with deformable image registration to interface a VR environment with imaging computation for the analysis of cardiac contraction. Thus, the VR-LSFM hybrid platform demonstrates an efficient and robust framework for creating a user-directed microenvironment in which we uncovered developmental cardiac mechanics and physiology with high spatiotemporal resolution