Automated Processing of Webcam Images for Phenological Classification

Along with the global climate change, there is an increasing interest for its effect on phenological patterns such as start and end of the growing season. Scientific digital webcams are used for this purpose taking every day one or more images from the same natural motive showing for example trees or grassland sites. To derive phenological patterns from the webcam images, regions of interest are manually defined on these images by an expert and subsequently a time series of percentage greenness is derived and analyzed with respect to structural changes. While this standard approach leads to satisfying results and allows to determine dates of phenological change points, it is associated with a considerable amount of manual work and is therefore constrained to a limited number of webcams only. In particular, this forbids to apply the phenological analysis to a large network of publicly accessible webcams in order to capture spatial phenological variation. In order to be able to scale up the analysis to several hundreds or thousands of webcams, we propose and evaluate two automated alternatives for the definition of regions of interest, allowing for efficient analyses of webcam images. A semi-supervised approach selects pixels based on the correlation of the pixels’ time series of percentage greenness with a few prototype pixels. An unsupervised approach clusters pixels based on scores of a singular value decomposition. We show for a scientific webcam that the resulting regions of interest are at least as informative as those chosen by an expert with the advantage that no manual action is required. Additionally, we show that the methods can even be applied to publicly available webcams accessed via the internet yielding interesting partitions of the analyzed images. Finally, we show that the methods are suitable for the intended big data applications by analyzing 13988 webcams from the AMOS database. All developed methods are implemented in the statistical software package R and publicly available in the R package phenofun. Executable example code is provided as supplementary material

High-throughput AFM analysis reveals unwrapping pathways of H3 and CENP-A nucleosomes

Nucleosomes, the fundamental units of chromatin, regulate readout and expression of eukaryotic genomes. Single-molecule experiments have revealed force-induced nucleosome accessibility, but a high-resolution unwrapping landscape in the absence of external forces is currently lacking. Here, we introduce a high-throughput pipeline for the analysis of nucleosome conformations based on atomic force microscopy and automated, multi-parameter image analysis. Our data set of ∼10 000 nucleosomes reveals multiple unwrapping states corresponding to steps of 5 bp DNA. For canonical H3 nucleosomes, we observe that dissociation from one side impedes unwrapping from the other side, but in contrast to force-induced unwrapping, we find only a weak sequence-dependent asymmetry. Notably, centromeric CENP-A nucleosomes do not unwrap anti-cooperatively, in stark contrast to H3 nucleosomes. Finally, our results reconcile previous conflicting findings about the differences in height between H3 and CENP-A nucleosomes. We expect our approach to enable critical insights into epigenetic regulation of nucleosome structure and stability and to facilitate future high-throughput AFM studies that involve heterogeneous nucleoprotein complexes

Uncertainty-Aware and Lesion-Specific Image Synthesis in Multiple Sclerosis Magnetic Resonance Imaging: A Multicentric Validation Study

Generative adversarial networks (GANs) can synthesize high-contrast MRI from lower-contrast input. Targeted translation of parenchymal lesions in multiple sclerosis (MS), as well as visualization of model confidence further augment their utility, provided that the GAN generalizes reliably across different scanners. We here investigate the generalizability of a refined GAN for synthesizing high-contrast double inversion recovery (DIR) images and propose the use of uncertainty maps to further enhance its clinical utility and trustworthiness. A GAN was trained to synthesize DIR from input fluid-attenuated inversion recovery (FLAIR) and T1w of 50 MS patients (training data). In another 50 patients (test data), two blinded readers (R1 and R2) independently quantified lesions in synthetic DIR (synthDIR), acquired DIR (trueDIR) and FLAIR. Of the 50 test patients, 20 were acquired on the same scanner as training data (internal data), while 30 were scanned at different scanners with heterogeneous field strengths and protocols (external data). Lesion-to-Background ratios (LBR) for MS-lesions vs. normal appearing white matter, as well as image quality parameters were calculated. Uncertainty maps were generated to visualize model confidence. Significantly more MS-specific lesions were found in synthDIR compared to FLAIR (R1: 26.7 ± 2.6 vs. 22.5 ± 2.2 p < 0.0001; R2: 22.8 ± 2.2 vs. 19.9 ± 2.0, p = 0.0005). While trueDIR remained superior to synthDIR in R1 [28.6 ± 2.9 vs. 26.7 ± 2.6 (p = 0.0021)], both sequences showed comparable lesion conspicuity in R2 [23.3 ± 2.4 vs. 22.8 ± 2.2 (p = 0.98)]. Importantly, improvements in lesion counts were similar in internal and external data. Measurements of LBR confirmed that lesion-focused GAN training significantly improved lesion conspicuity. The use of uncertainty maps furthermore helped discriminate between MS lesions and artifacts. In conclusion, this multicentric study confirms the external validity of a lesion-focused Deep-Learning tool aimed at MS imaging. When implemented, uncertainty maps are promising to increase the trustworthiness of synthetic MRI

High-throughput AFM analysis reveals unwrapping pathways of H3 and CENP-A nucleosomes

Nucleosomes, the fundamental units of chromatin, regulate readout and expression of eukaryotic genomes. Single-molecule experiments have revealed force-induced nucleosome accessibility, but a high-resolution unwrapping landscape in the absence of external forces is currently lacking. Here, we introduce a high-throughput pipeline for the analysis of nucleosome conformations based on atomic force microscopy and automated, multi-parameter image analysis. Our data set of ∼10 000 nucleosomes reveals multiple unwrapping states corresponding to steps of 5 bp DNA. For canonical H3 nucleosomes, we observe that dissociation from one side impedes unwrapping from the other side, but in contrast to force-induced unwrapping, we find only a weak sequence-dependent asymmetry. Notably, centromeric CENP-A nucleosomes do not unwrap anti-cooperatively, in stark contrast to H3 nucleosomes. Finally, our results reconcile previous conflicting findings about the differences in height between H3 and CENP-A nucleosomes. We expect our approach to enable critical insights into epigenetic regulation of nucleosome structure and stability and to facilitate future high-throughput AFM studies that involve heterogeneous nucleoprotein complexes. This journal i

ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset

Magnetic resonance imaging (MRI) is an important imaging modality in stroke. Computer based automated medical image processing is increasingly finding its way into clinical routine. The Ischemic Stroke Lesion Segmentation (ISLES) challenge is a continuous effort to develop and identify benchmark methods for acute and sub-acute ischemic stroke lesion segmentation. Here we introduce an expert-annotated, multicenter MRI dataset for segmentation of acute to subacute stroke lesions (https://doi.org/10.5281/zenodo.7153326). This dataset comprises 400 multi-vendor MRI cases with high variability in stroke lesion size, quantity and location. It is split into a training dataset of n = 250 and a test dataset of n = 150. All training data is publicly available. The test dataset will be used for model validation only and will not be released to the public. This dataset serves as the foundation of the ISLES 2022 challenge (https://www.isles-challenge.org/) with the goal of finding algorithmic methods to enable the development and benchmarking of automatic, robust and accurate segmentation methods for ischemic stroke

ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation dataset.

Magnetic resonance imaging (MRI) is an important imaging modality in stroke. Computer based automated medical image processing is increasingly finding its way into clinical routine. The Ischemic Stroke Lesion Segmentation (ISLES) challenge is a continuous effort to develop and identify benchmark methods for acute and sub-acute ischemic stroke lesion segmentation. Here we introduce an expert-annotated, multicenter MRI dataset for segmentation of acute to subacute stroke lesions ( https://doi.org/10.5281/zenodo.7153326 ). This dataset comprises 400 multi-vendor MRI cases with high variability in stroke lesion size, quantity and location. It is split into a training dataset of n = 250 and a test dataset of n = 150. All training data is publicly available. The test dataset will be used for model validation only and will not be released to the public. This dataset serves as the foundation of the ISLES 2022 challenge ( https://www.isles-challenge.org/ ) with the goal of finding algorithmic methods to enable the development and benchmarking of automatic, robust and accurate segmentation methods for ischemic stroke

DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes

We present DeepVesselNet, an architecture tailored to the challenges faced when extracting vessel trees and networks and corresponding features in 3-D angiographic volumes using deep learning. We discuss the problems of low execution speed and high memory requirements associated with full 3-D networks, high-class imbalance arising from the low percentage (<3%) of vessel voxels, and unavailability of accurately annotated 3-D training data—and offer solutions as the building blocks of DeepVesselNet. First, we formulate 2-D orthogonal cross-hair filters which make use of 3-D context information at a reduced computational burden. Second, we introduce a class balancing cross-entropy loss function with false-positive rate correction to handle the high-class imbalance and high false positive rate problems associated with existing loss functions. Finally, we generate a synthetic dataset using a computational angiogenesis model capable of simulating vascular tree growth under physiological constraints on local network structure and topology and use these data for transfer learning. We demonstrate the performance on a range of angiographic volumes at different spatial scales including clinical MRA data of the human brain, as well as CTA microscopy scans of the rat brain. Our results show that cross-hair filters achieve over 23% improvement in speed, lower memory footprint, lower network complexity which prevents overfitting and comparable accuracy that does not differ from full 3-D filters. Our class balancing metric is crucial for training the network, and transfer learning with synthetic data is an efficient, robust, and very generalizable approach leading to a network that excels in a variety of angiography segmentation tasks. We observe that sub-sampling and max pooling layers may lead to a drop in performance in tasks that involve voxel-sized structures. To this end, the DeepVesselNet architecture does not use any form of sub-sampling layer and works well for vessel segmentation, centerline prediction, and bifurcation detection. We make our synthetic training data publicly available, fostering future research, and serving as one of the first public datasets for brain vessel tree segmentation and analysis

Improving Automated Glioma Segmentation in Routine Clinical Use Through Artificial Intelligence-Based Replacement of Missing Sequences With Synthetic Magnetic Resonance Imaging Scans

Objectives: Although automated glioma segmentation holds promise for objective assessment of tumor biology and response, its routine clinical use is impaired by missing sequences, for example, due to motion artifacts. The aim of our study was to develop and validate a generative adversarial network for synthesizing missing sequences to allow for a robust automated segmentation. Materials and methods: Our model was trained on data from The Cancer Imaging Archive (n = 238 WHO II-IV gliomas) to synthesize either missing FLAIR, T2-weighted, T1-weighted (T1w), or contrast-enhanced T1w images from available sequences, using a novel tumor-targeting loss to improve synthesis of tumor areas. We validated performance in a test set from both the REMBRANDT repository and our local institution (n = 68 WHO II-IV gliomas), using qualitative image appearance metrics, but also segmentation performance with state-of-the-art segmentation models. Segmentation of synthetic images was compared with 2 commonly used strategies for handling missing input data, entering a blank mask or copying an existing sequence. Results: Across tumor areas and missing sequences, synthetic images generally outperformed both conventional approaches, in particular when FLAIR was missing. Here, for edema and whole tumor segmentation, we improved the Dice score, a common metric for evaluation of segmentation performance, by 12% and 11%, respectively, over the best conventional method. No method was able to reliably replace missing contrast-enhanced T1w images. Discussion: Replacing missing nonenhanced magnetic resonance sequences via synthetic images significantly improves segmentation quality over most conventional approaches. This model is freely available and facilitates more widespread use of automated segmentation in routine clinical use, where missing sequences are common

High-throughput AFM analysis reveals unwrapping pathways of H3 and CENP-A nucleosomes

Nucleosomes, the fundamental units of chromatin, regulate readout and expression of eukaryotic genomes. Single-molecule experiments have revealed force-induced nucleosome accessibility, but a high-resolution unwrapping landscape in the absence of external forces is currently lacking. Here, we introduce a high-throughput pipeline for the analysis of nucleosome conformations based on atomic force microscopy and automated, multi-parameter image analysis. Our data set of ∼10 000 nucleosomes reveals multiple unwrapping states corresponding to steps of 5 bp DNA. For canonical H3 nucleosomes, we observe that dissociation from one side impedes unwrapping from the other side, but in contrast to force-induced unwrapping, we find only a weak sequence-dependent asymmetry. Notably, centromeric CENP-A nucleosomes do not unwrap anti-cooperatively, in stark contrast to H3 nucleosomes. Finally, our results reconcile previous conflicting findings about the differences in height between H3 and CENP-A nucleosomes. We expect our approach to enable critical insights into epigenetic regulation of nucleosome structure and stability and to facilitate future high-throughput AFM studies that involve heterogeneous nucleoprotein complexes. This journal i