A New Nonlinear Diffusion Equation Model for Noisy Image Segmentation

Image segmentation and image denoising are two important and fundamental topics in the field of image processing. Geometric active contour model based on level set method can deal with the problem of image segmentation, but it does not consider the problem of image denoising. In this paper, a new diffusion equation model for noisy image segmentation is proposed by incorporating some classical diffusion equation denoising models into the segmental process. An assumption about the connection between the image intensity and level set function is given firstly. Some classical denoising models are employed to describe the evolution of level set function secondly. The final nonlinear diffusion equation model for noisy image segmentation is built thirdly. Then image segmentation and image denoising are combined in a united framework. The segmental results can be presented by level set function. Experimental results show that the new model has the advantage of noise resistance and is superior to traditional segmentation model

DFormer: Diffusion-guided Transformer for Universal Image Segmentation

This paper introduces an approach, named DFormer, for universal image segmentation. The proposed DFormer views universal image segmentation task as a denoising process using a diffusion model. DFormer first adds various levels of Gaussian noise to ground-truth masks, and then learns a model to predict denoising masks from corrupted masks. Specifically, we take deep pixel-level features along with the noisy masks as inputs to generate mask features and attention masks, employing diffusion-based decoder to perform mask prediction gradually. At inference, our DFormer directly predicts the masks and corresponding categories from a set of randomly-generated masks. Extensive experiments reveal the merits of our proposed contributions on different image segmentation tasks: panoptic segmentation, instance segmentation, and semantic segmentation. Our DFormer outperforms the recent diffusion-based panoptic segmentation method Pix2Seq-D with a gain of 3.6% on MS COCO val2017 set. Further, DFormer achieves promising semantic segmentation performance outperforming the recent diffusion-based method by 2.2% on ADE20K val set. Our source code and models will be publicly on https://github.com/cp3wan/DForme

A total variation-undecimated wavelet approach to chest radiograph image enhancement

Most often medical images such as X-Rays have a low dynamic range and many of their targeted features are difficult to identify. Intensity transformations that improve image quality usually rely onwavelet denoising and enhancement typically use the technique of thresholding to obtain better quality medical images. A disadvantage of wavelet thresholding is that even though it adequately removes noise in an image, it introduces unwanted artifacts into the image near discontinuities. We utilize a total variation method and an undecimated wavelet image enhancing algorithm for improving the image quality of chest radiographs. Our approach achieves a high level chest radiograph image deniosing in lung nodules detection while preserving the important features. Moreover, our method results in a high image sensitivity that reduces the average number of false positives on a test set of medical data

Denoising images corrupted by impulsive noise using projections onto the epigraph set of the total variation function (PES-TV)

In this article, a novel algorithm for denoising images corrupted by impulsive noise is presented. Impulsive noise generates pixels whose gray level values are not consistent with the neighboring pixels. The proposed denoising algorithm is a two-step procedure. In the first step, image denoising is formulated as a convex optimization problem, whose constraints are defined as limitations on local variations between neighboring pixels. We use Projections onto the Epigraph Set of the TV function (PES-TV) to solve this problem. Unlike other approaches in the literature, the PES-TV method does not require any prior information about the noise variance. It is only capable of utilizing local relations among pixels and does not fully take advantage of correlations between spatially distant areas of an image with similar appearance. In the second step, a Wiener filtering approach is cascaded to the PES-TV-based method to take advantage of global correlations in an image. In this step, the image is first divided into blocks and those with similar content are jointly denoised using a 3D Wiener filter. The denoising performance of the proposed two-step method was compared against three state-of-the-art denoising methods under various impulsive noise models. © 2015, Springer-Verlag London

Hyde: The First Open-Source, Python-Based, Gpu-Accelerated Hyperspectral Denoising Package

As with any physical instrument, hyperspectral cameras induce different kinds of noise in the acquired data. Therefore, Hyperspectral denoising is a crucial step for analyzing hyperspectral images (HSIs). Conventional computational methods rarely use GPUs to improve efficiency and are not fully open-source. Alternatively, deep learning-based methods are often open-source and use GPUs, but their training and utilization for real-world applications remain non-trivial for many researchers. Consequently, we propose HyDe: the first open-source, GPU-accelerated Python-based, hyperspectral image denoising toolbox, which aims to provide a large set of methods with an easy-to-use environment. HyDe includes a variety of methods ranging from low-rank wavelet-based methods to deep neural network (DNN) models. HyDe's interface dramatically improves the interoperability of these methods and the performance of the underlying functions. In fact, these methods maintain similar HSI denoising performance to their original implementations while consuming nearly ten times less energy. Furthermore, we present a method for training DNNs for denoising HSIs which are not spatially related to the training dataset, i.e., training on ground-level HSIs for denoising HSIs with other perspectives including airborne, drone-borne, and space-borne. To utilize the trained DNNs, we show a sliding window method to effectively denoise HSIs which would otherwise require more than 40 GB. The package can be found at: \url{https://github.com/Helmholtz-AI-Energy/HyDe}.Comment: 5 page

Image denoising with multi-layer perceptrons, part 1: comparison with existing algorithms and with bounds

Image denoising can be described as the problem of mapping from a noisy image to a noise-free image. The best currently available denoising methods approximate this mapping with cleverly engineered algorithms. In this work we attempt to learn this mapping directly with plain multi layer perceptrons (MLP) applied to image patches. We will show that by training on large image databases we are able to outperform the current state-of-the-art image denoising methods. In addition, our method achieves results that are superior to one type of theoretical bound and goes a large way toward closing the gap with a second type of theoretical bound. Our approach is easily adapted to less extensively studied types of noise, such as mixed Poisson-Gaussian noise, JPEG artifacts, salt-and-pepper noise and noise resembling stripes, for which we achieve excellent results as well. We will show that combining a block-matching procedure with MLPs can further improve the results on certain images. In a second paper, we detail the training trade-offs and the inner mechanisms of our MLPs