10,153 research outputs found
Networks for Nonlinear Diffusion Problems in Imaging
A multitude of imaging and vision tasks have seen recently a major
transformation by deep learning methods and in particular by the application of
convolutional neural networks. These methods achieve impressive results, even
for applications where it is not apparent that convolutions are suited to
capture the underlying physics.
In this work we develop a network architecture based on nonlinear diffusion
processes, named DiffNet. By design, we obtain a nonlinear network architecture
that is well suited for diffusion related problems in imaging. Furthermore, the
performed updates are explicit, by which we obtain better interpretability and
generalisability compared to classical convolutional neural network
architectures. The performance of DiffNet tested on the inverse problem of
nonlinear diffusion with the Perona-Malik filter on the STL-10 image dataset.
We obtain competitive results to the established U-Net architecture, with a
fraction of parameters and necessary training data
Task adapted reconstruction for inverse problems
The paper considers the problem of performing a task defined on a model
parameter that is only observed indirectly through noisy data in an ill-posed
inverse problem. A key aspect is to formalize the steps of reconstruction and
task as appropriate estimators (non-randomized decision rules) in statistical
estimation problems. The implementation makes use of (deep) neural networks to
provide a differentiable parametrization of the family of estimators for both
steps. These networks are combined and jointly trained against suitable
supervised training data in order to minimize a joint differentiable loss
function, resulting in an end-to-end task adapted reconstruction method. The
suggested framework is generic, yet adaptable, with a plug-and-play structure
for adjusting both the inverse problem and the task at hand. More precisely,
the data model (forward operator and statistical model of the noise) associated
with the inverse problem is exchangeable, e.g., by using neural network
architecture given by a learned iterative method. Furthermore, any task that is
encodable as a trainable neural network can be used. The approach is
demonstrated on joint tomographic image reconstruction, classification and
joint tomographic image reconstruction segmentation
Deep D-Bar: Real-Time Electrical Impedance Tomography Imaging With Deep Neural Networks
The mathematical problem for electrical impedance tomography (EIT) is a highly nonlinear ill-posed inverse problem requiring carefully designed reconstruction procedures to ensure reliable image generation. D-bar methods are based on a rigorous mathematical analysis and provide robust direct reconstructions by using a low-pass filtering of the associated nonlinear Fourier data. Similarly to low-pass filtering of linear Fourier data, only using low frequencies in the image recovery process results in blurred images lacking sharp features, such as clear organ boundaries. Convolutional neural networks provide a powerful framework for post-processing such convolved direct reconstructions. In this paper, we demonstrate that these CNN techniques lead to sharp and reliable reconstructions even for the highly nonlinear inverse problem of EIT. The network is trained on data sets of simulated examples and then applied to experimental data without the need to perform an additional transfer training. Results for absolute EIT images are presented using experimental EIT data from the ACT4 and KIT4 EIT systems
- …