3 research outputs found
Nonlinear Evolutionary PDE-Based Refinement of Optical Flow
The goal of this paper is to propose two nonlinear variational models for
obtaining a refined motion estimation from an image sequence. Both the proposed
models can be considered as a part of a generalized framework for an accurate
estimation of physics-based flow fields such as rotational and fluid flow. The
first model is novel in the sense that it is divided into two phases: the first
phase obtains a crude estimate of the optical flow and then the second phase
refines this estimate using additional constraints. The correctness of this
model is proved using an Evolutionary PDE approach. The second model achieves
the same refinement as the first model, but in a standard manner, using a
single functional. A special feature of our models is that they permit us to
provide efficient numerical implementations through the first-order primaldual
Chambolle-Pock scheme. Both the models are compared in the context of accurate
estimation of angle by performing an anisotropic regularization of the
divergence and curl of the flow respectively. We observe that, although both
the models obtain the same level of accuracy, the two-phase model is more
efficient. In fact, we empirically demonstrate that the single-phase and the
two-phase models have convergence rates of order and
respectively
Task adapted reconstruction for inverse problems
The paper considers the problem of performing a task defined on a model
parameter that is only observed indirectly through noisy data in an ill-posed
inverse problem. A key aspect is to formalize the steps of reconstruction and
task as appropriate estimators (non-randomized decision rules) in statistical
estimation problems. The implementation makes use of (deep) neural networks to
provide a differentiable parametrization of the family of estimators for both
steps. These networks are combined and jointly trained against suitable
supervised training data in order to minimize a joint differentiable loss
function, resulting in an end-to-end task adapted reconstruction method. The
suggested framework is generic, yet adaptable, with a plug-and-play structure
for adjusting both the inverse problem and the task at hand. More precisely,
the data model (forward operator and statistical model of the noise) associated
with the inverse problem is exchangeable, e.g., by using neural network
architecture given by a learned iterative method. Furthermore, any task that is
encodable as a trainable neural network can be used. The approach is
demonstrated on joint tomographic image reconstruction, classification and
joint tomographic image reconstruction segmentation