A new nonlocal nonlinear diffusion equation for image denoising and data analysis

In this paper we introduce and study a new feature-preserving nonlinear anisotropic diffusion for denoising signals. The proposed partial differential equation is based on a novel diffusivity coefficient that uses a nonlocal automatically detected parameter related to the local bounded variation and the local oscillating pattern of the noisy input signal. We provide a mathematical analysis of the existence of the solution of our nonlinear and nonlocal diffusion equation in the two dimensional case (images processing). Finally, we propose a numerical scheme with some numerical experiments which demonstrate the effectiveness of the new method

FROM OPTIMIZATION TO EQUILIBRATION: UNDERSTANDING AN EMERGING PARADIGM IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING

Many existing machine learning (ML) algorithms cannot be viewed as gradient descent on some single objective. The solution trajectories taken by these algorithms naturally exhibit rotation, sometimes forming cycles, a behavior that is not expected with (full-batch) gradient descent. However, these algorithms can be viewed more generally as solving for the equilibrium of a game with possibly multiple competing objectives. Moreover, some recent ML models, specifically generative adversarial networks (GANs) and its variants, are now explicitly formulated as equilibrium problems. Equilibrium problems present challenges beyond those encountered in optimization such as limit-cycles and chaotic attractors and are able to abstract away some of the difficulties encountered when training models like GANs. In this thesis, I aim to advance our understanding of equilibrium problems so as to improve state-of-the-art in GANs and related domains. In the following chapters, I will present work on designing a no-regret framework for solving monotone equilibrium problems in online or streaming settings (with applications to Reinforcement Learning), ensuring convergence when training a GAN to fit a normal distribution to data by Crossing-the-Curl, improving state-of-the-art image generation with techniques derived from theory, and borrowing tools from dynamical systems theory for analyzing the complex dynamics of GAN training