Optimal bump functions for shallow ReLU networks: Weight decay, depth separation and the curse of dimensionality

In this note, we study how neural networks with a single hidden layer and ReLU activation interpolate data drawn from a radially symmetric distribution with target labels 1 at the origin and 0 outside the unit ball, if no labels are known inside the unit ball. With weight decay regularization and in the infinite neuron, infinite data limit, we prove that a unique radially symmetric minimizer exists, whose weight decay regularizer and Lipschitz constant grow as $d$ and $\sqrt{d}$ respectively. We furthermore show that the weight decay regularizer grows exponentially in $d$ if the label $1$ is imposed on a ball of radius $\varepsilon$ rather than just at the origin. By comparison, a neural networks with two hidden layers can approximate the target function without encountering the curse of dimensionality.Comment: Main text 24 page

Phase-field models for thin elastic structures: Willmore's energy and topological constraints

In this dissertation, I develop a phase-field approach to minimising a geometric energy functional in the class of connected structures confined to a small container. The functional under consideration is Willmore's energy, which depends on the mean curvature and area measure of a surface and thus allows for a formulation in terms of varifold geometry. In this setting, I prove existence of a minimiser and a very low level of regularity from simple energy bounds. In the second part, I describe a phase-field approach to the minimisation problem and provide a sample implementation along with an algorithmic description to demonstrate that the technique can be applied in practice. The diffuse Willmore functional in this setting goes back to De Giorgi and the novel element of my approach is the design of a penalty term which can control a topological quantity of the varifold limit in terms of phase-field functions. Besides the design of this functional, I present new results on the convergence of phase-fields away from a lower-dimensional subset which are needed in the proof, but interesting in their own right for future applications. In particular, they give a quantitative justification for heuristically identifying the zero level set of a phase field with a sharp interface limit, along with a precise description of cases when this may be admissible only up to a small additional set. The results are optimal in the sense that no further topological quantities can be controlled in this setting, as is also demonstrated. Besides independent geometric interest, the research is motivated by an application to certain biological membranes