Two combined methods for the global solution of implicit semilinear differential equations with the use of spectral projectors and Taylor expansions

Two combined numerical methods for solving semilinear differential-algebraic equations (DAEs) are obtained and their convergence is proved. The comparative analysis of these methods is carried out and conclusions about the effectiveness of their application in various situations are made. In comparison with other known methods, the obtained methods require weaker restrictions for the nonlinear part of the DAE. Also, the obtained methods enable to compute approximate solutions of the DAEs on any given time interval and, therefore, enable to carry out the numerical analysis of global dynamics of mathematical models described by the DAEs. The examples demonstrating the capabilities of the developed methods are provided. To construct the methods we use the spectral projectors, Taylor expansions and finite differences. Since the used spectral projectors can be easily computed, to apply the methods it is not necessary to carry out additional analytical transformations

Gradient Descent Only Converges to Minimizers: Non-Isolated Critical Points and Invariant Regions

Given a non-convex twice differentiable cost function f, we prove that the set of initial conditions so that gradient descent converges to saddle points where \nabla^2 f has at least one strictly negative eigenvalue has (Lebesgue) measure zero, even for cost functions f with non-isolated critical points, answering an open question in [Lee, Simchowitz, Jordan, Recht, COLT2016]. Moreover, this result extends to forward-invariant convex subspaces, allowing for weak (non-globally Lipschitz) smoothness assumptions. Finally, we produce an upper bound on the allowable step-size.Comment: 2 figure