A Novel Filled Function Method for Nonlinear Equations

A novel filled function method is suggested for solving box-constrained systems of nonlinear equations. Firstly, the original problem is converted into an equivalent global optimization problem. Subsequently, a novel filled function with one parameter is proposed for solving the converted global optimization problem. Some properties of the filled function are studied and discussed. Finally, an algorithm based on the proposed novel filled function for solving systems of nonlinear equations is presented. The objective function value can be reduced by quarter in each iteration of our algorithm. The implementation of the algorithm on several test problems is reported with satisfactory numerical results

Multigrid Renormalization

We combine the multigrid (MG) method with state-of-the-art concepts from the variational formulation of the numerical renormalization group. The resulting MG renormalization (MGR) method is a natural generalization of the MG method for solving partial differential equations. When the solution on a grid of $N$ points is sought, our MGR method has a computational cost scaling as $\mathcal{O}(\log(N))$, as opposed to $\mathcal{O}(N)$ for the best standard MG method. Therefore MGR can exponentially speed up standard MG computations. To illustrate our method, we develop a novel algorithm for the ground state computation of the nonlinear Schr\"{o}dinger equation. Our algorithm acts variationally on tensor products and updates the tensors one after another by solving a local nonlinear optimization problem. We compare several different methods for the nonlinear tensor update and find that the Newton method is the most efficient as well as precise. The combination of MGR with our nonlinear ground state algorithm produces accurate results for the nonlinear Schr\"{o}dinger equation on $N = 10^{18}$ grid points in three spatial dimensions.Comment: 18 pages, 17 figures, accepted versio

Solving nonlinear problems by Ostrowski Chun type parametric families

In this paper, by using a generalization of Ostrowski' and Chun's methods two bi-parametric families of predictor-corrector iterative schemes, with order of convergence four for solving system of nonlinear equations, are presented. The predictor of the first family is Newton's method, and the predictor of the second one is Steffensen's scheme. One of them is extended to the multidimensional case. Some numerical tests are performed to compare proposed methods with existing ones and to confirm the theoretical results. We check the obtained results by solving the molecular interaction problem.This research was supported by Ministerio de Ciencia y Tecnologia MTM2011-28636-C02-02 and FONDOCYT, Republica Dominicana.Cordero Barbero, A.; Maimo, J.; Torregrosa Sánchez, JR.; Vassileva, M. (2015). Solving nonlinear problems by Ostrowski Chun type parametric families. Journal of Mathematical Chemistry. 53(1):430-449. https://doi.org/10.1007/s10910-014-0432-zS430449531M.S. Petkovic̀, B. Neta, L.D. Petkovic̀, J. Dz̆unic̀, Multipoint Methods for Solving Nonlinear Equations (Academic, New York, 2013)M. Mahalakshmi, G. Hariharan, K. Kannan, The wavelet methods to linear and nonlinear reaction–diffusion model arising in mathematical chemistry. J. Math. Chem. 51(9), 2361–2385 (2013)P.G. Logrado, J.D.M. Vianna, Partitioning technique procedure revisited: Formalism and first application to atomic problems. J. Math. Chem. 22, 107–116 (1997)C.G. Jesudason, I. Numerical nonlinear analysis: differential methods and optimization applied to chemical reaction rate determination. J. Math. Chem. 49, 1384–1415 (2011)K. Maleknejad, M. Alizadeh, An efficient numerical scheme for solving hammerstein integral equation arisen in chemical phenomenon. Procedia Comput. Sci. 3, 361–364 (2011)R.C. Rach, J.S. Duan, A.M. Wazwaz, Solving coupled Lane–Emden boundary value problems in catalytic diffusion reactions by the Adomian decomposition method. J. Math. Chem. 52, 255–267 (2014)J.F. Steffensen, Remarks on iteration. Skand. Aktuar Tidskr. 16, 64–72 (1933)J.M. Ortega, W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Variables (Academic, New York, 1970)H.T. Kung, J.F. Traub, Optimal order of one-point and multipoint iteration. J. ACM 21, 643–651 (1974)J.R. Sharma, R.K. Guha, R. Sharma, An efficient fourth order weighted-Newton method for systems of nonlinear equations. Numer. Algorithms 62, 307–323 (2013)J.R. Sharma, H. Arora, On efficient weighted-Newton methods for solving systems of nonlinear equations. Appl. Math. Comput. 222, 497–506 (2013)M. Abad, A. Cordero, J.R. Torregrosa, Fourth- and fifth-order methods for solving nonlinear systems of equations: an application to the Global positioning system. Abstr. Appl. Anal.(2013) Article ID:586708. doi: 10.1155/2013/586708F. Soleymani, T. Lotfi, P. Bakhtiari, A multi-step class of iterative methods for nonlinear systems. Optim. Lett. 8, 1001–1015 (2014)M.T. Darvishi, N. Darvishi, SOR-Steffensen-Newton method to solve systems of nonlinear equations. Appl. Math. 2(2), 21–27 (2012). doi: 10.5923/j.am.20120202.05F. Awawdeh, On new iterative method for solving systems of nonlinear equations. Numer. Algorithms 5(3), 395–409 (2010)D.K.R. Babajee, A. Cordero, F. Soleymani, J.R. Torregrosa, On a novel fourth-order algorithm for solving systems of nonlinear equations. J. Appl. Math. (2012) Article ID:165452. doi: 10.1155/2012/165452A. Cordero, J.R. Torregrosa, M.P. Vassileva, Pseudocomposition: a technique to design predictor–corrector methods for systems of nonlinear equations. Appl. Math. Comput. 218(23), 1496–1504 (2012)A. Cordero, J.R. Torregrosa, M.P. Vassileva, Increasing the order of convergence of iterative schemes for solving nonlinear systems. J. Comput. Appl. Math. 252, 86–94 (2013)A.M. Ostrowski, Solution of Equations and System of Equations (Academic, New York, 1966)C. Chun, Construction of Newton-like iterative methods for solving nonlinear equations. Numer. Math. 104, 297–315 (2006)R. King, A family of fourth order methods for nonlinear equations. SIAM J. Numer. Anal. 10, 876–879 (1973)A. Cordero, J.R. Torregrosa, Low-complexity root-finding iteration functions with no derivatives of any order of convergence. J. Comput. Appl. Math. (2014). doi: 10.1016/j.cam.2014.01.024A. Cordero, J.L. Hueso, E. Martínez, J.R. Torregrosa, A modified Newton Jarratts composition. Numer. Algorithms 55, 87–99 (2010)P. Jarratt, Some fourth order multipoint methods for solving equations. Math. Comput. 20, 434–437 (1966)A. Cordero, J.R. Torregrosa, Variants of Newtons method using fifth-order quadrature formulas. Appl. Math. Comput. 190, 686–698 (2007)Z. Liu, Q. Zheng, P. Zhao, A variant of Steffensens method of fourth-order convergence and its applications. Appl. Math. Comput. 216, 1978–1983 (2010)A. Cordero, J.R. Torregrosa, A class of Steffensen type methods with optimal order of convergence. Appl. Math. Comput. 217, 7653–7659 (2011)L.B. Rall, New York, Computational Solution of Nonlinear Operator Equations (Robert E. Krieger Publishing Company Inc, New York, 1969

Memory in a new variant of King's family for solving nonlinear systems

[EN] In the recent literature, very few high-order Jacobian-free methods with memory for solving nonlinear systems appear. In this paper, we introduce a new variant of King's family with order four to solve nonlinear systems along with its convergence analysis. The proposed family requires two divided difference operators and to compute only one inverse of a matrix per iteration. Furthermore, we have extended the proposed scheme up to the sixth-order of convergence with two additional functional evaluations. In addition, these schemes are further extended to methods with memory. We illustrate their applicability by performing numerical experiments on a wide variety of practical problems, even big-sized. It is observed that these methods produce approximations of greater accuracy and are more efficient in practice, compared with the existing methods.This research was supported by PGC2018-095896-B-C22 (MCIU/AEI/FEDER, UE).Kansal, M.; Cordero Barbero, A.; Bhalla, S.; Torregrosa Sánchez, JR. (2020). Memory in a new variant of King's family for solving nonlinear systems. Mathematics. 8(8):1-15. https://doi.org/10.3390/math8081251S11588Cordero, A., Hueso, J. L., Martínez, E., & Torregrosa, J. R. (2009). A modified Newton-Jarratt’s composition. Numerical Algorithms, 55(1), 87-99. doi:10.1007/s11075-009-9359-zCordero, A., Hueso, J. L., Martínez, E., & Torregrosa, J. R. (2011). Efficient high-order methods based on golden ratio for nonlinear systems. Applied Mathematics and Computation, 217(9), 4548-4556. doi:10.1016/j.amc.2010.11.006Babajee, D. K. R., Cordero, A., Soleymani, F., & Torregrosa, J. R. (2012). On a Novel Fourth-Order Algorithm for Solving Systems of Nonlinear Equations. Journal of Applied Mathematics, 2012, 1-12. doi:10.1155/2012/165452Zheng, Q., Zhao, P., & Huang, F. (2011). A family of fourth-order Steffensen-type methods with the applications on solving nonlinear ODEs. Applied Mathematics and Computation, 217(21), 8196-8203. doi:10.1016/j.amc.2011.01.095Sharma, J., & Arora, H. (2013). An efficient derivative free iterative method for solving systems of nonlinear equations. Applicable Analysis and Discrete Mathematics, 7(2), 390-403. doi:10.2298/aadm130725016sSharma, J. R., Arora, H., & Petković, M. S. (2014). An efficient derivative free family of fourth order methods for solving systems of nonlinear equations. Applied Mathematics and Computation, 235, 383-393. doi:10.1016/j.amc.2014.02.103Wang, X., Zhang, T., Qian, W., & Teng, M. (2015). Seventh-order derivative-free iterative method for solving nonlinear systems. Numerical Algorithms, 70(3), 545-558. doi:10.1007/s11075-015-9960-2Chicharro, F. I., Cordero, A., Garrido, N., & Torregrosa, J. R. (2020). On the improvement of the order of convergence of iterative methods for solving nonlinear systems by means of memory. Applied Mathematics Letters, 104, 106277. doi:10.1016/j.aml.2020.106277Petković, M. S., & Sharma, J. R. (2015). On some efficient derivative-free iterative methods with memory for solving systems of nonlinear equations. Numerical Algorithms, 71(2), 457-474. doi:10.1007/s11075-015-0003-9Narang, M., Bhatia, S., Alshomrani, A. S., & Kanwar, V. (2019). General efficient class of Steffensen type methods with memory for solving systems of nonlinear equations. Journal of Computational and Applied Mathematics, 352, 23-39. doi:10.1016/j.cam.2018.10.048King, R. F. (1973). A Family of Fourth Order Methods for Nonlinear Equations. SIAM Journal on Numerical Analysis, 10(5), 876-879. doi:10.1137/0710072Hermite, M. C., & Borchardt, M. (1878). Sur la formule d’interpolation de Lagrange. Journal für die reine und angewandte Mathematik (Crelles Journal), 1878(84), 70-79. doi:10.1515/crelle-1878-18788405Petkovic, M., Dzunic, J., & Petkovic, L. (2011). A family of two-point methods with memory for solving nonlinear equations. Applicable Analysis and Discrete Mathematics, 5(2), 298-317. doi:10.2298/aadm110905021pCordero, A., & Torregrosa, J. R. (2007). Variants of Newton’s Method using fifth-order quadrature formulas. Applied Mathematics and Computation, 190(1), 686-698. doi:10.1016/j.amc.2007.01.062Awawdeh, F. (2009). On new iterative method for solving systems of nonlinear equations. Numerical Algorithms, 54(3), 395-409. doi:10.1007/s11075-009-9342-8Noor, M. A., Waseem, M., & Noor, K. I. (2015). New iterative technique for solving a system of nonlinear equations. Applied Mathematics and Computation, 271, 446-466. doi:10.1016/j.amc.2015.08.125Pramanik, S. (2002). Kinematic Synthesis of a Six-Member Mechanism for Automotive Steering. Journal of Mechanical Design, 124(4), 642-645. doi:10.1115/1.150337

On a novel fourth-order algorithm for solving systems of nonlinear equations

This paper focuses on solving systems of nonlinear equations numerically. We propose an efficient iterative scheme including two steps and fourth order of convergence. The proposed method does not require the evaluation of second or higher order Frechet derivatives per iteration to proceed and reach fourth order of convergence. Finally, numerical results illustrate the efficiency of the method.The authors would like to thank the referees for the valuable comments and for the suggestions to improve the readability of the paper. This research was supported by Ministerio de Ciencia y Tecnologia MTM2011-28636-C02-02.Babajee, DKR.; Cordero Barbero, A.; Soleymani, F.; Torregrosa Sánchez, JR. (2012). On a novel fourth-order algorithm for solving systems of nonlinear equations. Journal of Applied Mathematics. 2012. https://doi.org/10.1155/2012/1654522012Babajee, D. K. R., Dauhoo, M. Z., Darvishi, M. T., Karami, A., & Barati, A. (2010). Analysis of two Chebyshev-like third order methods free from second derivatives for solving systems of nonlinear equations. Journal of Computational and Applied Mathematics, 233(8), 2002-2012. doi:10.1016/j.cam.2009.09.035Darvishi, M. T., & Barati, A. (2007). A fourth-order method from quadrature formulae to solve systems of nonlinear equations. Applied Mathematics and Computation, 188(1), 257-261. doi:10.1016/j.amc.2006.09.115Soleymani, F., Khattri, S. K., & Karimi Vanani, S. (2012). Two new classes of optimal Jarratt-type fourth-order methods. Applied Mathematics Letters, 25(5), 847-853. doi:10.1016/j.aml.2011.10.030Cordero, A., Hueso, J. L., Martínez, E., & Torregrosa, J. R. (2010). Accelerated methods of order 2p for systems of nonlinear equations. Journal of Computational and Applied Mathematics, 233(10), 2696-2702. doi:10.1016/j.cam.2009.11.018Dayton, B. H., Li, T.-Y., & Zeng, Z. (2011). Multiple zeros of nonlinear systems. Mathematics of Computation, 80(276), 2143-2143. doi:10.1090/s0025-5718-2011-02462-2Haijun, W. (2008). New third-order method for solving systems of nonlinear equations. Numerical Algorithms, 50(3), 271-282. doi:10.1007/s11075-008-9227-2Noor, M. A., Waseem, M., Noor, K. I., & Al-Said, E. (2012). Variational iteration technique for solving a system of nonlinear equations. Optimization Letters, 7(5), 991-1007. doi:10.1007/s11590-012-0479-3Frontini, M., & Sormani, E. (2004). Third-order methods from quadrature formulae for solving systems of nonlinear equations. Applied Mathematics and Computation, 149(3), 771-782. doi:10.1016/s0096-3003(03)00178-4Cordero, A., Hueso, J. L., Martínez, E., & Torregrosa, J. R. (2009). A modified Newton-Jarratt’s composition. Numerical Algorithms, 55(1), 87-99. doi:10.1007/s11075-009-9359-zCordero, A., & Torregrosa, J. R. (2007). Variants of Newton’s Method using fifth-order quadrature formulas. Applied Mathematics and Computation, 190(1), 686-698. doi:10.1016/j.amc.2007.01.06

OKRidge: Scalable Optimal k-Sparse Ridge Regression for Learning Dynamical Systems

We consider an important problem in scientific discovery, identifying sparse governing equations for nonlinear dynamical systems. This involves solving sparse ridge regression problems to provable optimality in order to determine which terms drive the underlying dynamics. We propose a fast algorithm, OKRidge, for sparse ridge regression, using a novel lower bound calculation involving, first, a saddle point formulation, and from there, either solving (i) a linear system or (ii) using an ADMM-based approach, where the proximal operators can be efficiently evaluated by solving another linear system and an isotonic regression problem. We also propose a method to warm-start our solver, which leverages a beam search. Experimentally, our methods attain provable optimality with run times that are orders of magnitude faster than those of the existing MIP formulations solved by the commercial solver Gurobi

An efficient null space inexact Newton method for hydraulic simulation of water distribution networks

Null space Newton algorithms are efficient in solving the nonlinear equations arising in hydraulic analysis of water distribution networks. In this article, we propose and evaluate an inexact Newton method that relies on partial updates of the network pipes' frictional headloss computations to solve the linear systems more efficiently and with numerical reliability. The update set parameters are studied to propose appropriate values. Different null space basis generation schemes are analysed to choose methods for sparse and well-conditioned null space bases resulting in a smaller update set. The Newton steps are computed in the null space by solving sparse, symmetric positive definite systems with sparse Cholesky factorizations. By using the constant structure of the null space system matrices, a single symbolic factorization in the Cholesky decomposition is used multiple times, reducing the computational cost of linear solves. The algorithms and analyses are validated using medium to large-scale water network models.Comment: 15 pages, 9 figures, Preprint extension of Abraham and Stoianov, 2015 (https://dx.doi.org/10.1061/(ASCE)HY.1943-7900.0001089), September 2015. Includes extended exposition, additional case studies and new simulations and analysi