Numerical Approximate Methods for Solving Linear and Nonlinear Integral Equations

Integral equation has been one of the essential tools for various area of applied mathematics. In this work, we employed different numerical methods for solving both linear and nonlinear Fredholm integral equations. A goal is to categorize the selected methods and assess their accuracy and efficiency. We discuss challenges faced by researchers in this field, and we emphasize the importance of interdisciplinary effort for advancing the study on numerical methods for solving integral equations. Integral equations can be viewed as equations which are results of transformation of points in a given vector spaces of integrable functions by the use of certain specific integral operators to points in the same space. If, in particular, one is concerned with function spaces spanned by polynomials for which the kernel of the corresponding transforming integral operator is separable being comprised of polynomial functions only, then several approximate methods of solution of integral equations can be developed. This work, specially, deals with the development of different wavelet methods for solving integral and intgro-differential equations. Wavelets theory is a relatively new and emerging area in mathematical research. It has been applied in a wide range of engineering disciplines; particularly, wavelets are very successfully used in signal analysis for waveform representations and segmentations, time frequency analysis, and fast algorithms for easy implementation. Wavelets permit the accurate representation of a variety of functions and operators. Moreover, wavelets establish a connection with fast numerical algorithms. Wavelets can be separated into two distinct types, orthogonal and semi-orthogonal. The preliminary concept of integral equations and wavelets are first presented in Chapter 1. Classification of integral equations, construction of wavelets and multi-resolution analysis (MRA) have been briefly discussed and provided in this chapter. In Chapter 2, different wavelet methods are constructed and function approximation by these methods with convergence analysis have been presented. In Chapter 3, linear semi-orthogonal compactly supported B-spline wavelets together with their dual wavelets have been applied to approximate the solutions of Fredholm integral equations (both linear and nonlinear) of the second kind and their systems. Properties of these wavelets are first presented; these properties are then utilized to reduce the computation of integral equations to some algebraic equations. Convergence analysis of B-spline method has been discussed in this chapter. Again, in Chapter 4, system of nonlinear Fredholm integral equations have been solved by using hybrid Legendre Block-Pulse functions and xiii Bernstein collocation method. In Chapter 5, two practical problems arising from chemical phenomenon, have been modeled as Fredholm- Hammerstein integral equations and solved numerically by different numerical techniques. First, COSMO-RS model has been solved by Bernstein collocation method, Haar wavelet method and Sinc collocation method. Second, Hammerstein integral equation arising from chemical reactor theory has been solved by B-spline wavelet method. Comparison of results have been demonstrated through illustrative examples. In Chapter 6, Legendre wavelet method and Bernoulli wavelet method have been developed to solve system of integro-differential equations. Legendre wavelets along with their operational matrices are developed to approximate the solutions of system of nonlinear Volterra integro-differential equations. Also, nonlinear Volterra weakly singular integro-differential equations system has been solved by Bernoulli wavelet method. The properties of these wavelets are used to reduce the system of integral equations to a system of algebraic equations which can be solved numerically by Newton's method. Rigorous convergence analysis has been done for these wavelet methods. Illustrative examples have been included to demonstrate the validity and applicability of the proposed techniques. In Chapter 7, we have solved the second order Lane-Emden type singular differential equation. First, the second order differential equation is transformed into integro-differential equation and then solved by Legendre multi-wavelet method and Chebyshev wavelet method. Convergence of these wavelet methods have been discussed in this chapter. In Chapter 8, we have developed a efficient collocation technique called Legendre spectral collocation method to solve the Fredholm integro-differential-difference equations with variable coefficients and system of two nonlinear integro-differential equations which arise in biological model. The proposed method is based on the Gauss-Legendre points with the basis functions of Lagrange polynomials. The present method reduces this model to a system of nonlinear algebraic equations and again this algebraic system has been solved numerically by Newton's method. The study of fuzzy integral equations and fuzzy differential equations is an emerging area of research for many authors. In Chapter 9, we have proposed some numerical techniques for solving fuzzy integral equations and fuzzy integro-differential equations. Fundamentals of fuzzy calculus have been discussed in this chapter. Nonlinear fuzzy Hammerstein integral equation has been solved by Bernstein polynomials and Legendre wavelets, and then compared with homotopy analysis method. We have solved nonlinear fuzzy Hammerstein Volterra integral equations with constant delay by Bernoulli wavelet method and then compared with B-spline wavelet method. Finally, fuzzy integro-differential equation has been solved by Legendre wavelet method and compared with homotopy analysis method. In fuzzy case, we have applied two-dimensional numerical methods which are discussed in chapter 2. Convergence analysis and error estimate have been also provided for Bernoulli wavelet method. xiv The study of fractional calculus, fractional differential equations and fractional integral equations has a great importance in the field of science and engineering. Most of the physical phenomenon can be best modeled by using fractional calculus. Applications of fractional differential equations and fractional integral equations create a wide area of research for many researchers. This motivates to work on fractional integral equations, which results in the form of Chapter 10. First, the preliminary definitions and theorems of fractional calculus have been presented in this chapter. The nonlinear fractional mixed Volterra-Fredholm integro-differential equations along with mixed boundary conditions have been solved by Legendre wavelet method. A numerical scheme has been developed by using Petrov-Galerkin method where the trial and test functions are Legendre wavelets basis functions. Also, this method has been applied to solve fractional Volterra integro-differential equations. Uniqueness and existence of the problem have been discussed and the error estimate of the proposed method has been presented in this work. Sinc Galerkin method is developed to approximate the solution of fractional Volterra-Fredholm integro-differential equations with weakly singular kernels. The proposed method is based on the Sinc function approximation. Uniqueness and existence of the problem have been discussed and the error analysis of the proposed method have been presented in this chapte

Fourier Transforms

The 21st century ushered in a new era of technology that has been reshaping everyday life, simplifying outdated processes, and even giving rise to entirely new business sectors. Today, contemporary users of products and services expect more and more personalized products and services that can meet their unique needs. In that sense, it is necessary to further develop existing methods, adapt them to new applications, or even discover new methods. This book provides a thorough review of some methods that have an increasing impact on humanity today and that can solve different types of problems even in specific industries. Upgrading with Fourier Transformation gives a different meaning to these methods that support the development of new technologies and have a good projected acceleration in the future

Digital Image Processing

Newspapers and the popular scientific press today publish many examples of highly impressive images. These images range, for example, from those showing regions of star birth in the distant Universe to the extent of the stratospheric ozone depletion over Antarctica in springtime, and to those regions of the human brain affected by Alzheimer’s disease. Processed digitally to generate spectacular images, often in false colour, they all make an immediate and deep impact on the viewer’s imagination and understanding. Professor Jonathan Blackledge’s erudite but very useful new treatise Digital Image Processing: Mathematical and Computational Methods explains both the underlying theory and the techniques used to produce such images in considerable detail. It also provides many valuable example problems - and their solutions - so that the reader can test his/her grasp of the physical, mathematical and numerical aspects of the particular topics and methods discussed. As such, this magnum opus complements the author’s earlier work Digital Signal Processing. Both books are a wonderful resource for students who wish to make their careers in this fascinating and rapidly developing field which has an ever increasing number of areas of application. The strengths of this large book lie in: • excellent explanatory introduction to the subject; • thorough treatment of the theoretical foundations, dealing with both electromagnetic and acoustic wave scattering and allied techniques; • comprehensive discussion of all the basic principles, the mathematical transforms (e.g. the Fourier and Radon transforms), their interrelationships and, in particular, Born scattering theory and its application to imaging systems modelling; discussion in detail - including the assumptions and limitations - of optical imaging, seismic imaging, medical imaging (using ultrasound), X-ray computer aided tomography, tomography when the wavelength of the probing radiation is of the same order as the dimensions of the scatterer, Synthetic Aperture Radar (airborne or spaceborne), digital watermarking and holography; detail devoted to the methods of implementation of the analytical schemes in various case studies and also as numerical packages (especially in C/C++); • coverage of deconvolution, de-blurring (or sharpening) an image, maximum entropy techniques, Bayesian estimators, techniques for enhancing the dynamic range of an image, methods of filtering images and techniques for noise reduction; • discussion of thresholding, techniques for detecting edges in an image and for contrast stretching, stochastic scattering (random walk models) and models for characterizing an image statistically; • investigation of fractal images, fractal dimension segmentation, image texture, the coding and storing of large quantities of data, and image compression such as JPEG; • valuable summary of the important results obtained in each Chapter given at its end; • suggestions for further reading at the end of each Chapter. I warmly commend this text to all readers, and trust that they will find it to be invaluable. Professor Michael J Rycroft Visiting Professor at the International Space University, Strasbourg, France, and at Cranfield University, England

Digital Signal Processing (Second Edition)

This book provides an account of the mathematical background, computational methods and software engineering associated with digital signal processing. The aim has been to provide the reader with the mathematical methods required for signal analysis which are then used to develop models and algorithms for processing digital signals and finally to encourage the reader to design software solutions for Digital Signal Processing (DSP). In this way, the reader is invited to develop a small DSP library that can then be expanded further with a focus on his/her research interests and applications. There are of course many excellent books and software systems available on this subject area. However, in many of these publications, the relationship between the mathematical methods associated with signal analysis and the software available for processing data is not always clear. Either the publications concentrate on mathematical aspects that are not focused on practical programming solutions or elaborate on the software development of solutions in terms of working ‘black-boxes’ without covering the mathematical background and analysis associated with the design of these software solutions. Thus, this book has been written with the aim of giving the reader a technical overview of the mathematics and software associated with the ‘art’ of developing numerical algorithms and designing software solutions for DSP, all of which is built on firm mathematical foundations. For this reason, the work is, by necessity, rather lengthy and covers a wide range of subjects compounded in four principal parts. Part I provides the mathematical background for the analysis of signals, Part II considers the computational techniques (principally those associated with linear algebra and the linear eigenvalue problem) required for array processing and associated analysis (error analysis for example). Part III introduces the reader to the essential elements of software engineering using the C programming language, tailored to those features that are used for developing C functions or modules for building a DSP library. The material associated with parts I, II and III is then used to build up a DSP system by defining a number of ‘problems’ and then addressing the solutions in terms of presenting an appropriate mathematical model, undertaking the necessary analysis, developing an appropriate algorithm and then coding the solution in C. This material forms the basis for part IV of this work. In most chapters, a series of tutorial problems is given for the reader to attempt with answers provided in Appendix A. These problems include theoretical, computational and programming exercises. Part II of this work is relatively long and arguably contains too much material on the computational methods for linear algebra. However, this material and the complementary material on vector and matrix norms forms the computational basis for many methods of digital signal processing. Moreover, this important and widely researched subject area forms the foundations, not only of digital signal processing and control engineering for example, but also of numerical analysis in general. The material presented in this book is based on the lecture notes and supplementary material developed by the author for an advanced Masters course ‘Digital Signal Processing’ which was first established at Cranfield University, Bedford in 1990 and modified when the author moved to De Montfort University, Leicester in 1994. The programmes are still operating at these universities and the material has been used by some 700++ graduates since its establishment and development in the early 1990s. The material was enhanced and developed further when the author moved to the Department of Electronic and Electrical Engineering at Loughborough University in 2003 and now forms part of the Department’s post-graduate programmes in Communication Systems Engineering. The original Masters programme included a taught component covering a period of six months based on two semesters, each Semester being composed of four modules. The material in this work covers the first Semester and its four parts reflect the four modules delivered. The material delivered in the second Semester is published as a companion volume to this work entitled Digital Image Processing, Horwood Publishing, 2005 which covers the mathematical modelling of imaging systems and the techniques that have been developed to process and analyse the data such systems provide. Since the publication of the first edition of this work in 2003, a number of minor changes and some additions have been made. The material on programming and software engineering in Chapters 11 and 12 has been extended. This includes some additions and further solved and supplementary questions which are included throughout the text. Nevertheless, it is worth pointing out, that while every effort has been made by the author and publisher to provide a work that is error free, it is inevitable that typing errors and various ‘bugs’ will occur. If so, and in particular, if the reader starts to suffer from a lack of comprehension over certain aspects of the material (due to errors or otherwise) then he/she should not assume that there is something wrong with themselves, but with the author

MATLAB

A well-known statement says that the PID controller is the "bread and butter" of the control engineer. This is indeed true, from a scientific standpoint. However, nowadays, in the era of computer science, when the paper and pencil have been replaced by the keyboard and the display of computers, one may equally say that MATLAB is the "bread" in the above statement. MATLAB has became a de facto tool for the modern system engineer. This book is written for both engineering students, as well as for practicing engineers. The wide range of applications in which MATLAB is the working framework, shows that it is a powerful, comprehensive and easy-to-use environment for performing technical computations. The book includes various excellent applications in which MATLAB is employed: from pure algebraic computations to data acquisition in real-life experiments, from control strategies to image processing algorithms, from graphical user interface design for educational purposes to Simulink embedded systems

Nonlinear Analysis and Optimization with Applications

Nonlinear analysis has wide and significant applications in many areas of mathematics, including functional analysis, variational analysis, nonlinear optimization, convex analysis, nonlinear ordinary and partial differential equations, dynamical system theory, mathematical economics, game theory, signal processing, control theory, data mining, and so forth. Optimization problems have been intensively investigated, and various feasible methods in analyzing convergence of algorithms have been developed over the last half century. In this Special Issue, we will focus on the connection between nonlinear analysis and optimization as well as their applications to integrate basic science into the real world

Foundations of realistic rendering : a mathematical approach

Die vorliegende Dissertation ist keine gewöhnliche Abhandlung, sondern sie ist als Lehrbuch zum realistischen Rendering für Studenten im zweiten Studienabschnitt, sowie Forscher und am Thema Interessierte konzipiert. Aus mathematischer Sicht versteht man unter realistischem Rendering das Lösen der stationären Lichttransportgleichung, einer komplizierten Fredholm Integralgleichung der 2tenArt, deren exakte Lösung, wenn überhaupt berechenbar, nur in einem unendlich- dimensionalen Funktionenraum existiert. Während in den existierenden Büchern, die sich mit globaler Beleuchtungstheorie beschäftigen, vorwiegend die praktische Implementierung von Lösungsansätzen im Vordergrund steht, sind wir eher daran interessiert, den Leser mit den mathematischen Hilfsmitteln vertraut zu machen, mit welchen das globale Beleuchtungsproblem streng mathematisch formuliert und letzendlich auch gelöst werden kann. Neue, effzientere und elegantere Algorithmen zur Berechnung zumindest approxima- tiver Lösungen der Lichttransportgleichung und ihrer unterschiedlichen Varianten können nur im Kontext mit einem vertieften Verständnis der Lichttransportgleichung entwickelt werden. Da die Probleme des realistischen Renderings tief in verschiedenen mathematis- chen Disziplinen verwurzelt sind, setzt das vollständige Verständnis des globalen Beleuch- tungsproblems Kenntnisse aus verschiedenen Bereichen der Mathematik voraus. Als zen- trale Konzepte kristallisieren sich dabei Prinzipien der Funktionalanalysis, der Theorie der Integralgleichungen, der Maß- und Integrationstheorie sowie der Wahrscheinlichkeitstheo- rie heraus. Wir haben uns zum Ziel gesetzt, dieses Knäuel an mathematischen Konzepten zu entflechten, sie für Studenten verständlich darzustellen und ihnen bei Bedarf und je nach speziellem Interesse erschöpfend Auskunft zu geben.The available doctoral thesis is not a usual paper but it is conceived as a text book for realistic rendering, made for students in upper courses, as well as for researchers and interested people. From mathematical point of view, realistic rendering means solving the stationary light transport equation, a complicated Fredholm Integral equation of 2nd kind. Its exact solution exists|if possible at all|in an infinite dimensional functional space. Whereas practical implementation of approaches for solving problems are in the center of attentionin the existing textbooks that treat global illumination theory, we are more interested in familiarizing our reader with the mathematical tools which permit them to formulate the global illumination problem in accordance with strong mathematical principles and last but not least to solve it. New, more eficient and more elegant algorithms to calculate approximate solutions for the light transport equation and their different variants must be developed in the context of deep and complete understanding of the light transport equation. As the problems of realistic rendering are deeply rooted in different mathematical disciplines, there must precede the complete comprehension of all those areas. There are evolving principles of functional analysis, theory of integral equations, measure and integration theory as well as probability theory. We have set ourselves the target to remerge this bundle of fluff of mathematical concepts and principles, to represent them to the students in an understandable manner, and to give them, if required, exhaustive information