Integral equation

For equations of integer unknowns, see Diophantine equation.

In mathematics, integral equations are equations in which an unknown function appears under an integral sign. In mathematical notation, integral equations may thus be expressed as being of the form: $$f(x_{1},x_{2},x_{3},...,x_{n};u(x_{1},x_{2},x_{3},...,x_{n});I^{1}(u),I^{2}(u),I^{3}(u),...,I^{m}(u))=0$$where $I^{i}(u)$ is an integral operator acting on u. Hence, integral equations may be viewed as the analog to differential equations where instead of the equation involving derivatives, the equation contains integrals. A direct comparison can be seen with the mathematical form of the general integral equation above with the general form of a differential equation which may be expressed as follows:$$f(x_{1},x_{2},x_{3},...,x_{n};u(x_{1},x_{2},x_{3},...,x_{n});D^{1}(u),D^{2}(u),D^{3}(u),...,D^{m}(u))=0$$where $D^{i}(u)$ may be viewed as a differential operator of order i. Due to this close connection between differential and integral equations, one can often convert between the two. For example, one method of solving a boundary value problem is by converting the differential equation with its boundary conditions into an integral equation and solving the integral equation. In addition, because one can convert between the two, differential equations in physics such as Maxwell's equations often have an analog integral and differential form. See also, for example, Green's function and Fredholm theory.

Classification and overview

Various classification methods for integral equations exist. A few standard classifications include distinctions between linear and nonlinear; homogeneous and inhomogeneous; Fredholm and Volterra; first order, second order, and third order; and singular and regular integral equations. These distinctions usually rest on some fundamental property such as the consideration of the linearity of the equation or the homogeneity of the equation. These comments are made concrete through the following definitions and examples:

Linearity

Linear: An integral equation is linear if the unknown function u(x) and its integrals appear linearly in the equation. Hence, an example of a linear equation would be:$$u(x)=f(x)+\lambda \int _{\alpha (x)}^{\beta (x)}K(x,t)\cdot u(t)dt$$As a note on naming convention: i) u(x) is called the unknown function, ii) f(x) is called a known function, iii) K(x,t) is a function of two variables and often called the Kernel function, and iv) λ is an unknown factor or parameter, which plays the same role as the eigenvalue in linear algebra.

Nonlinear: An integral equation is nonlinear if the unknown function u(x) or any of its integrals appear nonlinear in the equation. Hence, examples of nonlinear equations would be the equation above if we replaced u(t) with $u^{2}(x),\,\,\cos(u(x)),\,{\text{or }}\,e^{u(x)}$, such as:$$u(x)=f(x)+\int _{\alpha (x)}^{\beta (x)}K(x,t)\cdot u^{2}(t)dt$$Certain kinds of nonlinear integral equations have specific names. A selection of such equations are:

• Nonlinear Volterra integral equations of the second kind which have the general form: $u(x)=f(x)+\lambda \int _{a}^{x}K(x,t)\,F(x,t,u(t))\,dt,$ where F is a known function.
• Nonlinear Fredholm integral equations of the second kind which have the general form: $f(x)=F(x,\int _{a}^{b}K(x,y,f(x),f(y))\,dy)$.
• A special type of nonlinear Fredholm integral equations of the second kind is given by the form: $f(x)=g(x)+\int _{a}^{b}K(x,y,f(x),f(y))\,dy$, which has the two special subclasses:
  • Urysohn equation: $f(x)=g(x)+\int _{a}^{b}k(x,y,f(y))\,dy$.
  • Hammerstein equation: $f(x)=g(x)+\int _{a}^{b}k(x,y)\,G(y,f(y))\,dy$.

More information on the Hammerstein equation and different versions of the Hammerstein equation can be found in the Hammerstein section below.

Location of the unknown equation

First kind: An integral equation is called an integral equation of the first kind if the unknown function appears only under the integral sign. An example would be: $f(x)=\int _{a}^{b}K(x,t)\,u(t)\,dt$.

Second kind: An integral equation is called an integral equation of the second kind if the unknown function also appears outside the integral.

Third kind: An integral equation is called an integral equation of the third kind if it is a linear Integral equation of the following form:$$g(t)u(t)+\lambda \int _{a}^{b}K(t,x)u(x)\,dx=f(t)$$where g(t) vanishes at least once in the interval [a,b] or where g(t) vanishes at a finite number of points in (a,b).

Limits of Integration

Fredholm: An integral equation is called a Fredholm integral equation if both of the limits of integration in all integrals are fixed and constant. An example would be that the integral is taken over a fixed subset of $\mathbb {R} ^{n}$. Hence, the following two examples are Fredholm equations:

• Fredholm equation of the first type: $f(x)=\int _{a}^{b}K(x,t)\,u(t)\,dt$.
• Fredholm equation of the second type: $u(x)=f(x)+\lambda \int _{a}^{b}K(x,t)\,u(t)\,dt.$

Note that we can express integral equations such as those above also using integral operator notation. For example, we can define the Fredholm integral operator as:$$({\mathcal {F}}y)(t):=\int _{t_{0}}^{T}K(t,s)\,y(s)\,ds.$$Hence, the above Fredholm equation of the second kind may be written compactly as:$$y(t)=g(t)+\lambda ({\mathcal {F}}y)(t).$$

Volterra: An integral equation is called a Volterra integral equation if at least one of the limits of integration is a variable. Hence, the integral is taken over a domain varying with the variable of integration. Examples of Volterra equations would be:

• Volterra integral equation of the first kind: $f(x)=\int _{a}^{x}K(x,t)\,u(t)\,dt$
• Volterra integral equation of the second kind: $u(x)=f(x)+\lambda \int _{a}^{x}K(x,t)\,u(t)\,dt.$

As with Fredholm equations, we can again adopt operator notation. Thus, we can define the linear Volterra integral operator ${\mathcal {V}}:C(I)\to C(I)$, as follows:$$({\mathcal {V}}\phi )(t):=\int _{t_{0}}^{t}K(t,s)\,\phi (s)\,ds$$where $t\in I=[t_{0},T]$ and K(t,s) is called the kernel and must be continuous on the interval $D:=\{(t,s):0\leq s\leq t\leq T\leq \infty \}$. Hence, the Volterra integral equation of the first kind may be written as:$$({\mathcal {V}}y)(t)=g(t)$$with $g(0)=0$. In addition, a linear Volterra integral equation of the second kind for an unknown function $y(t)$ and a given continuous function $g(t)$ on the interval $I$ where $t\in I$:$$y(t)=g(t)+({\mathcal {V}}y)(t).$$Volterra-Fredholm: In higher dimensions, integral equations such as Fredholm-Volterra integral equations (VFIE) exist. A VFIE has the form:$$u(t,x)=g(t,x)+({\mathcal {T}}u)(t,x)$$with $x\in \Omega$ and $\Omega$ being a closed bounded region in $\mathbb {R} ^{d}$ with piecewise smooth boundary. The Fredholm-Volterra Integral Operator ${\mathcal {T}}:C(I\times \Omega )\to C(I\times \Omega )$ is defined as:

$$({\mathcal {T}}u)(t,x):=\int _{0}^{t}\int _{\Omega }K(t,s,x,\xi )\,G(u(s,\xi ))\,d\xi \,ds.$$Note that while throughout this article, the bounds of the integral are usually written as intervals, this need not be the case. In general, integral equations don't always need to be defined over an interval $[a,b]=I$, but could also be defined over a curve or surface.

Homogeneity

Homogeneous: An integral equation is called homogeneous if the known function $f$ is identically zero.

Inhomogeneous: An integral equation is called inhomogeneous if the known function $f$ is nonzero.

Regularity

Regular: An integral equation is called regular if the integrals used are all proper integrals.

Singular or weakly singular: An integral equation is called singular or weakly singular if the integral is an improper integral. This could be either because at least one of the limits of integration is infinite or the kernel becomes unbounded, meaning infinite, on at least one point in the interval or domain over which is being integrated.

Examples include:$$F(\lambda )=\int _{-\infty }^{\infty }e^{-i\lambda x}u(x)\,dx$$$$L[u(x)]=\int _{0}^{\infty }e^{-\lambda x}u(x)\,dx$$These two integral equations are the Fourier transform and the Laplace transform of u(x), respectively, with both being Fredholm equations of the first kind with kernel $K(x,t)=e^{-i\lambda x}$ and $K(x,t)=e^{-\lambda x}$, respectively. Another example of a singular integral equation in which the kernel becomes unbounded is: $$x^{2}=\int _{0}^{x}{\frac {1}{\sqrt {x-t}}}\,u(t)\,dt.$$This equation is a special form of the more general weakly singular Volterra integral equation of the first kind, called Abel's integral equation: $$g(x)=\int _{a}^{x}{\frac {f(y)}{\sqrt {x-y}}}\,dy$$Strongly singular: An integral equation is called strongly singular if the integral is defined by a special regularisation, for example, by the Cauchy principal value.

Integro-differential equations

An Integro-differential equation, as the name suggests, combines differential and integral operators into one equation. There are many version including the Volterra integro-differential equation and delay type equations as defined below. For example, using the Volterra operator as defined above, the Volterra integro-differential equation may be written as:$$y'(t)=f(t,y(t))+(V_{\alpha }y)(t)$$For delay problems, we can define the delay integral operator $({\mathcal {W}}_{\theta ,\alpha }y)$ as:$$({\mathcal {W}}_{\theta ,\alpha }y)(t):=\int _{\theta (t)}^{t}(t-s)^{-\alpha }\cdot k_{2}(t,s,y(s),y'(s))\,ds$$where the delay integro-differential equation may be expressed as: $$y'(t)=f(t,y(t),y(\theta (t)))+({\mathcal {W}}_{\theta ,\alpha }y)(t).$$

Volterra integral equations

Uniqueness and existence theorems in 1D

The solution to a linear Volterra integral equation of the first kind, given by the equation:$$({\mathcal {V}}y)(t)=g(t)$$can be described by the following uniqueness and existence theorem. Recall that the Volterra integral operator ${\mathcal {V}}:C(I)\to C(I)$, can be defined as follows:$$({\mathcal {V}}\phi )(t):=\int _{t_{0}}^{t}K(t,s)\,\phi (s)\,ds$$where $t\in I=[t_{0},T]$ and K(t,s) is called the kernel and must be continuous on the interval $D:=\{(t,s):0\leq s\leq t\leq T\leq \infty \}$.

Theorem — Assume that $K$ satisfies $K\in C(D),\,\partial K/\partial t\in C(D)$ and $\vert K(t,t)\vert \geq k_{0}>0$ for some $t\in I.$ Then for any $g\in C^{1}(I)$ with $g(0)=0$ the integral equation above has a unique solution in $y\in C(I)$.

The solution to a linear Volterra integral equation of the second kind, given by the equation:$$y(t)=g(t)+({\mathcal {V}}y)(t)$$can be described by the following uniqueness and existence theorem.

Theorem — Let $K\in C(D)$ and let $R$ denote the resolvent Kernel associated with $K$. Then, for any $g\in C(I)$ , the second-kind Volterra integral equation has a unique solution $y\in C(I)$ and this solution is given by: $y(t)=g(t)+\int _{0}^{t}R(t,s)\,g(s)\,ds$.

Volterra integral equations in $\mathbb {R} ^{2}$

A Volterra Integral equation of the second kind can be expressed as follows:$$u(t,x)=g(t,x)+\int _{0}^{x}\int _{0}^{y}K(x,\xi ,y,\eta )\,u(\xi ,\eta )\,d\eta \,d\xi$$where $(x,y)\in \Omega :=[0,X]\times [0,Y]$, $g\in C(\Omega )$, $K\in C(D_{2})$ and $D_{2}:=\{(x,\xi ,y,\eta ):0\leq \xi \leq x\leq X,0\leq \eta \leq y\leq Y\}$. This integral equation has a unique solution $u\in C(\Omega )$ given by:$$u(t,x)=g(t,x)+\int _{0}^{x}\int _{0}^{y}R(x,\xi ,y,\eta )\,g(\xi ,\eta )\,d\eta \,d\xi$$where $R$ is the resolvent kernel of K.

Uniqueness and existence theorems of Fredholm-Volterra equations

As defined above, a VFIE has the form:$$u(t,x)=g(t,x)+({\mathcal {T}}u)(t,x)$$with $x\in \Omega$ and $\Omega$ being a closed bounded region in $\mathbb {R} ^{d}$ with piecewise smooth boundary. The Fredholm-Volterrra Integral Operator ${\mathcal {T}}:C(I\times \Omega )\to C(I\times \Omega )$ is defined as:$$({\mathcal {T}}u)(t,x):=\int _{0}^{t}\int _{\Omega }K(t,s,x,\xi )\,G(u(s,\xi ))\,d\xi \,ds.$$In the case where the Kernel K may be written as $K(t,s,x,\xi )=k(t-s)H(x,\xi )$, K is called the positive memory kernel. With this in mind, we can now introduce the following theorem:

Theorem — If the linear VFIE given by: $u(t,x)=g(t,x)+\int _{0}^{t}\int _{\Omega }K(t,s,x,\xi )\,G(u(s,\xi ))\,d\xi \,ds$ with $(t,x)\in I\times \Omega$ satisfies the following conditions:

• $g\in C(I\times \Omega )$, and
• $K\in C(D\times \Omega ^{2})$ where $D:=\{(t,s):0\leq s\leq t\leq T\}$ and $\Omega ^{2}=\Omega \times \Omega$

Then the VFIE has a unique solution $u\in C(I\times \Omega )$ given by $u(t,x)=g(t,x)+\int _{0}^{t}\int _{\Omega }R(t,s,x,\xi )\,G(u(s,\xi ))\,d\xi \,ds$ where $R\in C(D\times \Omega ^{2})$ is called the Resolvent Kernel and is given by the limit of the Neumann series for the Kernel $K$ and solves the resolvent equations: $R(t,s,x,\xi )=K(t,s,x,\xi )+\int _{0}^{t}\int _{\Omega }K(t,v,x,z)R(v,s,z,\xi )\,dz\,dv=K(t,s,x,\xi )+\int _{0}^{t}\int _{\Omega }R(t,v,x,z)K(v,s,z,\xi )\,dz\,dv$

Special Volterra equations

A special type of Volterra equation which is used in various applications is defined as follows:$$y(t)=g(t)+(V_{\alpha }y)(t)$$where $t\in I=[t_{0},T]$, the function g(t) is continuous on the interval $I$, and the Volterra integral operator $(V_{\alpha }t)$ is given by:$$(V_{\alpha }t)(t):=\int _{t_{0}}^{t}(t-s)^{-\alpha }\cdot k(t,s,y(s))\,ds$$with $(0\leq \alpha <1)$.

Converting IVP to integral equations

In the following section, we give an example of how to convert an initial value problem (IVP) into an integral equation. There are multiple motivations for doing so, among them being that integral equations can often be more readily solvable and are more suitable for proving existence and uniqueness theorems.

The following example was provided by Wazwaz on pages 1 and 2 in his book. We examine the IVP given by the equation:

$$u'(t)=2tu(t),\,\,\,\,\,\,\,x\geq 0$$and the initial condition:

$$u(0)=1$$

If we integrate both sides of the equation, we get:

$$\int _{0}^{x}u'(t)dt=\int _{0}^{x}2tu(t)dt$$

and by the fundamental theorem of calculus, we obtain:

$$u(x)-u(0)=\int _{0}^{x}2tu(t)dt$$

Rearranging the equation above, we get the integral equation:

$$u(x)=1+\int _{0}^{x}2tu(t)dt$$

which is a Volterra integral equation of the form:

$$u(x)=f(x)+\int _{\alpha (x)}^{\beta (x)}K(x,t)\cdot u(t)dt$$

where K(x,t) is called the kernel and equal to 2t, and f(x)=1.

Numerical solution

It is worth noting that integral equations often do not have an analytical solution, and must be solved numerically. An example of this is evaluating the electric-field integral equation (EFIE) or magnetic-field integral equation (MFIE) over an arbitrarily shaped object in an electromagnetic scattering problem.

One method to solve numerically requires discretizing variables and replacing integral by a quadrature rule

$\sum _{j=1}^{n}w_{j}K\left(s_{i},t_{j}\right)u(t_{j})=f(s_{i}),\qquad i=0,1,\dots ,n.$

Then we have a system with n equations and n variables. By solving it we get the value of the n variables

$u(t_{0}),u(t_{1}),\dots ,u(t_{n}).$

Integral equations as a generalization of eigenvalue equations

Further information: Fredholm theory

Certain homogeneous linear integral equations can be viewed as the continuum limit of eigenvalue equations. Using index notation, an eigenvalue equation can be written as

$\sum _{j}M_{i,j}v_{j}=\lambda v_{i}$

where M = [M_i,j] is a matrix, v is one of its eigenvectors, and λ is the associated eigenvalue.

Taking the continuum limit, i.e., replacing the discrete indices i and j with continuous variables x and y, yields

$\int K(x,y)\,\varphi (y)\,dy=\lambda \,\varphi (x),$

where the sum over j has been replaced by an integral over y and the matrix M and the vector v have been replaced by the kernel K(x, y) and the eigenfunction φ(y). (The limits on the integral are fixed, analogously to the limits on the sum over j.) This gives a linear homogeneous Fredholm equation of the second type.

In general, K(x, y) can be a distribution, rather than a function in the strict sense. If the distribution K has support only at the point x = y, then the integral equation reduces to a differential eigenfunction equation.

In general, Volterra and Fredholm integral equations can arise from a single differential equation, depending on which sort of conditions are applied at the boundary of the domain of its solution.

Wiener–Hopf integral equations

Main article: Wiener–Hopf method

$$y(t)=\lambda x(t)+\int _{0}^{\infty }k(t-s)\,x(s)\,ds,\qquad 0\leq t<\infty .$$ Originally, such equations were studied in connection with problems in radiative transfer, and more recently, they have been related to the solution of boundary integral equations for planar problems in which the boundary is only piecewise smooth.

Hammerstein equations

A Hammerstein equation is a nonlinear first-kind Volterra integral equation of the form:$$g(t)=\int _{0}^{t}K(t,s)\,G(s,y(s))\,ds.$$Under certain regularity conditions, the equation is equivalent to the implicit Volterra integral equation of the second-kind:$$G(t,y(t))=g_{1}(t)-\int _{0}^{t}K_{1}(t,s)\,G(s,y(s))\,ds$$where:$$g_{1}(t):={\frac {g'(t)}{K(t,t)}}\,\,\,\,\,\,\,{\text{and}}\,\,\,\,\,\,\,K_{1}(t,s):=-{\frac {1}{K(t,t)}}{\frac {\partial K(t,s)}{\partial t}}.$$The equation may however also be expressed in operator form which motivates the definition of the following operator called the nonlinear Volterra-Hammerstein operator:$$({\mathcal {H}}y)(t):=\int _{0}^{t}K(t,s)\,G(s,y(s))\,ds$$Here $G:I\times \mathbb {R} \to \mathbb {R}$ is a smooth function while the kernel K may be continuous, i.e. bounded, or weakly singular. The corresponding second-kind Volterra integral equation called the Volterra-Hammerstein Integral Equation of the second kind, or simply Hammerstein equation for short, can be expressed as:$$y(t)=g(t)+({\mathcal {H}}y)(t)$$In certain applications, the nonlinearity of the function G may be treated as being only semi-linear in the form of:$$G(s,y)=y+H(s,y)$$In this case, we the following semi-linear Volterra integral equation:$$y(t)=g(t)+({\mathcal {H}}y)(t)=g(t)+\int _{0}^{t}K(t,s)[y(s)+H(s,y(s))]\,ds$$In this form, we can state an existence and uniqueness theorem for the semi-linear Hammerstein integral equation.

Theorem — Suppose that the semi-linear Hammerstein equation has a unique solution $y\in C(I)$ and $H:I\times \mathbb {R} \to \mathbb {R}$ be a Lipschitz continuous function. Then the solution of this equation may be written in the form: $y(t)=y_{l}(t)+\int _{0}^{t}R(t,s)\,H(s,y(s))\,ds$ where $y_{l}(t)$ denotes the unique solution of the linear part of the equation above and is given by: $y_{l}(t)=g(t)+\int _{0}^{t}R(t,s)\,g(s)\,ds$ with $R(t,s)$ denoting the resolvent kernel.

We can also write the Hammerstein equation using a different operator called the Niemytzki operator, or substitution operator, ${\mathcal {N}}$ defined as follows:$$({\mathcal {N}}\phi )(t):=G(t,\phi (t))$$More about this can be found on page 75 of this book.

Applications

Integral equations are important in many applications. Problems in which integral equations are encountered include radiative transfer, and the oscillation of a string, membrane, or axle. Oscillation problems may also be solved as differential equations.

• Actuarial science (ruin theory)
• Computational electromagnetics
  • Boundary element method
• Inverse problems
  • Marchenko equation (inverse scattering transform)
• Options pricing under jump-diffusion
• Radiative transfer
• Renewal theory
• Viscoelasticity
• Fluid mechanics

See also

• Differential equation
• Integro-differential equation
• Ruin theory
• Volterra integral equation

Bibliography

• Agarwal, Ravi P., and Donal O'Regan. Integral and Integrodifferential Equations: Theory, Method and Applications. Gordon and Breach Science Publishers, 2000.
• Brunner, Hermann. Collocation Methods for Volterra Integral and Related Functional Differential Equations. Cambridge University Press, 2004.
• Burton, T. A. Volterra Integral and Differential Equations. Elsevier, 2005.
• Chapter 7 It Mod 02-14-05 - Ira A. Fulton College of Engineering. https://www.et.byu.edu/~vps/ET502WWW/NOTES/CH7m.pdf.
• Corduneanu, C. Integral Equations and Applications. Cambridge University Press, 2008.
• Hackbusch, Wolfgang. Integral Equations Theory and Numerical Treatment. Birkhäuser, 1995.
• Hochstadt, Harry. Integral Equations. Wiley-Interscience/John Wiley & Sons, 1989.
• "Integral Equation." From Wolfram MathWorld, https://mathworld.wolfram.com/IntegralEquation.html.
• "Integral Equation." Integral Equation - Encyclopedia of Mathematics, https://encyclopediaofmath.org/wiki/Integral_equation.
• Jerri, Abdul J. Introduction to Integral Equations with Applications. Sampling Publishing, 2007.
• Pipkin, A. C. A Course on Integral Equations. Springer-Verlag, 1991.
• Polëiìanin A. D., and Alexander V. Manzhirov. Handbook of Integral Equations. Chapman & Hall/CRC, 2008.
• Wazwaz, Abdul-Majid. A First Course in Integral Equations. World Scientific, 2015.

Further reading

• Kendall E. Atkinson. The Numerical Solution of Integral Equations of the Second Kind. Cambridge Monographs on Applied and Computational Mathematics, 1997.
• George Arfken and Hans Weber. Mathematical Methods for Physicists. Harcourt/Academic Press, 2000.
• Harry Bateman (1910) History and Present State of the Theory of Integral Equations, Report of the British Association.
• Andrei D. Polyanin and Alexander V. Manzhirov Handbook of Integral Equations. CRC Press, Boca Raton, 1998. ISBN 0-8493-2876-4.
• E. T. Whittaker and G. N. Watson. A Course of Modern Analysis Cambridge Mathematical Library.
• M. Krasnov, A. Kiselev, G. Makarenko, Problems and Exercises in Integral Equations, Mir Publishers, Moscow, 1971
• Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007). "Chapter 19. Integral Equations and Inverse Theory". Numerical Recipes: The Art of Scientific Computing (3rd ed.). New York: Cambridge University Press. ISBN 978-0-521-88068-8. Archived from the original on 2011-08-11. Retrieved 2011-08-17.

External links

• Integral Equations: Exact Solutions at EqWorld: The World of Mathematical Equations.
• Integral Equations: Index at EqWorld: The World of Mathematical Equations.
• "Integral equation", Encyclopedia of Mathematics, EMS Press, 2001 [1994]
• Integral Equations (MIT OpenCourseWare)