By now the reader will have come to appreciate that integration is generally quite a bit more difficult than differentiation. There are a great many simple-looking integrals, such as \(\int e^{-x^2}\dee{x}\text{,}\) that are either very difficult or even impossible to express in terms of standard functions 1 . Such integrals are not merely mathematical curiosities, but arise very naturally in many contexts. For example, the error function
is extremely important in many areas of mathematics, and also in many practical applications of statistics.
In such applications we need to be able to evaluate this integral (and many others) at a given numerical value of \(x\text{.}\) In this section we turn to the problem of how to find (approximate) numerical values for integrals, without having to evaluate them algebraically. To develop these methods we return to Riemann sums and our geometric interpretation of the definite integral as the signed area.
We start by describing (and applying) three simple algorithms for generating, numerically, approximate values for the definite integral \(\int_a^b f(x)\,\dee{x}\text{.}\) In each algorithm, we begin in much the same way as we approached Riemann sums.
We first select an integer \(n \gt 0\text{,}\) called the “number of steps”.
We then divide the interval of integration, \(a\le x\le b\text{,}\) into \(n\) equal subintervals, each of length \(\De x=\frac{b-a}{n}\text{.}\) The first subinterval runs from \(x_0=a\) to \(x_1=a+\De x\text{.}\) The second runs from \(x_1\) to \(x_2=a+2\De x\text{,}\) and so on. The last runs from \(x_{n-1}=b-\De x\) to \(x_n=b\text{.}\)
This splits the original integral into \(n\) pieces:
Each subintegral \(\int_{x_{j-1}}^{x_j} f(x)\,\dee{x}\) is approximated by the area of a simple geometric figure. The three algorithms we consider approximate the area by rectangles, trapezoids and parabolas (respectively).
We will explain these rules in detail below, but we give a brief overview here:
The midpoint rule approximates each subintegral by the area of a rectangle of height given by the value of the function at the midpoint of the subinterval
The trapezoidal rule approximates each subintegral by the area of a trapezoid with vertices at \((x_{j-1},0), (x_{j-1},f(x_{j-1})), (x_{j},f(x_{j})), (x_{j},0)\text{:}\)
The trapezoid is illustrated in the middle figure above. We shall derive the formula for the area shortly.
Simpson's rule approximates two adjacent subintegrals by the area under a parabola that passes through the points \((x_{j-1},f(x_{j-1}))\text{,}\)\((x_{j},f(x_{j}))\) and \((x_{j+1},f(x_{j+1}))\text{:}\)
The parabola is illustrated in the right hand figure above. We shall derive the formula for the area shortly.
Definition1.11.1.Midpoints.
In what follows we need to refer to the midpoint between \(x_{j-1}\) and \(x_j\) very frequently. To save on writing (and typing) we introduce the notation
The integral \(\int_{x_{j-1}}^{x_j} f(x)\,\dee{x}\) represents the area between the curve \(y=f(x)\) and the \(x\)-axis with \(x\) running from \(x_{j-1}\) to \(x_j\text{.}\) The width of this region is \(x_j-x_{j-1}=\De x\text{.}\) The height varies over the different values that \(f(x)\) takes as \(x\) runs from \(x_{j-1}\) to \(x_j\text{.}\)
The midpoint rule approximates this area by the area of a rectangle of width \(x_j-x_{j-1}=\De x\) and height \(f(\bar x_j)\) which is the exact height at the midpoint of the range covered by \(x\text{.}\)
The area of the approximating rectangle is \(f(\bar x_j)\De x\text{,}\) and the midpoint rule approximates each subintegral by
Applying this approximation to each subinterval and summing gives us the following approximation of the full integral:
\begin{align*}
\int_a^b f(x)\,\dee{x}&=
\int_{x_0}^{x_1}\!\! f(x)\,\dee{x} +
\int_{x_1}^{x_2}\!\! f(x)\,\dee{x} +\cdots +
\int_{x_{n-1}}^{x_n} f(x)\,\dee{x}\\
&\approx
f(\bar x_1)\De x +
f(\bar x_2)\De x
+ \cdots +
f(\bar x_n)\De x
\end{align*}
So notice that the approximation is the sum of the function evaluated at the midpoint of each interval and then multiplied by \(\De x\text{.}\) Our other approximations will have similar forms.
In summary:
Equation1.11.2.The midpoint rule.
The midpoint rule approximation is
\begin{gather*}
\int_a^b f(x)\,\dee{x}\approx\Big[f(\bar x_1)+f(\bar x_2)+\cdots +f(\bar x_n)\Big]\De x
\end{gather*}
That is, the error is about \(0.04\%\) of the exact value.
The midpoint rule gives us quite good estimates of the integral without too much work — though it is perhaps a little tedious to do by hand 2 . Of course, it would be very helpful to quantify what we mean by “good” in this context and that requires us to discuss errors.
Definition1.11.4.
Suppose that \(\alpha\) is an approximation to \(A\text{.}\) This approximation has
absolute error \(|A-\alpha|\) and
relative error \(\frac{|A-\alpha|}{|A|}\) and
percentage error \(100\frac{|A-\alpha|}{|A|}\)
We will discuss errors further in Section 1.11.4 below.
With little work we have managed to estimate the integral to within \(1\%\) of its true value.
Subsection1.11.2The trapezoidal rule
Consider again the area represented by the integral \(\int_{x_{j-1}}^{x_j} f(x)\,\dee{x}\text{.}\) The trapezoidal rule 3 (unsurprisingly) approximates this area by a trapezoid 4 whose vertices lie at
\begin{gather*}
(x_{j-1},0), (x_{j-1},f(x_{j-1})), (x_{j},f(x_{j})) \text{ and } (x_{j},0).
\end{gather*}
The trapezoidal approximation of the integral \(\int_{x_{j-1}}^{x_j} f(x)\,\dee{x}\) is the shaded region in the figure on the right above. It has width \(x_j-x_{j-1}=\De x\text{.}\) Its left hand side has height \(f(x_{j-1})\) and its right hand side has height \(f(x_j)\text{.}\)
As the figure below shows, the area of a trapezoid is its width times its average height.
So the trapezoidal rule approximates each subintegral by
\begin{equation*}
\int_{x_{j-1}}^{x_j} f(x)\,\dee{x}\approx \tfrac{f(x_{j-1})+f(x_j)}{2}\De x
\end{equation*}
Applying this approximation to each subinterval and then summing the result gives us the following approximation of the full integral
\begin{align*}
\int_a^b f(x)\,\dee{x}&=
\int_{x_0}^{x_1} f(x)\,\dee{x} + \int_{x_1}^{x_2} f(x)\,\dee{x}
+\cdots+\int_{x_{n-1}}^{x_n} f(x)\,\dee{x}\\
& \approx \tfrac{f(x_0)+f(x_1)}{2}\De x + \tfrac{f(x_1)+f(x_2)}{2}\De x
+ \cdots +
\tfrac{f(x_{n-1})+f(x_n)}{2}\De x\\
&=
\Big[\half f(x_0)+f(x_1)+f(x_2)+\cdots+ f(x_{n-1})+\half f(x_n)\Big]\De x
\end{align*}
So notice that the approximation has a very similar form to the midpoint rule, excepting that
we evaluate the function at the \(x_j\)'s rather than at the midpoints, and
we multiply the value of the function at the endpoints \(x_0,x_n\) by \(\frac12\text{.}\)
In summary:
Equation1.11.6.The trapezoidal rule.
The trapezoidal rule approximation is
\begin{align*}
\int_a^b f(x)\,\dee{x}
&\approx\Big[\half f(x_0)+f(x_1)+f(x_2)+\cdots+ f(x_{n-1})+\half f(x_n)\Big]\De x
\end{align*}
The exact value of the integral is still \(\pi\text{.}\) So the error in the approximation generated by eight steps of the trapezoidal rule is \(|3.139-\pi|=0.0026\text{,}\) which is \(100\tfrac{|3.139-\pi|}{\pi}\% =0.08\%\) of the exact answer. Notice that this is roughly twice the error that we achieved using the midpoint rule in Example 1.11.3.
Let us also redo Example 1.11.5 using the trapezoidal rule.
The exact answer is \(\int_0^\pi\sin x\,\dee{x}=-\cos x\Big|_0^\pi=2\text{.}\) So with eight steps of the trapezoidal rule we achieved \(100\tfrac{|1.974-2|}{2}=1.3\%\) accuracy. Again this is approximately twice the error we achieved in Example 1.11.5 using the midpoint rule.
These two examples suggest that the midpoint rule is more accurate than the trapezoidal rule. Indeed, this observation is born out by a rigorous analysis of the error — see Section 1.11.4.
Subsection1.11.3Simpson's Rule
When we use the trapezoidal rule we approximate the area \(\int_{x_{j-1}}^{x_j}f(x)\dee{x}\) by the area between the \(x\)-axis and a straight line that runs from \((x_{j-1},f(x_{j-1}))\) to \((x_j, f(x_j))\) — that is, we approximate the function \(f(x)\) on this interval by a linear function that agrees with the function at each endpoint. An obvious way to extend this — just as we did when extending linear approximations to quadratic approximations in our differential calculus course — is to approximate the function with a quadratic. This is precisely what Simpson's 5 rule does.
Simpson's rule approximates the integral over two neighbouring subintervals by the area between a parabola and the \(x\)-axis. In order to describe this parabola we need 3 distinct points (which is why we approximate two subintegrals at a time). That is, we approximate
by the area bounded by the parabola that passes through the three points \(\big(x_0,f(x_0)\big)\text{,}\)\(\big(x_1,f(x_1)\big)\) and \(\big(x_2,f(x_2)\big)\text{,}\) the \(x\)-axis and the vertical lines \(x=x_0\) and \(x=x_2\text{.}\)
We repeat this on the next pair of subintervals and approximate \(\int_{x_2}^{x_4} f(x)\,\dee{x}\) by the area between the \(x\)-axis and the part of a parabola with \(x_2\le x\le x_4\text{.}\) This parabola passes through the three points \(\big(x_2,f(x_2)\big)\text{,}\)\(\big(x_3,f(x_3)\big)\) and \(\big(x_4,f(x_4)\big)\text{.}\) And so on. Because Simpson's rule does the approximation two slices at a time, \(n\)must be even.
To derive Simpson's rule formula, we first find the equation of the parabola that passes through the three points \(\big(x_0,f(x_0)\big)\text{,}\)\(\big(x_1,f(x_1)\big)\) and \(\big(x_2,f(x_2)\big)\text{.}\) Then we find the area between the \(x\)-axis and the part of that parabola with \(x_0\le x\le x_2\text{.}\) To simplify this computation consider a parabola passing through the points \((-h,y_{-1}), (0,y_0)\) and \((h,y_1)\text{.}\)
Write the equation of the parabola as
\begin{align*}
y &= Ax^2 + Bx +C
\end{align*}
Then the area between it and the \(x\)-axis with \(x\) running from \(-h\) to \(h\) is
Notice that Simpson's rule requires essentially no more work than the trapezoidal rule. In both rules we must evaluate \(f(x)\) at \(x=x_0,x_1,\cdots,x_n\text{,}\) but we add those terms multiplied by different constants 6 .
This agrees with \(\pi\) (the exact value of the integral) to six decimal places. So the error in the approximation generated by eight steps of Simpson's rule is \(|3.14159250-\pi|=1.5\times 10^{-7}\text{,}\) which is \(100\tfrac{|3.14159250-\pi|}{\pi}\% =5\times 10^{-6}\%\) of the exact answer.
It is striking that the absolute error approximating with Simpson's rule is so much smaller than the error from the midpoint and trapezoidal rules.
This completes our derivation of the midpoint, trapezoidal and Simpson's rules for approximating the values of definite integrals. So far we have not attempted to see how efficient and how accurate the algorithms are in general. That's our next task.
Now we are armed with our three (relatively simple) methods for numerical integration we should give thought to how practical they might be in the real world 7 . Two obvious considerations when deciding whether or not a given algorithm is of any practical value are
the amount of computational effort required to execute the algorithm and
the accuracy that this computational effort yields.
For algorithms like our simple integrators, the bulk of the computational effort usually goes into evaluating the function \(f(x)\text{.}\) The number of evaluations of \(f(x)\) required for \(n\) steps of the midpoint rule is \(n\text{,}\) while the number required for \(n\) steps of the trapezoidal and Simpson's rules is \(n+1\text{.}\) So all three of our rules require essentially the same amount of effort — one evaluation of \(f(x)\) per step.
To get a first impression of the error behaviour of these methods, we apply them to a problem whose answer we know exactly:
To be a little more precise, we would like to understand how the errors of the three methods change as we increase the effort we put in (as measured by the number of steps \(n\)). The following table lists the error in the approximate value for this number generated by our three rules applied with three different choices of \(n\text{.}\) It also lists the number of evaluations of \(f\) required to compute the approximation.
Midpoint
Trapezoidal
Simpson's
n
error
# evals
error
# evals
error
# evals
10
\(8.2\times 10^{-3}\)
10
\(1.6\times 10^{-2}\)
11
\(1.1\times 10^{-4}\)
11
100
\(8.2\times 10^{-5}\)
100
\(1.6\times 10^{-4}\)
101
\(1.1\times 10^{-8}\)
101
1000
\(8.2\times 10^{-7}\)
1000
\(1.6\times 10^{-6}\)
1001
\(1.1\times 10^{-12}\)
1001
Observe that
Using 101 evaluations of \(f\) worth of Simpson's rule gives an error 75 times smaller than 1000 evaluations of \(f\) worth of the midpoint rule.
The trapezoidal rule error with \(n\) steps is about twice the midpoint rule error with \(n\) steps.
With the midpoint rule, increasing the number of steps by a factor of 10 appears to reduce the error by about a factor of \(100=10^2=n^2\text{.}\)
With the trapezoidal rule, increasing the number of steps by a factor of 10 appears to reduce the error by about a factor of \(10^2=n^2\text{.}\)
With Simpson's rule, increasing the number of steps by a factor of 10 appears to reduce the error by about a factor of \(10^4=n^4\text{.}\)
So it looks like
\begin{align*}
&\hbox{approx value of $\ds\int_a^b f(x)\,\dee{x}$ given by $n$ midpoint steps }
\hskip-0.35in&&\approx \int_a^b f(x)\,\dee{x}+K_M\cdot \frac{1}{n^2}\\
&\hbox{approx value of $\ds\int_a^b f(x)\,\dee{x}$ given by $n$ trapezoidal steps }
\hskip-0.35in&&\approx \int_a^b f(x)\,\dee{x}+K_T\cdot \frac{1}{n^2}\\
&\hbox{approx value of $\ds\int_a^b f(x)\,\dee{x}$ given by $n$ Simpson's steps }
\hskip-0.35in&&\approx \int_a^b f(x)\,\dee{x}+K_M\cdot \frac{1}{n^4}
\end{align*}
with some constants \(K_M,\ K_T\) and \(K_S\text{.}\) It also seems that \(K_T\approx 2 K_M\text{.}\)
Figure1.11.12.A log-log plot of the error in the \(n\) step approximation to \(\ds \int_0^\pi \sin x\,\dee{x}\text{.}\)
To test these conjectures for the behaviour of the errors we apply our three rules with about ten different choices of \(n\) of the form \(n=2^m \) with \(m\) integer. Figure 1.11.12 contains two graphs of the results. The left-hand plot shows the results for the midpoint and trapezoidal rules and the right-hand plot shows the results for Simpson's rule.
For each rule we are expecting (based on our conjectures above) that the error
for some constants \(K\) and \(k\text{.}\) We would like to test if this is really the case, by graphing \(Y=e_n\) against \(X=n\) and seeing if the graph “looks right”. But it is not easy to tell whether or not a given curve really is \(Y=\frac{K}{X^k}\text{,}\) for some specific \(k\text{,}\) by just looking at it. However, your eye is pretty good at determining whether or not a graph is a straight line. Fortunately, there is a little trick that turns the curve \(Y=\tfrac{K}{X^k}\) into a straight line — no matter what \(k\) is.
Instead of plotting \(Y\) against \(X\text{,}\) we plot \(\log Y\) against \(\log X\text{.}\) This transformation 8 works because when \(Y=\frac{K}{X^k}\)
\begin{align*}
\log Y &= \log K - k \log X
\end{align*}
So plotting \(y=\log Y\) against \(x=\log X\) gives the straight line \(y=\log K -kx\text{,}\) which has slope \(-k\) and \(y\)-intercept \(\log K\text{.}\)
The three graphs in Figure 1.11.12 plot \(y=\log_2 e_n\) against \(x=\log_2 n\) for our three rules. Note that we have chosen to use logarithms 9 with this “unusual base” because it makes it very clear how much the error is improved if we double the number of steps used. To be more precise — one unit step along the \(x\)-axis represents changing \(n \mapsto 2n\text{.}\) For example, applying Simpson's rule with \(n=2^4\) steps results in an error of \(0000166\text{,}\) so the point \((x=\log_2 2^4=4, y=\log_2 0000166 = \frac{\log 0000166}{\log 2} = -15.8)\) has been included on the graph. Doubling the effort used — that is, doubling the number of steps to \(n=2^5\)— results in an error of \(0.00000103\text{.}\) So, the data point \((x=\log_2 2^5=5\ ,\ y=\log_2 0.00000103 =\frac{\ln 0.00000103}{\ln 2}=-19.9)\) lies on the graph. Note that the \(x\)-coordinates of these points differ by 1 unit.
For each of the three sets of data points, a straight line has also been plotted “through” the data points. A procedure called linear regression 10 has been used to decide precisely which straight line to plot. It provides a formula for the slope and \(y\)-intercept of the straight line which “best fits” any given set of data points. From the three lines, it sure looks like \(k=2\) for the midpoint and trapezoidal rules and \(k=4\) for Simpson's rule. It also looks like the ratio between the value of \(K\) for the trapezoidal rule, namely \(K=2^{0.7253}\text{,}\) and the value of \(K\) for the midpoint rule, namely \(K=2^{-0.2706}\text{,}\) is pretty close to 2: \(2^{0.7253}/2^{-0.2706}=2^{0.9959}\text{.}\)
The intuition, about the error behaviour, that we have just developed is in fact correct — provided the integrand \(f(x)\) is reasonably smooth. To be more precise
Theorem1.11.13.Numerical integration errors.
Assume that \(|f''(x)| \leq M\) for all \(a\leq x \leq b\text{.}\) Then
\begin{align*}
&\text{the total error introduced by the midpoint rule is bounded by } & \frac{M}{24} \frac{(b-a)^3}{n^2}\\
&\text{and}\\
&\text{the total error introduced by the trapezoidal rule is bounded by } &
\frac{M}{12} \frac{(b-a)^3}{n^2}\\
\end{align*}
when approximating \(\ds \int_a^b f(x)\dee{x}\text{.}\) Further, if \(|f^{(4)}(x)|\leq L\) for all \(a\leq x \leq b\text{,}\) then
\begin{align*}
&\text{the total error introduced by Simpson's rule is bounded by } & \frac{L}{180} \frac{(b-a)^5}{n^4}.
\end{align*}
The first of these error bounds in proven in the following (optional) section. Here are some examples which illustrate how they are used. First let us check that the above result is consistent with our data in Figure 1.11.12
which is consistent with the bound \(|e_n|\le \frac{\pi^3}{24}\frac{1}{n^2}\text{.}\)
In a typical application we would be asked to evaluate a given integral to some specified accuracy. For example, if you are manufacturer and your machinery can only cut materials to an accuracy of \({\tfrac{1}{10}}^{\rm th}\) of a millimeter, there is no point in making design specifications more accurate than \({\tfrac{1}{10}}^{\rm th}\) of a millimeter.
Suppose now that we wish evaluate \(\int_0^1 e^{-x^2}\,\dee{x}\) to within an accuracy of \(10^{-6}\) — but now using Simpson's rule. How many steps should we use?
Solution:
Again we have \(a=0,b=1\text{.}\)
We then need to bound \(\ddiff{4}{}{x}e^{-x^2}\) on the domain of integration, \(0\leq x\leq 1\text{.}\)
So \(22\) steps of Simpson's rule will do the job.
\(n=22\) steps actually results in an error of \(3.5\times 10^{-8}\text{.}\) The reason that we get an error so much smaller than we need is that we have overestimated the number of steps required. This, in turn, occurred because we made quite a rough bound of \(\left|\ddiff{4}{}{x}f(x)\right|\leq 36\text{.}\) If we are more careful then we will get a slightly smaller \(n\text{.}\) It actually turns out 12 that you only need \(n=10\) to approximate within \(10^{-6}\text{.}\)
Subsection1.11.5Optional — An error bound for the midpoint rule
We now try develop some understanding as to why we got the above experimental results. We start with the error generated by a single step of the midpoint rule. That is, the error introduced by the approximation
\begin{equation*}
\int_{x_0}^{x_1}f(x)\,\dee{x}\approx f(\bar x_1)\De x \qquad\hbox{ where }
\De x=x_1-x_0,\ \bar x_1=\tfrac{x_0+x_1}{2}
\end{equation*}
To do this we are going to need to apply integration by parts in a sneaky way. Let us start by considering 13 a subinterval \(\alpha \leq x \leq \beta\) and let's call the width of the subinterval \(2q\) so that \(\beta=\alpha+2q\text{.}\) If we were to now apply the midpoint rule to this subinterval, then we would write
Let us apply integration by parts to \(\int_\alpha^{\alpha+q} f(x)\dee{x}\) — with \(u=f(x), \dee{v}=\dee{x}\) so \(\dee{u}=f'(x)\dee{x}\) and we will make the slightly non-standard choice of \(v=x-\alpha\text{:}\)
Notice that the first term on the right-hand side is the term we need, and that our non-standard choice of \(v\) allowed us to avoid introducing an \(f(\alpha)\) term.
Now integrate by parts again using \(u=f'(x), \dee{v}=(x-\alpha)\dee{x}\text{,}\) so \(\dee{u}=f''(x), v = \frac{(x-\alpha)^2}{2}\text{:}\)
A very similar analysis shows that, as was stated in Theorem 1.11.13 above,
the total error introduced by the trapezoidal rule is bounded by \(\ds \frac{M}{12}\frac{(b-a)^3}{n^2}\text{,}\)
the total error introduced by Simpson's rule is bounded by \(\ds \frac{M}{180}\frac{(b-a)^5}{n^4}\)
Exercises1.11.6Exercises
Recall that we are using \(\log x\) to denote the logarithm of \(x\) with base \(e\text{.}\) In other courses it is often denoted \(\ln x\text{.}\)
Exercises — Stage 1
.
1.
Suppose we approximate an object to have volume \(1.5 \mathrm{m}^3\text{,}\) when its exact volume is \(1.387 \mathrm{m}^3\text{.}\) Give the relative error, absolute error, and percent error of our approximation.
2.
Consider approximating \(\displaystyle\int_2^{10} f(x) \dee{x}\text{,}\) where \(f(x)\) is the function in the graph below.
Draw the rectangles associated with the midpoint rule approximation and \(n=4\text{.}\)
Draw the trapezoids associated with the trapezoidal rule approximation and \(n=4\text{.}\)
You don't have to give an approximation.
3.
Let \(f(x) = -\dfrac{1}{12}x^4+\dfrac{7}{6}x^3-3x^2\text{.}\)
Find a reasonable value \(M\) such that \(|f''(x)| \leq M\) for all \(1 \leq x \leq 6\text{.}\)
Find a reasonable value \(L\) such that \(|f^{(4)}(x)| \leq L\) for all \(1 \leq x \leq 6\text{.}\)
4.
Let \(f(x) = x\sin x+2\cos x\text{.}\) Find a reasonable value \(M\) such that \(|f''(x)| \leq M\) for all \(-3 \leq x \leq 2\text{.}\)
5.
Consider the quantity \(A=\displaystyle\int_{-\pi}^{\pi} \cos x \dee{x}\text{.}\)
Find the upper bound on the error using Simpson's rule with \(n=4\) to approximate \(A\) using Theorem 1.11.13 in the text.
Find the Simpson's rule approximation of \(A\) using \(n=4\text{.}\)
What is the (actual) absolute error in the Simpson's rule approximation of \(A\) with \(n=4\text{?}\)
6.
Give a function \(f(x)\) such that:
\(f''(x) \leq 3\) for every \(x\) in \([0,1]\text{,}\) and
the error using the trapezoidal rule approximating \(\displaystyle\int_0^1 f(x) \dee{x}\) with \(n=2\) intervals is exactly \(\dfrac{1}{16}\text{.}\)
7.
Suppose my mother is under 100 years old, and I am under 200 years old. 15 Who is older?
8.
True or False: for fixed positive constants \(M\text{,}\)\(n\text{,}\)\(a\text{,}\) and \(b\text{,}\) with \(b \gt a\text{,}\)
True or False: for a function \(f(x)\) and fixed constants \(n\text{,}\)\(a\text{,}\) and \(b\text{,}\) with \(b \gt a\text{,}\) the \(n\)-interval midpoint approximation of \(\displaystyle\int_a^b f(x) \dee{x}\) is more accurate than the \(n\)-interval trapezoidal approximation.
9.(✳).
Decide whether the following statement is true or false. If false, provide a counterexample. If true, provide a brief justification.
When \(f(x)\) is positive and concave up, any trapezoidal rule approximation for \(\displaystyle\int_{a}^{b} f(x) \,\dee{x}\) will be an upper estimate for \(\displaystyle\int_{a}^{b} f(x) \,\dee{x}\text{.}\)
10.
Give a polynomial \(f(x)\) with the property that the Simpson's rule approximation of \(\displaystyle\int_a^b f(x) \dee{x}\) is exact for all \(a\text{,}\)\(b\text{,}\) and \(n\text{.}\)
Exercises — Stage 2
.
Questions 11 and 12 ask you to approximate a given integral using the formulas in Equations 1.11.2, 1.11.6, and 1.11.9 in the text.
Questions 13 though 17 ask you to approximate a quantity based on observed data.
In Questions 18 through 24, we practice finding error bounds for our approximations.
11.
Write out all three approximations of \(\displaystyle\int_0^{30} \frac{1}{x^3+1} \dee{x}\) with \(n=6\text{.}\) (That is: midpoint, trapezoidal, and Simpson's.) You do not need to simplify your answers.
12.(✳).
Find the midpoint rule approximation to \(\displaystyle\int_0^\pi \sin x\dee{x}\) with \(n = 3\text{.}\)
13.(✳).
The solid \(V\) is 40 cm high and the horizontal cross sections are circular disks. The table below gives the diameters of the cross sections in centimeters at 10 cm intervals. Use the trapezoidal rule to estimate the volume of \(V\text{.}\)
height
0
10
20
30
40
diameter
24
16
10
6
4
14.(✳).
A \(6\) metre long cedar log has cross sections that are approximately circular. The diameters of the log, measured at one metre intervals, are given below:
metres from left end of log
0
1
2
3
4
5
6
diameter in metres
1.2
1
0.8
0.8
1
1
1.2
Use Simpson's Rule to estimate the volume of the log.
15.(✳).
The circumference of an 8 metre high tree at different heights above the ground is given in the table below. Assume that all horizontal cross--sections of the tree are circular disks.
height (metres)
0
2
4
6
8
circumference (metres)
1.2
1.1
1.3
0.9
0.2
Use Simpson's rule to approximate the volume of the tree.
16.(✳).
By measuring the areas enclosed by contours on a topographic map, a geologist determines the cross sectional areas \(A\) in \(\mathrm{m}^2\) of a \(60\) m high hill. The table below gives the cross sectional area \(A(h)\) at various heights \(h\text{.}\) The volume of the hill is \(V=\int_0^{60} A(h)\,\dee{h}\text{.}\)
\(h\)
0
10
20
30
40
50
60
\(A\)
10,200
9,200
8,000
7,100
4,500
2,400
100
If the geologist uses the Trapezoidal Rule to estimate the volume of the hill, what will be their estimate, to the nearest 1,000\(\mathrm{m}^3\text{?}\)
What will be the geologist's estimate of the volume of the hill if they use Simpson's Rule instead of the Trapezoidal Rule?
17.(✳).
The graph below applies to both parts (a) and (b).
Use the Trapezoidal Rule, with \(n = 4\text{,}\) to estimate the area under the graph between \(x = 2\) and \(x = 6\text{.}\) Simplify your answer completely.
Use Simpson's Rule, with \(n = 4\text{,}\) to estimate the area under the graph between \(x = 2\) and \(x = 6\text{.}\)
18.(✳).
The integral \(\displaystyle\int_{-1}^{1} \sin(x^2) \, \dee{x}\) is estimated using the Midpoint Rule with \(1000\) intervals. Show that the absolute error in this approximation is at most \(2\cdot 10^{-6}\text{.}\)
You may use the fact that when approximating \(\int_a^b f(x) \, \dee{x}\) with the Midpoint Rule using \(n\) points, the absolute value of the error is at most \(M(b-a)^3/24n^2\) when \(\left|f''(x)\right|\leq M\) for all \(x\in[a,b]\text{.}\)
19.(✳).
The total error using the midpoint rule with \(n\) subintervals to approximate the integral of \(f(x)\) over \([a,b]\) is bounded by \(\dfrac{M (b-a)^3}{(24n^2)}\text{,}\) if \(|f''(x)| \le M\) for all \(a \le x \le b\text{.}\)
Using this bound, if the integral \(\displaystyle\int_{-2}^{1} 2x^4 \,\dee{x}\) is approximated using the midpoint rule with \(60\) subintervals, what is the largest possible error between the approximation \(M_{60}\) and the true value of the integral?
20.(✳).
Both parts of this question concern the integral \(I = \displaystyle\int_{0}^{2} (x-3)^5\,\dee{x}\text{.}\)
Write down the Simpson's Rule approximation to \(I\) with \(n=6\text{.}\) Leave your answer in calculator-ready form.
Which method of approximating \(I\) results in a smaller error bound: the Midpoint Rule with \(n=100\) intervals, or Simpson's Rule with \(n=10\) intervals? You may use the formulas
where \(M\) is an upper bound for \(|f''(x)|\) and \(L\) is an upper bound for \(|f^{(4)}(x)|\text{,}\) and \(E_M\) and \(E_S\) are the absolute errors arising from the midpoint rule and Simpson's rule, respectively.
21.(✳).
Find a bound for the error in approximating \(\displaystyle\int_1^5 \frac{1}{x}\,\dee{x}\) using Simpson's rule with \(n = 4\text{.}\) Do not write down the Simpson's rule approximation \(S_4\text{.}\)
In general the error in approximating \(\int_a^b f(x)\dee{x}\) using Simpson's rule with \(n\) steps is bounded by \(\dfrac{L(b-a)}{180}(\De x)^4\) where \(\De x=\dfrac{b-a}{n}\) and \(L\ge |f^{(4)}(x)|\) for all \(a\le x\le b\text{.}\)
using Simpson's rule with \(n = 6\text{.}\) Do not write down the Simpson's rule approximation \(S_n\text{.}\)
In general, the error in approximating \(\int_a^b f(x)\dee{x}\) using Simpson's rule with \(n\) steps is bounded by \(\dfrac{ L(b-a)}{180}(\De x)^4\) where \(\De x=\dfrac{b-a}{n}\) and \(L\ge |f^{(4)}(x)|\) for all \(a\le x\le b\text{.}\)
23.(✳).
Let \(I=\displaystyle\int_1^2 (1/x)\,\dee{x}\text{.}\)
Write down the trapezoidal approximation \(T_4\) for \(I\text{.}\)You do not need to simplify your answer.
Write down the Simpson's approximation \(S_4\) for \(I\text{.}\)You do not need to simplify your answer.
Without computing \(I\text{,}\) find an upper bound for \(|I - S_4|\text{.}\) You may use the fact that if \(\big|f^{(4)}(x)\big|\le L\) on the interval \([a, b]\text{,}\) then the error in using \(S_n\) to approximate \(\int_a^b f(x)\,\dee{x}\) has absolute value less than or equal to \(L(b-a)^5/180n^4\text{.}\)
24.(✳).
A function \(s(x)\) satisfies \(s(0)=1.00664\text{,}\)\(s(2)=1.00543\text{,}\)\(s(4)=1.00435\text{,}\)\(s(6)=1.00331\text{,}\)\(s(8)=1.00233\text{.}\) Also, it is known to satisfy \(\big|s^{(k)}(x)\big|\le \dfrac{k}{1000}\) for \(0\le x\le 8\) and all positive integers \(k\text{.}\)
Find the best Trapezoidal Rule and Simpson's Rule approximations that you can for \(\displaystyle I=\int_0^8 s(x)\dee{x}\text{.}\)
Determine the maximum possible sizes of errors in the approximations you gave in part (a). Recall that if a function \(f(x)\) satisfies \(\big|f^{(k)}(x)\big|\le K_k\) on \([a,b]\text{,}\) then
Consider the trapezoidal rule for making numerical approximations to \(\displaystyle\int_a^b f(x)\dee{x}\text{.}\) The error for the trapezoidal rule satisfies \(|E_T| \le \dfrac{ M(b - a)^3}{12n^2}\) , where \(|f''(x)| \le M\) for \(a \le x \le b\text{.}\) If \(-2 \lt f''(x) \lt 0\) for \(1 \le x \le 4\text{,}\) find a value of \(n\) to guarantee the trapezoidal rule will give an approximation for \(\displaystyle\int_1^4 f(x)\dee{x}\) with absolute error, \(|E_T|\text{,}\) less than \(0.001\text{.}\)
Exercises — Stage 3
.
26.(✳).
A swimming pool has the shape shown in the figure below. The vertical cross--sections of the pool are semi--circular disks. The distances in feet across the pool are given in the figure at 2--foot intervals along the sixteen--foot length of the pool. Use Simpson's Rule to estimate the volume of the pool.
27.(✳).
A piece of wire 1m long with radius 1mm is made in such a way that the density varies in its cross--section, but is radially symmetric (that is, the local density \(g(r)\) in \({\rm kg/m^3}\) depends only on the distance \(r\) in mm from the centre of the wire). Take as given that the total mass \(W\) of the wire in kg is given by
Find the best Trapezoidal Rule approximation that you can for \(W\) based on the data in the table.
Suppose that it is known that \(|g'(r)| \lt 200\) and \(|g''(r)| \lt 150\) for all values of \(r\text{.}\) Determine the maximum possible size of the error in the approximation you gave in part (a). Recall that if a function \(f(x)\) satisfies \(|f''(x)|\le M\) on \([a,b]\text{,}\) then
where \(I=\int_a^b f(x)\,\dee{x}\) and \(T_n\) is the Trapezoidal Rule approximation to \(I\) using \(n\) subintervals.
28.(✳).
Simpson's rule can be used to approximate \(\log 2\text{,}\) since \(\displaystyle\log 2=\int_1^2\frac{1}{x}\,\dee{x}\text{.}\)
Use Simpson's rule with 6 subintervals to approximate \(\log 2\text{.}\)
How many subintervals are required in order to guarantee that the absolute error is less than \(0.00001\text{?}\)
Note that if \(E_n\) is the error using \(n\) subintervals, then \(|E_n|\le\dfrac{L(b-a)^5}{180n^4}\) where \(L\) is the maximum absolute value of the fourth derivative of the function being integrated and \(a\) and \(b\) are the end points of the interval.
29.(✳).
Let \(I={\displaystyle\int_0^2}\cos(x^2)\dee{x}\) and let \(S_n\) be the Simpson's rule approximation to \(I\) using \(n\) subintervals.
Estimate the maximum absolute error in using \(S_8\) to approximate \(I\text{.}\)
How large should \(n\) be in order to ensure that \(|I-S_n|\le 0.0001\text{?}\)
Note: The graph of \(f''''(x)\text{,}\) where \(f(x)=\cos(x^2)\text{,}\) is shown below. The absolute error in the Simpson's rule approximation is bounded by \(\dfrac{L(b-a)^5}{180n^4}\) when \(|f''''(x)|\le L\) on the interval \([a,b]\text{.}\)
30.(✳).
Define a function \(f(x)\) and an integral \(I\) by
Estimate how many subdivisions are needed to calculate \(I\) to five decimal places of accuracy using the trapezoidal rule.
Note that if \(E_n\) is the error using \(n\) subintervals, then \(|E_n|\le\dfrac{M(b-a)^3}{12n^2\vphantom{\frac{1}{2}}}\text{,}\) where \(M\) is the maximum absolute value of the second derivative of the function being integrated and \(a\) and \(b\) are the limits of integration.
31.
Let \(f(x)\) be a function 18 with \(f''(x) = \dfrac{x^2}{x+1}\text{.}\)
Show that \(|f''(x)| \leq 1\) whenever \(x\) is in the interval \([0,1]\text{.}\)
Find the maximum value of \(|f''(x)|\) over the interval \([0,1]\text{.}\)
Assuming \(M=1\text{,}\) how many intervals should you use to approximate \(\displaystyle\int_{0}^{1}f(x) \dee{x}\) to within \(10^{-5}\text{?}\)
Using the value of \(M\) you found in (b), how many intervals should you use to approximate \(\displaystyle\int_0^1 f(x) \dee{x}\) to within \(10^{-5}\text{?}\)
32.
Approximate the function \(\log x\) with a rational function by approximating the integral \(\displaystyle\int_1^{x\vphantom{\frac{1}{2}}} \frac{1}{t} \dee{t}\) using Simpson's rule. Your rational function \(f(x)\) should approximate \(\log x\) with an error of not more than 0.1 for any \(x\) in the interval \([1,3]\text{.}\)
33.
Using an approximation of the area under the curve \(\dfrac{1}{x^2+1}\text{,}\) show that the constant \(\arctan2\) is in the interval \(\left[\dfrac{\pi}{4}+0.321,\, \dfrac{\pi}{4}+0.323\right]\text{.}\)
You may assume use without proof that \(\displaystyle\ddiff{4}{}{x}\left\{\frac{1}{1+x^2}\right\} = \dfrac{24(5x^4-10x^2+1)}{(x^2+1)^5}\text{.}\) You may use a calculator, but only to add, subtract, multiply, and divide.
We apologise for being a little sloppy here — but we just want to say that it can be very hard or even impossible to write some integrals as some finite sized expression involving polynomials, exponentials, logarithms and trigonometric functions. We don't want to get into a discussion of computability, though that is a very interesting topic.
Thankfully it is very easy to write a program to apply the midpoint rule.
This method is also called the “trapezoid rule” and “trapezium rule”.
A trapezoid is a four sided polygon, like a rectangle. But, unlike a rectangle, the top and bottom of a trapezoid need not be parallel.
Simpson's rule is named after the 18th century English mathematician Thomas Simpson, despite its use a century earlier by the German mathematician and astronomer Johannes Kepler. In many German texts the rule is often called Kepler's rule.
There is an easy generalisation of Simpson's rule that uses cubics instead of parabolas. It is known as Simpson's second rule and Simpson's \(\frac38\) rule. While one can push this approach further (using quartics, quintics etc), it can sometimes lead to larger errors — the interested reader should look up Runge's phenomenon.
Indeed, even beyond the “real world” of many applications in first year calculus texts, some of the methods we have described are used by actual people (such as ship builders, engineers and surveyors) to estimate areas and volumes of actual objects!
There is a variant of this trick that works even when you don't know the answer to the integral ahead of time. Suppose that you suspect that the approximation satisfies \(M_n=A+K\tfrac{1}{n^k}\) where \(A\) is the exact value of the integral and suppose that you don't know the values of \(A\text{,}\)\(K\) and \(k\text{.}\) Then \(M_{n}-M_{2n} =K\tfrac{1}{n^k}-K\tfrac{1}{(2n)^k} =K\big(1-\tfrac{1}{2^k}\big)\tfrac{1}{n^k}\) so plotting \(y=\log(M_{n}-M_{2n})\) against \(x=\log n\) gives the straight line \(y=\log \big[K\big(1-\frac{1}{2^k}\big)\big] -kx\text{.}\)
Now is a good time for a quick revision of logarithms — see “Whirlwind review of logarithms” in Section 2.7 of the CLP-1 text.
Linear regression is not part of this course as its derivation requires some multivariable calculus. It is a very standard technique in statistics.
This is our favourite running example of an integral that cannot be evaluated algebraically — we need to use numerical methods.
The authors tested this empirically.
We chose this interval so that we didn't have lots of subscripts floating around in the algebra.
The triangle inequality says that for any real numbers \(x,y\)\(|x+y| \leq |x| + |y|.\)
We're going somewhere with this.
Anyone caught trying to come up with a scenario in which I am older than my mother will be sent to maximum security grad school.
This is what the error bound always tells us.
For example, \(f(x)=\frac{1}{6}x^3-\frac{1}{2}x^2+(1+x)\log|x+1|\) will do, but you don't need to know what \(f(x)\) is for this problem.
