Exponential Distribution

Section 8.3 Exponential Distribution

Once again, consider a Poisson Process where you start with an interval of variable length X so that X measures the interval needed in order to obtain a first success with \(R = (0,\infty)\text{.}\) The resulting distribution of X will be called an Exponential distribution.

To derive the probability function for this distribution, consider finding f(x) by first considering F(x).

Theorem 8.3.1. Exponential Probability Function.

For an exponential random variable \(X\text{,}\)

\begin{equation*} f(x) = \lambda e^{-\lambda x}, \end{equation*}

where \(\lambda\) is a given parameter.

(Note that we will find later that \(\lambda = \frac{1}{\mu}\) or the reciprocal of the theoretical mean.)

Proof.

\begin{align*} F(x)& = P(X \le x)\\ & = 1 - P(X \gt x)\\ & = 1 - P(\text{first change occurs after an interval of length} x)\\ & = 1 - P(\text{no changes in the interval} [0,x])\\ & = 1 - \frac{(\lambda x)^0 e^{-\lambda x}}{0!}\\ & = 1 - e^{-\lambda x} \end{align*}

where the discrete Poisson Probability Function is used to answer the probability of exactly no changes in the "fixed" interval [0,x].

Using this distribution function and taking the derivative yields

\begin{equation*} f(x) = F'(x) = \lambda e^{-\lambda x}. \end{equation*}

We found that if \(\lambda\) is the parameter for the Poisson process, then the Poisson distribution had mean \(\lambda T\) or if one presumed that T=1, then for that distribution, the mean is just \(\lambda\text{.}\) We will find out below that the mean for the exponential distribution will be \(\frac{1}{\lambda}\text{.}\) Therefore, we will eventually present this formula using the exponental mean \(\mu = \frac{1}{\lambda}\) rather than using \(\lambda\) in the actual formula.

You will also often find that exercises in other textbooks and in online WeBWorK will just provide \(\lambda\) for the underlying Poisson process and that the time interval T will be presumed to be T=1. For those problems, if the exercise asks for a Poisson probability, use \(\mu = \lambda\) while if the exercise asks for an Exponential probability, use \(\mu = \frac{1}{\lambda}\text{.}\)

Theorem 8.3.2. Verification of Exponential Probability Function.

\begin{equation*} \int_0^{\infty} \lambda e^{-\lambda x} dx = 1 \end{equation*}

Proof.

\begin{align*} & \int_0^{\infty} \lambda e^{-\lambda x} dx\\ & = \int_0^{\infty} e^{-u} du\\ & = -e^{-u} \big |_0^{\infty} = 1 \end{align*}

where we used the substitution \(u = \lambda x\text{.}\)

Theorem 8.3.3. Derivation of Statistics for Exponential Distribution and Plotting.

\begin{equation*} \mu = \frac{1}{\lambda} \end{equation*}

\begin{equation*} \sigma^2 = \mu^2 \end{equation*}

\begin{equation*} \gamma_1 = 2 \end{equation*}

\begin{equation*} \gamma_2 = 9 \end{equation*}

Proof.

For the mean, use integration by parts with \(u = x\) and \(dv = \lambda e^{-\lambda \cdot x}\) to get (eventually)

\begin{align*} \text{Mean} = \mu & = \int_0^{\infty} x \cdot \lambda e^{-\lambda x} dx\\ & = \left [ -(x+\frac{1}{\lambda}) e^{-\lambda \cdot x} \right ] \big |_0^{\infty} \\ & = \frac{1}{\lambda}. \end{align*}

and so the use of \(\lambda = \frac{1}{\mu}\) in f(x) is warranted.

The remaining statistics are derived similarly using repeated integration by parts. The interactive Sage cell below calculates those for you automatically.

Corollary 8.3.4. Alternate Form for the Exponential Distribution Probability Function.

Given a Poisson process and a constant \(\mu = \frac{1}{\lambda}\text{,}\) suppose \(X\) measures the variable interval length needed until you get a first success. Then \(X\) has an exponential distribution with probability function

\begin{equation*} f(x) = \frac{1}{\mu} e^{-\frac{x}{\mu}}. \end{equation*}

Proof.

Simply replace the mean as derived above in the original function.

Theorem 8.3.5. Distribution function for Exponential Distribution.

\begin{equation*} F(x) = 1 - e^{-\frac{x}{\mu}} \end{equation*}

Proof.

Using \(f(x) = \frac{1}{\mu} e^{-\frac{x}{\mu}}\text{,}\) note

\begin{align*} F(x) & = \int_0^x \frac{1}{\mu} e^{-\frac{u}{\mu}} du\\ & = - e^{-\frac{u}{\mu}} \big |_0^x\\ & = 1 - e^{-\frac{x}{\mu}} \end{align*}

Example 8.3.6. Router Requests Revisited.

Once again, let's consider a router which, over time, has been shown to receive on average 1000 such requests in any given 10 minute period during regular working hours. This would mean that, on average, it would take \(\mu = \frac{10}{1000} = \frac{1}{100} = 0.01\) minutes (i.e., less than a second) to receive the first request. If X were to measure the time interval until the first actual request comes in, then the Exponential distribution would be a good model using

\begin{equation*} f(x) = \frac{1}{0.01} e^{-\frac{x}{0.01}}. \end{equation*}

Let's determine the probability that a first request arrives in the next two seconds. First, note that since X is a continuous variable that f(x) is NOT the probability of exactly X minutes but you must integrate to compute all probabilities. Also, the next 2 seconds is actually the next \(\frac{2}{60} = \frac{1}{30}\) of a minute. Therefore, F(x) is what you need in general and you find

\begin{equation*} P(X \le \frac{1}{30}) = F(\frac{1}{30}) = 1 - e^{-\frac{\frac{1}{30}}{0.01}} \approx 0.96433. \end{equation*}

Checkpoint 8.3.7. WebWork - Exponential.

Suppose that the time (in hours) required to repair a machine is an exponentially distributed random variable with parameter \(\lambda = 0.8\text{.}\) What is

(a) the probability that a repair time exceeds \(10\) hours?

(b) the conditional probability that a repair takes at least \(9\) hours, given that it takes more than \(6\) hours?

Answer 1.

\(0.000335462627902512\)

Answer 2.

\(0.0907179532894125\)

Theorem 8.3.8. The Exponential Distribution yields a continuous memoryless model..

If X has an exponential distribution and a and b are nonnegative integers, then

\begin{equation*} P( X > a + b \; \; | \; \; X > b ) = P( X > a) \end{equation*}

Proof.

Using the definition of conditional probability,

\begin{align*} P( X > a + b | X > b ) & = P( X > a + b \cap X > b ) \ P( X > b)\\ & = P( X > a + b ) / P( X > b)\\ & = e^{-(a+b)/ \mu} / e^{-b / \mu}\\ & = e^{-a/ \mu}\\ & = P(X > a) \end{align*}

Checkpoint 8.3.9.

It can be presumed that the life span in years of a certain brand of lightbulbs follows the Poisson process assumptions. Suppose that the mean life span till failure is known to be 0.7 years. A tester makes random observations of the life times of this particular brand of lightbulbs and records them one by one as either a success if the life time exceeds 1 year, or as a failure otherwise.

Determine the probability that a randomly tested bulb lasts more than 1 year:

Determine probability that the first success occurs in the fifth observation:

Determine the probability that the second success occurs in the 8th observation given that the first success occurred in the 3rd observation:

Determine the probability that the first success occurs in an odd-numbered observation:

Hint.

Use the exponential distribution to get the first answer. Use the geometric to get the remainder.

\(0.2397\)

\(0.0801\)

\(0.0801\)

\(0.5681\)

Essentials of Mathematical Probability and Statistics

Search Results:

Section 8.3 Exponential Distribution

Theorem 8.3.1. Exponential Probability Function.

Proof.

Theorem 8.3.2. Verification of Exponential Probability Function.

Proof.

Theorem 8.3.3. Derivation of Statistics for Exponential Distribution and Plotting.

Proof.

Corollary 8.3.4. Alternate Form for the Exponential Distribution Probability Function.

Proof.

Theorem 8.3.5. Distribution function for Exponential Distribution.

Proof.

Example 8.3.6. Router Requests Revisited.

Checkpoint 8.3.7. WebWork - Exponential.

Theorem 8.3.8. The Exponential Distribution yields a continuous memoryless model..

Proof.

Checkpoint 8.3.9.