Definition 4.7.1 Independent Events
Events A and B are independent provided
You have seen when repeatedly sampling without replacement leads to a change the the likelihood of some event in successive trials. Indeed, this is what conditional probabilities above illustrate. However, when sampling with replacement you may find a different situation arises. Indeed, you easily notice that when flipping a coin, P(Heads) = 1/2 regardless of the outcome of any previous flip. In situations such as this where the probability of an event is not affected by the occurrence (or lack of occurrence) of some other event determining the probability of compound events can be greatly simplified.
Events A and B are independent provided
Definition 4.7.1 Independent Events
Given independent events A and B, and
Corollary 4.7.2 Independence and Conditional Probability
Proof
By the multiplication rule and the definition of independence, for any events A and B
Therefore, if P(A) is non-zero, canceling yields the first result. Switching around notation provides the second.
Independence makes combined probabilities VERY easy to compute.
Basically you just multiply individual probabilities together. Independence is often assumed since it makes computations easier. That said, you should remember to consider each time whether independence should or should not be assumed.
If events A and B are both independent and mutually exclusive, then at least one of them has zero probability.
Corollary 4.7.4 Independence and Mutual Exclusivity
Proof
By independence, \(P(A \cap B) = P(A) \cdot P(B)\text{.}\) However, by mutually exclusivity, \(A \cap B = \emptyset \Rightarrow P(A \cap B) = 0\) gives
Hence, one or the other (or both) must be zero.
Given a sequence of mutually independent events \(A_1, A_2, A_3, ...\text{,}\)
Corollary 4.7.5 Successive Independent Events