Probability rules provide a consistent method for calculating the likelihood of events. The foundational rules include non-negativity, normalization, and additivity for mutually exclusive events. From these axioms, several useful rules can be derived. The complement rule states that the probability of an event not occurring is one minus the probability that it occurs. The addition rule gives the probability that at least one of two events occurs. When two events are mutually exclusive, their intersection is empty, so their probabilities can be added directly. When they overlap, the probability of their intersection must be subtracted once to avoid double counting. The multiplication rule and conditional probability are also important in probability, although their full treatment belongs to later topics. For independent events, the probability of both events occurring is the product of their probabilities. These rules must be applied according to the relationships between events; independence and mutual exclusivity are different concepts.
Basic Probability Rules
Basic probability rules are mathematical principles that govern how probabilities are assigned and calculated, including the complement rule and the addition rule for combined events.
P(A) ≥ 0
P(S) = 1
P(Aᶜ) = 1 − P(A)
P(A ∪ B) = P(A) + P(B) − P(A ∩ B)
P(A ∪ B) = P(A) + P(B), when A and B are mutually exclusive
P(A ∩ B) = P(A)P(B), when A and B are independent
Explanation
Variables
A and B: Events.
P(A): Probability of event A.
P(B): Probability of event B.
Aᶜ: Complement of A.
A ∪ B: Union of A and B.
A ∩ B: Intersection of A and B.
S: Sample space.
Example or application
When rolling a fair die, the event of obtaining an even number is {2, 4, 6}. Its probability is 3/6 = 1/2. The probability of not obtaining an even number is 1 − 1/2 = 1/2.
Definition
Basic probability rules are mathematical laws derived from the probability axioms that govern the valid calculation and combination of event probabilities.
Purpose
The purpose of basic probability rules is to provide reliable methods for calculating probabilities of individual events, complementary events, and combinations of events.
Importance
These rules are the foundation of more advanced probability. They prevent common calculation errors, such as double counting overlapping events or multiplying probabilities without checking independence.
Learning Objectives
State the basic probability axioms.
Apply the complement rule.
Apply the addition rule for mutually exclusive events.
Explain how overlapping events are handled.
Distinguish independence from mutual exclusivity.
Key Concepts
Non-negativity
Normalization
Additivity
Complement rule
Addition rule
Mutually exclusive events
Independent events
Working Principle
Probability rules combine event probabilities while accounting for logical relationships between events. The complement rule handles non-occurrence, the addition rule handles 'or' conditions, and multiplication rules handle suitable 'and' conditions. The correct rule depends on whether events overlap or are independent.
Process
Define the events and sample space.
Identify whether the problem involves an event, its complement, a union, or an intersection.
Check whether the events are mutually exclusive or independent when relevant.
Select the appropriate probability rule.
Substitute known probability values.
Calculate and verify that the result lies between 0 and 1.
Applications
Risk calculation
Medical testing
Reliability engineering
Card and dice problems
Statistical modelling
Decision analysis
Computer simulations
Worked Example
A fair die is rolled once. Let A be the event of obtaining an even number, so A = {2, 4, 6}, and let B be the event of obtaining a number greater than 3, so B = {4, 5, 6}. Then P(A) = 3/6, P(B) = 3/6, and P(A ∩ B) = 2/6 because the common outcomes are {4, 6}. By the addition rule, P(A ∪ B) = 3/6 + 3/6 − 2/6 = 4/6 = 2/3.
Common Misconceptions
The probabilities of overlapping events cannot simply be added without accounting for their intersection.
Mutually exclusive events cannot occur together, while independent events do not change one another's probabilities.
Independence does not mean that events are unrelated in every possible sense.
The multiplication rule for independent events should not be used when independence has not been established.
Every calculated probability must be between 0 and 1.
Practice Questions
State the complement rule.
When can the probabilities of two events be added directly?
Why is the intersection subtracted in the general addition rule?
What is the difference between independent and mutually exclusive events?
If P(A) = 0.4, find P(Aᶜ).
If P(A) = 0.5, P(B) = 0.6, and P(A ∩ B) = 0.2, calculate P(A ∪ B).
Key Takeaway
Probability rules provide a consistent way to calculate event likelihoods. Correct application requires understanding whether events overlap, are mutually exclusive, or are independent.
Prerequisites
Events and Their Representation
Simple and Compound Events
Probability Notation and Terminology
Probability Scale: Zero to One
Reference
Sheldon Ross, A First Course in Probability, Pearson.
Joseph K. Blitzstein and Jessica Hwang, Introduction to Probability, CRC Press.
OpenStax, Introductory Statistics.
Related Topics
Events and Their Representation
Simple and Compound Events
Subjective and Axiomatic Probability
Conditional Probability
Sources and verification
Sources are shown as provided in the project data. Not every source has yet been independently verified. Please report errors or missing citations.
- Source verification pending; check an authoritative textbook, university, standards body, or peer-reviewed source.