✦ScienexySCIENCE KNOWLEDGE LIBRARY
reference · SCI-MAT-009-018

Basic Probability Rules

Basic probability rules are mathematical principles that govern how probabilities are assigned and calculated, including the complement rule and the addition rule for combined events.

  • P(A) ≥ 0

  • P(S) = 1

  • P(Aᶜ) = 1 − P(A)

  • P(A ∪ B) = P(A) + P(B) − P(A ∩ B)

  • P(A ∪ B) = P(A) + P(B), when A and B are mutually exclusive

  • P(A ∩ B) = P(A)P(B), when A and B are independent

Explanation

Probability rules provide a consistent method for calculating the likelihood of events. The foundational rules include non-negativity, normalization, and additivity for mutually exclusive events. From these axioms, several useful rules can be derived. The complement rule states that the probability of an event not occurring is one minus the probability that it occurs. The addition rule gives the probability that at least one of two events occurs. When two events are mutually exclusive, their intersection is empty, so their probabilities can be added directly. When they overlap, the probability of their intersection must be subtracted once to avoid double counting. The multiplication rule and conditional probability are also important in probability, although their full treatment belongs to later topics. For independent events, the probability of both events occurring is the product of their probabilities. These rules must be applied according to the relationships between events; independence and mutual exclusivity are different concepts.

Variables

  • A and B: Events.

  • P(A): Probability of event A.

  • P(B): Probability of event B.

  • Aᶜ: Complement of A.

  • A ∪ B: Union of A and B.

  • A ∩ B: Intersection of A and B.

  • S: Sample space.

Example or application

When rolling a fair die, the event of obtaining an even number is {2, 4, 6}. Its probability is 3/6 = 1/2. The probability of not obtaining an even number is 1 − 1/2 = 1/2.

Definition

Basic probability rules are mathematical laws derived from the probability axioms that govern the valid calculation and combination of event probabilities.

Purpose

The purpose of basic probability rules is to provide reliable methods for calculating probabilities of individual events, complementary events, and combinations of events.

Importance

These rules are the foundation of more advanced probability. They prevent common calculation errors, such as double counting overlapping events or multiplying probabilities without checking independence.

Learning Objectives

  • State the basic probability axioms.

  • Apply the complement rule.

  • Apply the addition rule for mutually exclusive events.

  • Explain how overlapping events are handled.

  • Distinguish independence from mutual exclusivity.

Key Concepts

  • Non-negativity

  • Normalization

  • Additivity

  • Complement rule

  • Addition rule

  • Mutually exclusive events

  • Independent events

Working Principle

Probability rules combine event probabilities while accounting for logical relationships between events. The complement rule handles non-occurrence, the addition rule handles 'or' conditions, and multiplication rules handle suitable 'and' conditions. The correct rule depends on whether events overlap or are independent.

Process

  • Define the events and sample space.

  • Identify whether the problem involves an event, its complement, a union, or an intersection.

  • Check whether the events are mutually exclusive or independent when relevant.

  • Select the appropriate probability rule.

  • Substitute known probability values.

  • Calculate and verify that the result lies between 0 and 1.

Applications

  • Risk calculation

  • Medical testing

  • Reliability engineering

  • Card and dice problems

  • Statistical modelling

  • Decision analysis

  • Computer simulations

Worked Example

A fair die is rolled once. Let A be the event of obtaining an even number, so A = {2, 4, 6}, and let B be the event of obtaining a number greater than 3, so B = {4, 5, 6}. Then P(A) = 3/6, P(B) = 3/6, and P(A ∩ B) = 2/6 because the common outcomes are {4, 6}. By the addition rule, P(A ∪ B) = 3/6 + 3/6 − 2/6 = 4/6 = 2/3.

Common Misconceptions

  • The probabilities of overlapping events cannot simply be added without accounting for their intersection.

  • Mutually exclusive events cannot occur together, while independent events do not change one another's probabilities.

  • Independence does not mean that events are unrelated in every possible sense.

  • The multiplication rule for independent events should not be used when independence has not been established.

  • Every calculated probability must be between 0 and 1.

Practice Questions

  • State the complement rule.

  • When can the probabilities of two events be added directly?

  • Why is the intersection subtracted in the general addition rule?

  • What is the difference between independent and mutually exclusive events?

  • If P(A) = 0.4, find P(Aᶜ).

  • If P(A) = 0.5, P(B) = 0.6, and P(A ∩ B) = 0.2, calculate P(A ∪ B).

Key Takeaway

Probability rules provide a consistent way to calculate event likelihoods. Correct application requires understanding whether events overlap, are mutually exclusive, or are independent.

Prerequisites

  • Events and Their Representation

  • Simple and Compound Events

  • Probability Notation and Terminology

  • Probability Scale: Zero to One

Reference

  • Sheldon Ross, A First Course in Probability, Pearson.

  • Joseph K. Blitzstein and Jessica Hwang, Introduction to Probability, CRC Press.

  • OpenStax, Introductory Statistics.

Related Topics

  • Events and Their Representation

  • Simple and Compound Events

  • Subjective and Axiomatic Probability

  • Conditional Probability

Sources and verification

Sources are shown as provided in the project data. Not every source has yet been independently verified. Please report errors or missing citations.

  • Source verification pending; check an authoritative textbook, university, standards body, or peer-reviewed source.

Suggest a correction or source · More in Probability