Basic Concepts of Probability

Tags
Probability
Computer Science
School
Published
December 9, 2024
Author
Junkai Ji

Experiments, Sample Spaces, and Events

  1. Experiment: A process or action with uncertain outcomes that can be repeated under identical conditions.
    1. Example: Tossing a coin, rolling a die, or drawing a card from a deck.
  1. Sample Space (): The set of all possible outcomes of an experiment.
      • For tossing a coin:
      • For rolling a die:
  1. Event (): A subset of the sample space, representing outcomes of interest.
      • Rolling an even number on a die:
      • Drawing a red card from a standard deck:

Set Theory and Events

Probability theory uses set operations to describe relationships between events:
  1. Union (): The event that either , , or both occur.
💡
Rolling a number less than 3 () or an even number ():
  1. Intersection (): The event that both and occur.
💡
For and :
  1. Complement (): The event that does not occur.
💡
If for rolling a die, then:
  1. Mutually Exclusive Events: Events that cannot occur simultaneously.
💡
Rolling an odd number and rolling an even number on a die:

Axioms of Probability

Probability is based on Kolmogorov's three axioms:
  1. Non-Negativity: for any event .
  1. Normalization: , where is the sample space.
  1. Additivity: For mutually exclusive events

Probability Measures

A probability measure assigns a value to each event in the sample space, satisfying the axioms of probability. Let be the sample space with probabilities . A valid probability measure satisfies:
  1. for all .
  1. .
  1. For an event , .

Examples

💡
Tossing Two Coins:
Sample Space:
Event:
Probability:
💡
Rolling a Fair Die:
Sample Space:
Event:
Probability:
💡
If two dice are rolled, what is the probability that the sum is 7 given that one die shows 4?:
Sample Space:
Event : Sum = 7 and one die shows 4:
Probability: