Math 2.0

Probability theory and stochastic processes Proof

Proof of the law of total probability

Builds on Probability spaceProbability measureConditional probabilityPartition of a setSigma-algebraProbability of the complement

Proof

  1. Let (Ω,ℱ,P)(\Omega, \mathcal{F}, P) be a probability space. Let (Bi)i∈I(B_i)_{i \in I} be the given family, with I={1,…,N}I = \set{1, \dots, N} or I={1,2,… }I = \set{1, 2, \dots}.
  2. So the BiB_i are pairwise disjoint events with ⋃i∈IBi=Ω\bigcup_{i \in I} B_i = \Omega and P(Bi)>0P(B_i) > 0. They form a partition of Ω\Omega. Let AA be an event.
  3. For each integer i≥1i \ge 1 let Ei=A∩BiE_i = A \cap B_i if i∈Ii \in I, and Ei=∅E_i = \varnothing if i∉Ii \notin I. Each EiE_i is in ℱ\mathcal{F}, because ℱ\mathcal{F} is a σ-algebra.
  4. The EiE_i are pairwise disjoint. For i≠ji \ne j in II we have Ei∩Ej⊆Bi∩Bj=∅E_i \cap E_j \subseteq B_i \cap B_j = \varnothing, and the empty sets meet nothing.
  5. Their union is ⋃i∈I(A∩Bi)=A∩⋃i∈IBi=A∩Ω=A\bigcup_{i \in I} (A \cap B_i) = A \cap \bigcup_{i \in I} B_i = A \cap \Omega = A.
  6. By the complement rule, P(∅)=1−P(Ω)=0P(\varnothing) = 1 - P(\Omega) = 0.
  7. By the countable additivity of the probability measure PP and step 6, P(A)=∑i∈IP(A∩Bi)P(A) = \sum_{i \in I} P(A \cap B_i).
  8. For i∈Ii \in I we have P(Bi)>0P(B_i) > 0. By the definition of conditional probability, P(A∩Bi)=P(A∣Bi) P(Bi)P(A \cap B_i) = P(A \mid B_i) \, P(B_i).
  9. Substituting step 8 into step 7 gives P(A)=∑iP(A∣Bi) P(Bi)P(A) = \sum_{i} P(A \mid B_i) \, P(B_i).

Idea

The partition cuts AA into the disjoint pieces A∩BiA \cap B_i, so P(A)P(A) is the sum of their probabilities. Each piece has probability P(A∣Bi)P(Bi)P(A \mid B_i) P(B_i) by the definition of conditional probability.

Reading path

To understand this page from the ground up, read these 61 pages in order. The foundations come first. The path takes the proofs Proof of the approximation property of the supremum, Proof of the probability of the complement, Proof that the reals form an ordered field, with the Cauchy sequence construction, Proof that the reals are Archimedean from the completeness axiom.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Integers object
  4. Ordered field definition
  5. Proposition concept
  6. Random experiment concept
  7. Rational numbers object
  8. Real numbers object
  9. Set bounded above definition
  10. Set definition
  11. Ring of integers statement
  12. Archimedean ordered field definition
  13. Conjunction definition
  14. Disjunction definition
  15. Implication definition
  16. Predicate definition
  17. The reals form a field statement
  18. Supremum definition
  19. Empty set object
  20. Family of sets definition
  21. Ordered pair definition
  22. Intersection definition
  23. Union definition
  24. Sample space definition
  25. The rationals form a field statement
  26. Existential quantifier definition
  27. Universal quantifier definition
  28. Completeness axiom statement
  29. Disjoint sets definition
  30. Cartesian product definition
  31. Subset definition
  32. Union of a family of sets definition
  33. The rationals form an ordered field statement
  34. Universal set definition
  35. Binary relation definition
  36. Partition of a set definition
  37. Order on the reals definition
  38. Power set definition
  39. Antisymmetric relation definition
  40. Complement definition
  41. Reflexive relation definition
  42. Transitive relation definition
  43. Interval definition
  44. Sigma-algebra definition
  45. Preorder definition
  46. Partial order definition
  47. Event definition
  48. Total order definition
  49. Probability axioms concept
  50. Probability measure definition
  51. Proof that the reals form an ordered field, with the Cauchy sequence construction proof
  52. Probability space definition
  53. The reals form an ordered field statement
  54. Conditional probability definition
  55. Proof of the approximation property of the supremum proof
  56. Approximation property of the supremum statement
  57. Proof that the reals are Archimedean from the completeness axiom proof
  58. The reals are Archimedean statement
  59. Proof of the probability of the complement proof
  60. Probability of the complement statement
  61. Proof of the law of total probability proof

Where this leads

39 pages build on this one.

Further reading

  1. Web https://proofwiki.org/wiki/Total_Probability_Theorem
About this page
TagPWHGN2Q7TC
URIm2://PWHGN2Q7TC
Kindproof
WritingW0 stub
MSC60A05
ProvesLaw of total probability
UsesProbability space, Probability measure, Conditional probability, Partition of a set, Sigma-algebra, Probability of the complement
Changed4 November 2026

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.