Math 2.0

Probability theory and stochastic processes Proof

Proof that independence means the joint law is the product of the marginals

Builds on Independence of two random variablesJoint probability distributionMarginal distributionLaw of a random variableRandom variableProduct measureProduct sigma-algebraSigma-finite measureProbability measureSigma-algebraPreimage of a set

Proof

  1. Let (Ω,ℱ,P)(\Omega, \mathcal{F}, P) be the probability space. Let XX and YY be random variables with values in (E1,ℰ1)(E_1, \mathcal{E}_1) and (E2,ℰ2)(E_2, \mathcal{E}_2).
  2. Let Z ⁣:Ω→E1×E2Z \colon \Omega \to E_1 \times E_2 be Z(ω)=(X(ω),Y(ω))Z(\omega) = (X(\omega), Y(\omega)). Let π1\pi_1 and π2\pi_2 be the coordinate projections of E1×E2E_1 \times E_2.
  3. Let 𝒢\mathcal{G} be the family of sets C⊆E1×E2C \subseteq E_1 \times E_2 whose preimage Z−1(C)Z^{-1}(C) lies in ℱ\mathcal{F}.
  4. 𝒢\mathcal{G} is a σ-algebra. Indeed Z−1(E1×E2)=ΩZ^{-1}(E_1 \times E_2) = \Omega, preimages commute with complements, and the preimage of a union is the union of the preimages.
  5. For A∈ℰ1A \in \mathcal{E}_1, π1−1(A)=A×E2\pi_1^{-1}(A) = A \times E_2 and Z−1(A×E2)=X−1(A)∈ℱZ^{-1}(A \times E_2) = X^{-1}(A) \in \mathcal{F}. In the same way Z−1(π2−1(B))=Y−1(B)∈ℱZ^{-1}(\pi_2^{-1}(B)) = Y^{-1}(B) \in \mathcal{F} for B∈ℰ2B \in \mathcal{E}_2.
  6. So 𝒢\mathcal{G} contains the generators of the product σ-algebra ℰ1⊗ℰ2\mathcal{E}_1 \otimes \mathcal{E}_2. Hence ℰ1⊗ℰ2⊆𝒢\mathcal{E}_1 \otimes \mathcal{E}_2 \subseteq \mathcal{G}.
  7. By step 6 the joint law μ(X,Y)(C)=P(Z−1(C))\mu_{(X, Y)}(C) = P(Z^{-1}(C)) is defined for all C∈ℰ1⊗ℰ2C \in \mathcal{E}_1 \otimes \mathcal{E}_2.
  8. μ(X,Y)\mu_{(X, Y)} is a probability measure. Its total mass is P(Ω)=1P(\Omega) = 1. Disjoint sets have disjoint preimages, and preimages respect unions, so countable additivity of PP passes to μ(X,Y)\mu_{(X, Y)}.
  9. The same argument shows that the laws μX(A)=P(X∈A)\mu_X(A) = P(X \in A) and μY(B)=P(Y∈B)\mu_Y(B) = P(Y \in B) are probability measures.
  10. They are the marginal laws of μ(X,Y)\mu_{(X, Y)}: by step 5, μ(X,Y)(A×E2)=μX(A)\mu_{(X, Y)}(A \times E_2) = \mu_X(A) and μ(X,Y)(E1×B)=μY(B)\mu_{(X, Y)}(E_1 \times B) = \mu_Y(B).
  11. Let A∈ℰ1A \in \mathcal{E}_1 and B∈ℰ2B \in \mathcal{E}_2. Then A×B=π1−1(A)∩π2−1(B)A \times B = \pi_1^{-1}(A) \cap \pi_2^{-1}(B) lies in ℰ1⊗ℰ2\mathcal{E}_1 \otimes \mathcal{E}_2, and Z−1(A×B)=X−1(A)∩Y−1(B)Z^{-1}(A \times B) = X^{-1}(A) \cap Y^{-1}(B).
  12. So μ(X,Y)(A×B)=P(X∈A, Y∈B)\mu_{(X, Y)}(A \times B) = P(X \in A, \, Y \in B) for all A∈ℰ1A \in \mathcal{E}_1 and B∈ℰ2B \in \mathcal{E}_2.
  13. The measures μX\mu_X and μY\mu_Y are finite, so they are σ-finite. Hence the product measure μX⊗μY\mu_X \otimes \mu_Y exists.
  14. By its definition, μX⊗μY\mu_X \otimes \mu_Y is the unique measure on ℰ1⊗ℰ2\mathcal{E}_1 \otimes \mathcal{E}_2 with (μX⊗μY)(A×B)=P(X∈A) P(Y∈B)(\mu_X \otimes \mu_Y)(A \times B) = P(X \in A) \, P(Y \in B) for all AA and BB.
  15. Suppose that XX and YY are independent. Then step 12 gives μ(X,Y)(A×B)=P(X∈A) P(Y∈B)\mu_{(X, Y)}(A \times B) = P(X \in A) \, P(Y \in B) for all A∈ℰ1A \in \mathcal{E}_1 and B∈ℰ2B \in \mathcal{E}_2.
  16. So μ(X,Y)\mu_{(X, Y)} is a measure on ℰ1⊗ℰ2\mathcal{E}_1 \otimes \mathcal{E}_2 with the property of step 14. By the uniqueness in step 14, μ(X,Y)=μX⊗μY\mu_{(X, Y)} = \mu_X \otimes \mu_Y.
  17. Conversely, suppose that μ(X,Y)=μX⊗μY\mu_{(X, Y)} = \mu_X \otimes \mu_Y. Evaluating both sides at A×BA \times B and using steps 12 and 14 gives P(X∈A, Y∈B)=P(X∈A) P(Y∈B)P(X \in A, \, Y \in B) = P(X \in A) \, P(Y \in B).
  18. This holds for all A∈ℰ1A \in \mathcal{E}_1 and B∈ℰ2B \in \mathcal{E}_2, so XX and YY are independent.

Idea

On a rectangle A×BA \times B, the joint law gives P(X∈A,Y∈B)P(X \in A, Y \in B) and the product measure gives P(X∈A)P(Y∈B)P(X \in A) P(Y \in B). Independence says exactly that these agree. A measure on the product σ-algebra is determined by its values on rectangles, so agreement on rectangles is the same as equality of the measures.

Reading path

To understand this page from the ground up, read these 55 pages in order. The foundations come first.

  1. Cartesian product concept
  2. Construction of the reals from Cauchy sequences concept
  3. Element definition
  4. Integers object
  5. Measurable function concept
  6. Measurable space concept
  7. Measure concept
  8. Ordered field definition
  9. Product sigma-algebra concept
  10. Proposition concept
  11. Random experiment concept
  12. Rational numbers object
  13. Real numbers object
  14. Sigma-algebra concept
  15. Sigma-finite measure concept
  16. Set definition
  17. Ring of integers statement
  18. Product sigma-algebra definition
  19. Disjunction definition
  20. Implication definition
  21. Predicate definition
  22. Product measure definition
  23. Ordered pair definition
  24. Union definition
  25. Existential quantifier definition
  26. Sample space definition
  27. Universal quantifier definition
  28. The rationals form a field statement
  29. Cartesian product definition
  30. Subset definition
  31. Uniqueness quantifier definition
  32. The rationals form an ordered field statement
  33. Binary relation definition
  34. Universal set definition
  35. Power set definition
  36. Order on the reals definition
  37. Function definition
  38. Complement definition
  39. Interval definition
  40. Preimage of a set definition
  41. Sigma-algebra definition
  42. Event definition
  43. Borel sigma-algebra definition
  44. Probability axioms concept
  45. Probability measure definition
  46. Probability distribution definition
  47. Probability space definition
  48. Conditional probability definition
  49. Random variable definition
  50. Independence of two events definition
  51. Law of a random variable definition
  52. Independence of two random variables definition
  53. Joint probability distribution definition
  54. Marginal distribution definition
  55. Proof that independence means the joint law is the product of the marginals proof

Where this leads

96 pages build on this one.

Further reading

  1. Web https://www.math.cmu.edu/~ttkocz/teaching/1920/prob-grad-notes.pdf
About this page
TagYYSQJQ81ZF
URIm2://YYSQJQ81ZF
Kindproof
WritingW0 stub
MSC60A05
ProvesIndependence means the joint law is the product of the marginals
UsesIndependence of two random variables, Joint probability distribution, Marginal distribution, Law of a random variable, Random variable, Product measure, Product sigma-algebra, Sigma-finite measure, Probability measure, Sigma-algebra, Preimage of a set
Changed4 November 2026

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.