Probability theory and stochastic processes Proof
Proof that independence means the joint law is the product of the marginals
Builds on Independence of two random variablesJoint probability distributionMarginal distributionLaw of a random variableRandom variableProduct measureProduct sigma-algebraSigma-finite measureProbability measureSigma-algebraPreimage of a set
Proof
- Let be the probability space. Let and be random variables with values in and .
- Let be . Let and be the coordinate projections of .
- Let be the family of sets whose preimage lies in .
- is a σ-algebra. Indeed , preimages commute with complements, and the preimage of a union is the union of the preimages.
- For , and . In the same way for .
- So contains the generators of the product σ-algebra . Hence .
- By step 6 the joint law is defined for all .
- is a probability measure. Its total mass is . Disjoint sets have disjoint preimages, and preimages respect unions, so countable additivity of passes to .
- The same argument shows that the laws and are probability measures.
- They are the marginal laws of : by step 5, and .
- Let and . Then lies in , and .
- So for all and .
- The measures and are finite, so they are σ-finite. Hence the product measure exists.
- By its definition, is the unique measure on with for all and .
- Suppose that and are independent. Then step 12 gives for all and .
- So is a measure on with the property of step 14. By the uniqueness in step 14, .
- Conversely, suppose that . Evaluating both sides at and using steps 12 and 14 gives .
- This holds for all and , so and are independent.
Idea
On a rectangle , the joint law gives and the product measure gives . Independence says exactly that these agree. A measure on the product σ-algebra is determined by its values on rectangles, so agreement on rectangles is the same as equality of the measures.
Reading path
To understand this page from the ground up, read these 55 pages in order. The foundations come first.
- Cartesian product concept
- Construction of the reals from Cauchy sequences concept
- Element definition
- Integers object
- Measurable function concept
- Measurable space concept
- Measure concept
- Ordered field definition
- Product sigma-algebra concept
- Proposition concept
- Random experiment concept
- Rational numbers object
- Real numbers object
- Sigma-algebra concept
- Sigma-finite measure concept
- Set definition
- Ring of integers statement
- Product sigma-algebra definition
- Disjunction definition
- Implication definition
- Predicate definition
- Product measure definition
- Ordered pair definition
- Union definition
- Existential quantifier definition
- Sample space definition
- Universal quantifier definition
- The rationals form a field statement
- Cartesian product definition
- Subset definition
- Uniqueness quantifier definition
- The rationals form an ordered field statement
- Binary relation definition
- Universal set definition
- Power set definition
- Order on the reals definition
- Function definition
- Complement definition
- Interval definition
- Preimage of a set definition
- Sigma-algebra definition
- Event definition
- Borel sigma-algebra definition
- Probability axioms concept
- Probability measure definition
- Probability distribution definition
- Probability space definition
- Conditional probability definition
- Random variable definition
- Independence of two events definition
- Law of a random variable definition
- Independence of two random variables definition
- Joint probability distribution definition
- Marginal distribution definition
- Proof that independence means the joint law is the product of the marginals proof
Where this leads
96 pages build on this one.
- Characteristic function of a sum of independent random variables
- Expectation of a product of independent random variables
- De Moivre–Laplace theorem
- Independent random variables are uncorrelated
- Independence means the joint law is the product of the marginals
- Method of moments
- Weak law of large numbers
- Uncorrelated random variables that are not independent
- Strong law of large numbers
- Chi-squared test
- Central limit theorem
- Maximum likelihood estimation
- Student's t-test
- Sample variance
- Confidence interval
- Coupon collector's problem
- Student's t-distribution
- Sum of independent normal random variables
- Cumulant generating function
- Sample mean
- Generating function of a sum of independent random variables
- Chi-squared distribution
- Variance of a sum of independent random variables
- Hoeffding's inequality
- Moment-generating function of a sum of independent random variables
- Sum of independent Poisson random variables
- Sample average approximation
- Efficiency of an estimator
- Poisson regression
- Ergodic decomposition
- Koksma–Hlawka inequality
- Hodges' superefficient estimator
- Consistency of the maximum likelihood estimator
- Asymptotic equipartition property
- Source–channel separation theorem
- M-estimator
- Score test
- Kingman's subadditive ergodic theorem
- McDiarmid's inequality
- Asymptotic normality of the maximum likelihood estimator
- Typical set
- F-distribution
- Edgeworth expansion
- Sample mean and sample covariance
- Proof of the product formula for the moment-generating function of a sum of independent random variables
- Whittle likelihood
- Proof of Hoeffding's inequality via Hoeffding's lemma and the Chernoff bound
- Logistic regression
- Azuma's inequality
- Erdős–Kac theorem
- Proof of the de Moivre–Laplace theorem from the central limit theorem
- Monte Carlo integration
- Breakdown point
- Delta method
- Noncentral chi-squared distribution
- Behrens–Fisher problem
- Kruskal–Wallis test
- Shannon–Hartley theorem
- Wishart distribution
- Proof of the sum of independent normal random variables by characteristic functions
- Proof of the central limit theorem by characteristic functions
- Empirical likelihood
- Bayesian information criterion
- Berry–Esseen theorem
- Cochran's theorem
- Jackknife
- Birkhoff's ergodic theorem
- Akaike information criterion
- Independence of sample mean and sample variance for normal samples
- Estimating equations
- Ideal chain
- Generalized method of moments
- Proof that independent random variables are uncorrelated
- Oseledets theorem
- Noisy-channel coding theorem
- Flory–Huggins solution theory
- Likelihood-ratio test
- Expectation–maximization algorithm
- Hotelling's T-squared distribution
- Kelly criterion
- Wald test
- Proof of the formula for the variance of a sum of independent random variables
- Generalized linear model
- Box–Jenkins method
- Pesin theory
- Reptation
- Binomial proportion confidence interval
- Neyman construction
- Wilks' theorem
- Proof of the weak law of large numbers by characteristic functions
- Monte Carlo methods in finance
- Proof of the product formula for the characteristic function of a sum of independent random variables
- Frequentist inference
- Worm-like chain
- Observed information
- Point estimation
Further reading
About this page
| Tag | YYSQJQ81ZF |
|---|---|
| URI | m2://YYSQJQ81ZF |
| Kind | proof |
| Writing | W0 stub |
| MSC | 60A05 |
| Proves | Independence means the joint law is the product of the marginals |
| Uses | Independence of two random variables, Joint probability distribution, Marginal distribution, Law of a random variable, Random variable, Product measure, Product sigma-algebra, Sigma-finite measure, Probability measure, Sigma-algebra, Preimage of a set |
| Changed | 4 November 2026 |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
- a source with a locator (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.