Probability theory and stochastic processes Proof
Proof of the product formula for the characteristic function of a sum of independent random variables
Builds on Characteristic functionIndependence of random variablesIndependence of two random variablesExpectation of a product of independent random variablesLinearity of expectationEuler's formulaProduct of exponentialsPi-systemDynkin systemDynkin's π-λ theoremContinuity of probability measuresMeasurable function
Proof
We write as a product and argue by induction on the number of factors. We split each complex factor into its real and imaginary parts.
- Let be independent real random variables on , and let . Fix .
- For each , let . By Euler's formula, , so its real and imaginary parts are bounded by .
- For a complex variable with bounded real variables and , write . By the definition of the characteristic function, and .
- By the product of exponentials, .
- For , let be the family of events with Borel sets . Let be the σ-algebra generated by .
- The intersection of two such events is , again in . So is a π-system.
- Fix a Borel set and let . For in , the definition of independence with gives .
- The same definition with gives . So for each .
- Let be the family of events with . It contains .
- If are in , then . This is , so .
- If are in with union , then increases to . By continuity of probability, .
- By steps 9 to 11, is a Dynkin system that contains . By Dynkin's π-λ theorem, .
- Claim: if is a bounded real -measurable variable and is a bounded continuous real function, then .
- Proof of the claim. Each event with Borel lies in . Each event equals , and is Borel.
- By step 12, and are independent. Both are bounded, hence integrable. The product rule for independent variables gives the claim.
- Let , and write with , real. Since , we have , so and are bounded by .
- Expanding the product, and are sums of products of the variables and with . Fix and a Borel set . The set is Borel, since is continuous.
- So the event lies in , with all other sets equal to . The same holds for , so these variables are -measurable.
- Sums and products of measurable functions are measurable. So and are -measurable.
- Let and . Then .
- By linearity of expectation and the claim of step 13, .
- The right side equals .
- Since , with , step 22 gives for .
- By induction on , starting from , we get for .
- For , steps 3, 4 and 24 give .
Idea
The exponential turns the sum into the product of the factors . Independence lets the expectation of a product split into the product of the expectations. The π-λ theorem makes the first factors, taken together, independent of the next one, and the real and imaginary parts are handled separately.
Reading path
To understand this page from the ground up, read these 184 pages in order. The foundations come first. The path takes the proofs Proof of the limit of a sum of sequences, Proof of the approximation property of the supremum, Proof of the continuity of probability measures, Proof that a complex number times its conjugate is the square of its modulus, Proof of the probability of the complement, Proof of the equality of complex numbers, Proof that the reals form an ordered field, with the Cauchy sequence construction, Proof that subsequences of a convergent sequence converge to the same limit, Proof of the limit of a product of sequences, Proof that the absolute value is multiplicative, Proof of the squeeze theorem for sequences, Proof of the existence of square roots of nonnegative reals, Proof of Pascal's rule from the recursive definition, Proof that i squared is minus one, Proof of the expectation of a product of independent random variables by simple functions, Proof of the monotonicity of probability, Proof of the triangle inequality for real numbers, Proof of the epsilon-N definition of the limit of a sequence, Proof that the modulus is multiplicative, Proof of the factorial formula for binomial coefficients by induction, Proof of the product of exponentials by the Cauchy product, Proof that the complex numbers form a field, Proof of the binomial theorem by induction, Proof that the reals are Archimedean from the completeness axiom, Proof that convergent sequences are bounded, Proof of the monotone convergence theorem for sequences, Proof of Euler's formula by power series, Proof that a series of nonnegative terms converges iff its partial sums are bounded, Proof that the Cauchy product of absolutely convergent series converges absolutely to the product, Proof that independence means the joint law is the product of the marginals.
- Binomial coefficient definition
- Cartesian product concept
- Complex numbers object
- Complex numbers as pairs of reals concept
- Construction of the reals from Cauchy sequences concept
- Dynkin system concept
- Element definition
- Extended real number line object
- Factorial definition
- Group concept
- Imaginary unit object
- Integers object
- Integral of a non-negative function concept
- Mathematical induction concept
- Measurable function concept
- Measurable space concept
- Measure concept
- Measure space concept
- Ordered field definition
- Pi-system concept
- Probability measure concept
- Product sigma-algebra concept
- Proposition concept
- Random experiment concept
- Rational numbers object
- Real numbers object
- Sequence definition
- Set bounded above definition
- Sigma-algebra concept
- Sigma-finite measure concept
- Simple function concept
- Proof of Pascal's rule from the recursive definition proof
- Complex exponential definition
- Power series in the complex plane definition
- Real and imaginary parts definition
- Proof that i squared is minus one proof
- Set definition
- Ring definition
- Ring of integers statement
- Monotone convergence theorem statement
- Product sigma-algebra definition
- Archimedean ordered field definition
- Dynkin's π-λ theorem statement
- Disjunction definition
- Implication definition
- Predicate definition
- Product measure definition
- The reals form a field statement
- Real sequence definition
- Subsequence definition
- Supremum definition
- Pascal's rule statement
- Complex conjugate definition
- Ordered pair definition
- i squared is minus one statement
- Commutative ring definition
- Unit of a ring definition
- Union definition
- Existential quantifier definition
- Sample space definition
- Universal quantifier definition
- The rationals form a field statement
- Bounded sequence definition
- Limit of a sequence definition
- Monotone sequence definition
- Series definition
- Integral of a non-negative function definition
- Completeness axiom statement
- Cartesian product definition
- Proof of the factorial formula for binomial coefficients by induction proof
- Proof of the equality of complex numbers proof
- Field definition
- Uniqueness quantifier definition
- Subset definition
- Convergent sequence definition
- Cauchy product definition
- Partial sum definition
- The rationals form an ordered field statement
- Binary relation definition
- Equality of complex numbers statement
- Factorial formula for binomial coefficients statement
- Power set definition
- Universal set definition
- Order on the reals definition
- Convergent series definition
- Antisymmetric relation definition
- Reflexive relation definition
- Transitive relation definition
- Proof of the binomial theorem by induction proof
- Function definition
- Complement definition
- Interval definition
- Proof that the complex numbers form a field proof
- Sum of a series definition
- Absolute convergence definition
- Binomial theorem statement
- Preorder definition
- Injective function definition
- Indicator function definition
- Preimage of a set definition
- Sigma-algebra definition
- The complex numbers form a field statement
- Partial order definition
- Countable set definition
- Event definition
- Dynkin system definition
- Borel sigma-algebra definition
- Total order definition
- Probability axioms concept
- Probability measure definition
- Proof that the reals form an ordered field, with the Cauchy sequence construction proof
- Probability distribution definition
- Probability space definition
- The reals form an ordered field statement
- Conditional probability definition
- Absolute value definition
- Random variable definition
- Proof of the approximation property of the supremum proof
- Proof of the existence of square roots of nonnegative reals proof
- Cumulative distribution function definition
- Independence of two events definition
- Law of a random variable definition
- Discrete random variable definition
- Proof of the triangle inequality for real numbers proof
- Proof that the absolute value is multiplicative proof
- Random variable with a density definition
- Proof of the epsilon-N definition of the limit of a sequence proof
- Existence of square roots of nonnegative reals statement
- Approximation property of the supremum statement
- Joint probability distribution definition
- Mutual independence of events definition
- Independence of two random variables definition
- Probability mass function definition
- Triangle inequality statement
- Absolute value is multiplicative statement
- Expected value definition
- Probability density function definition
- Square root definition
- Epsilon-N definition of the limit of a sequence statement
- Proof that the reals are Archimedean from the completeness axiom proof
- Marginal distribution definition
- Independent sigma-algebras definition
- Modulus of a complex number definition
- Law of the unconscious statistician statement
- Proof of the squeeze theorem for sequences proof
- Linearity of expectation statement
- Proof of the limit of a sum of sequences proof
- Proof that convergent sequences are bounded proof
- The reals are Archimedean statement
- Proof of the monotone convergence theorem for sequences proof
- Proof that subsequences of a convergent sequence converge to the same limit proof
- Independence of random variables definition
- Proof that a complex number times its conjugate is the square of its modulus proof
- Proof of the probability of the complement proof
- Proof that independence means the joint law is the product of the marginals proof
- Squeeze theorem statement
- Convergent sequences are bounded statement
- Limit of a sum of sequences statement
- Floor function definition
- Monotone convergence theorem for sequences statement
- Subsequences of a convergent sequence converge to the same limit statement
- A complex number times its conjugate statement
- Independence means the joint law is the product of the marginals statement
- Probability of the complement statement
- Proof of the limit of a product of sequences proof
- Proof that a series of nonnegative terms converges iff its partial sums are bounded proof
- Proof of the monotonicity of probability proof
- Proof that the modulus is multiplicative proof
- A series of nonnegative terms converges iff its partial sums are bounded statement
- Limit of a product of sequences statement
- Modulus is multiplicative statement
- Monotonicity of probability statement
- Proof of Euler's formula by power series proof
- Proof that the Cauchy product of absolutely convergent series converges absolutely to the product proof
- Proof of the expectation of a product of independent random variables by simple functions proof
- Proof of the continuity of probability measures proof
- Euler's formula statement
- Expectation of a product of independent random variables statement
- Cauchy product of absolutely convergent series statement
- Continuity of probability measures statement
- Characteristic function definition
- Proof of the product of exponentials by the Cauchy product proof
- Product of exponentials statement
- Proof of the product formula for the characteristic function of a sum of independent random variables proof
Where this leads
35 pages build on this one.
- Characteristic function of a sum of independent random variables
- De Moivre–Laplace theorem
- Weak law of large numbers
- Strong law of large numbers
- Central limit theorem
- Sum of independent normal random variables
- Sample average approximation
- Ergodic decomposition
- Koksma–Hlawka inequality
- Consistency of the maximum likelihood estimator
- Asymptotic equipartition property
- Source–channel separation theorem
- Kingman's subadditive ergodic theorem
- Asymptotic normality of the maximum likelihood estimator
- Typical set
- Edgeworth expansion
- Erdős–Kac theorem
- Proof of the de Moivre–Laplace theorem from the central limit theorem
- Monte Carlo integration
- Delta method
- Shannon–Hartley theorem
- Proof of the sum of independent normal random variables by characteristic functions
- Proof of the central limit theorem by characteristic functions
- Berry–Esseen theorem
- Birkhoff's ergodic theorem
- Ideal chain
- Oseledets theorem
- Noisy-channel coding theorem
- Flory–Huggins solution theory
- Kelly criterion
- Pesin theory
- Reptation
- Proof of the weak law of large numbers by characteristic functions
- Monte Carlo methods in finance
- Worm-like chain
Further reading
- Web https://en.wikipedia.org/wiki/Characteristic_function_(probability_theory), Basic manipulations of distributions
About this page
| Tag | Y1TKWM24AH |
|---|---|
| URI | m2://Y1TKWM24AH |
| Kind | proof |
| Writing | W0 stub |
| MSC | 60E10 |
| Proves | Characteristic function of a sum of independent random variables |
| Uses | Characteristic function, Independence of random variables, Independence of two random variables, Expectation of a product of independent random variables, Linearity of expectation, Euler's formula, Product of exponentials, Pi-system, Dynkin system, Dynkin's π-λ theorem, Continuity of probability measures, Measurable function |
| Changed | 4 November 2026 |
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.