Probability theory and stochastic processes Proof
Proof of the central limit theorem by characteristic functions
Builds on Independent and identically distributed random variablesIndependence of random variablesCharacteristic functionCharacteristic function of a sum of independent random variablesCharacteristic function of the normal distributionLévy's continuity theoremThe characteristic function determines the distributionConvergence in distributionNormal distributionVarianceDominated convergence theoremFundamental theorem of calculusTaylor's theorem with the Lagrange remainderProduct of exponentialsLinearity of expectation
Proof
We show that the characteristic function of the normalized sum tends to . Then we use Lévy's continuity theorem.
- Let . For a Borel set , with the continuous map . So the are independent and identically distributed, like the i.i.d. variables .
- By linearity of expectation and the definition of the variance, and .
- Let . Note that .
- Let be the characteristic function of . It is also the characteristic function of each , since it depends only on the law.
- By the definition, . By the characteristic function of a sum of independent random variables, .
- Claim: for real . By the fundamental theorem of calculus, on real and imaginary parts, . Also .
- So the modulus in step 6 is at most , which proves the claim.
- Claim: for real . Again , so by step 7 the modulus is at most .
- Also, by step 7, the modulus is at most . This proves the claim.
- For real , let . By step 2, .
- By step 8 with , .
- Claim: as . Let . The integrand tends to at each , since it is at most . It is bounded by , which is integrable.
- By dominated convergence, . Since the sequence was arbitrary, the claim holds.
- Claim: . By Taylor's theorem with the Lagrange remainder, for there is with . Since , the error is at most .
- Steps 11 and 14 give .
- Claim: for complex with and , . Indeed , and each of the terms has modulus at most .
- Fix . By the product of exponentials, . Also and .
- By steps 5, 16, 17 and 15 with , .
- By step 13, the right side tends to . So for each .
- The function is continuous at . By Lévy's continuity theorem, is the characteristic function of a random variable , and in distribution.
- By the characteristic function of the normal distribution, is also the characteristic function of . Since the characteristic function determines the distribution, , and its cumulative distribution function is .
- The standard normal density is bounded by . So , and is continuous at every point.
- By steps 20 to 22, for each . This is the claim of the theorem.
Idea
After centering and scaling, has characteristic function , the same to second order as . Raising to the power at multiplies the error by , but the error is , so the limit is . Lévy's continuity theorem turns this into convergence of the distribution functions.
Reading path
To understand this page from the ground up, read these 434 pages in order. The foundations come first. The path takes the proofs Proof that Darboux and Riemann integrals agree, Proof of integration by parts, Proof of the Cauchy–Hadamard theorem, Proof of the derivative of cosine by term-by-term differentiation, Proof of the Weierstrass M-test, Proof of the limit of a sum of sequences, Proof of Rolle's theorem, Proof of the approximation property of the supremum, Proof that every sequence has a monotone subsequence, by peaks, Proof of the formula for the derivative of a polynomial, Proof of the commutativity of addition by induction, Proof of term-by-term differentiation, Proof of the continuity of probability measures, Proof of the epsilon-delta form of continuity, Proof of the power rule by induction, Proof that absolutely convergent series converge, Proof of the sum of a finite geometric series, Proof that convergent sequences are Cauchy, Proof that a complex number times its conjugate is the square of its modulus, Proof that there is a natural number n with 1/n below any positive epsilon, Proof of the chain rule with an auxiliary difference quotient, Proof of the integral of the exponential function, Proof of the probability of the complement, Proof of the Cauchy criterion for series, Proof of the Cauchy criterion for sequences by the Bolzano–Weierstrass theorem, Proof of the reverse triangle inequality, Proof that the exponential series has infinite radius of convergence, Proof of the equality of complex numbers, Proof that continuous functions on a closed bounded interval are uniformly continuous, Proof that the reals form an ordered field, with the Cauchy sequence construction, Proof of the root test, Proof of the double negation law by a truth table, Proof that power series converge uniformly on smaller intervals inside the radius of convergence, Proof of the extreme value theorem by the Bolzano–Weierstrass theorem, Proof that subsequences of a convergent sequence converge to the same limit, Proof of the uniqueness of limits, Proof that Lipschitz functions are uniformly continuous, Proof that the integral of a continuous function is an antiderivative, Proof of strong induction from ordinary induction, Proof that power series are differentiable inside the radius of convergence, Proof of the limit of a product of sequences, Proof that uniform convergence of derivatives allows term-by-term differentiation, Proof that the absolute value is multiplicative, Proof of the squeeze theorem for sequences, Proof of the existence of square roots of nonnegative reals, Proof of Pascal's rule from the recursive definition, Proof that i squared is minus one, Proof of the expectation of a product of independent random variables by simple functions, Proof of the linearity of differentiation, Proof of the angle addition formulas by differentiation, Proof of the mean value theorem for integrals, Proof of the monotonicity of probability, Proof of Riemann's criterion for integrability, Proof of the sequential characterization of limits, Proof of the Cauchy mean value theorem from Rolle's theorem, Proof that Cauchy sequences are bounded, Proof of the triangle inequality for real numbers, Proof of the epsilon-N definition of the limit of a sequence, Proof of the first fundamental theorem of calculus, Proof that the modulus is multiplicative, Proof of the comparison test, Proof of the existence of the infimum by negation, Proof of Fermat's theorem on stationary points, Proof that limits preserve non-strict inequalities, Proof of the linearity of the integral, Proof of the formula for the characteristic function of the normal distribution, Proof of the factorial formula for binomial coefficients by induction, Proof of integration by substitution, Proof of the product of exponentials by the Cauchy product, Proof of the second fundamental theorem of calculus, Proof that the complex numbers form a field, Proof of the intermediate value theorem by the supremum, Proof of the binomial theorem by induction, Proof that exponentials dominate powers in sequences, by the ratio of consecutive terms, Proof of Taylor's theorem with the Lagrange remainder by the Cauchy mean value theorem, Proof that differentiable functions are continuous, Proof that one-sided limits of a monotone function exist, Proof of the epsilon-delta form of the limit of a function, Proof of the derivative of sine by term-by-term differentiation, Proof of the well-ordering principle from strong induction, Proof of the Bolzano–Weierstrass theorem by a monotone subsequence, Proof of the Archimedean property in an Archimedean ordered field, Proof that a composition of continuous functions is continuous, Proof of the exponential of a sum by the Cauchy product, Proof of the additivity of the integral over intervals, Proof that a decreasing sequence bounded below converges, Proof of the term test, Proof that the exponential function is its own derivative, by term-by-term differentiation, Proof that the reals are Archimedean from the completeness axiom, Proof of the ratio test, Proof of the power series of the exponential function, Proof that convergent sequences are bounded, Proof of the product rule, Proof of the monotone convergence theorem for sequences, Proof that continuity is equivalent to sequential continuity, Proof of the formula for the moment-generating function of the normal distribution, Proof that a function with zero derivative on an open interval is constant, Proof of the monotonicity of the integral, Proof of the comparison test for improper integrals, Proof of the boundedness theorem by Bolzano–Weierstrass, Proof of the ratio formula for the radius of convergence, Proof of Euler's formula by power series, Proof of the fundamental theorem of calculus, Proof that a series of nonnegative terms converges iff its partial sums are bounded, Proof of the product formula for the characteristic function of a sum of independent random variables, Proof of the mean value theorem from Rolle's theorem, Proof that the Cauchy product of absolutely convergent series converges absolutely to the product, Proof that sums and products of continuous functions are continuous, Proof that independence means the joint law is the product of the marginals, Proof that continuous functions are Riemann integrable, Proof of the constant multiple rule.
- Almost everywhere concept
- Binomial coefficient definition
- Cartesian product concept
- Complex numbers object
- Complex numbers as pairs of reals concept
- Construction of the reals from Cauchy sequences concept
- Definition by recursion concept
- Dynkin system concept
- Element definition
- Extended real number line object
- Factorial definition
- Group concept
- Imaginary unit object
- Integers object
- Integrable function concept
- Integral of a non-negative function concept
- Lebesgue integral concept
- Limit point of a set definition
- Lipschitz continuity definition
- Local maximum definition
- Mathematical induction concept
- Measurable function concept
- Measurable space concept
- Measure concept
- Measure space concept
- Natural numbers object
- Ordered field definition
- Partition of an interval definition
- Peano axioms concept
- Pi-system concept
- Probability measure concept
- Product sigma-algebra concept
- Proposition concept
- Random experiment concept
- Rational numbers object
- Real numbers object
- Sequence definition
- Set bounded above definition
- Sigma-algebra concept
- Sigma-finite measure concept
- Simple function concept
- Proof of Pascal's rule from the recursive definition proof
- Complex exponential definition
- Power series in the complex plane definition
- Real and imaginary parts definition
- Proof that i squared is minus one proof
- Set definition
- Ring definition
- Ring of integers statement
- Limit of a function definition
- Monotone convergence theorem statement
- Local minimum definition
- Product sigma-algebra definition
- Archimedean ordered field definition
- Dynkin's π-λ theorem statement
- Successor function definition
- Mesh of a partition definition
- Refinement of a partition definition
- Riemann sum definition
- Product measure definition
- Conjunction definition
- Disjunction definition
- Implication definition
- Negation definition
- Predicate definition
- The reals form a field statement
- Real sequence definition
- Subsequence definition
- Infimum definition
- Supremum definition
- Pascal's rule statement
- Complex conjugate definition
- Ordered pair definition
- Commutative ring definition
- Unit of a ring definition
- i squared is minus one statement
- Continuity at a point definition
- Derivative definition
- Limit at infinity definition
- One-sided limit definition
- Union definition
- Addition of natural numbers definition
- Riemann integrable function definition
- Proof of the Archimedean property in an Archimedean ordered field proof
- Sample space definition
- Biconditional definition
- The rationals form a field statement
- Truth table concept
- Modus ponens concept
- The successor function is injective statement
- Zero is not a successor statement
- Existential quantifier definition
- Universal quantifier definition
- Integral of a non-negative function definition
- Bounded sequence definition
- Cauchy sequence definition
- Geometric sequence definition
- Limit of a sequence definition
- Monotone sequence definition
- Sequence tending to infinity definition
- Series definition
- Completeness axiom statement
- Cartesian product definition
- Field definition
- Proof of the factorial formula for binomial coefficients by induction proof
- Proof of the equality of complex numbers proof
- Continuous function definition
- Antiderivative definition
- Differentiable function definition
- One-sided derivative definition
- Riemann integral definition
- Archimedean property statement
- Subset definition
- Proof of the commutativity of addition by induction proof
- Mathematical proof concept
- Order on the natural numbers definition
- The rationals form an ordered field statement
- Propositional logic concept
- Uniqueness quantifier definition
- Limit inferior definition
- Limit superior definition
- Upper and lower Darboux sums definition
- Proof of the sum of a finite geometric series proof
- Convergent sequence definition
- Pointwise convergence definition
- Sequential continuity definition
- The sequence r^n tends to infinity for r > 1 example
- Cauchy product definition
- Partial sum definition
- Power series definition
- Equality of complex numbers statement
- Factorial formula for binomial coefficients statement
- Binary relation definition
- Proof that a composition of continuous functions is continuous proof
- Derivative function definition
- Universal set definition
- Definite integral definition
- Improper integral definition
- Order on the reals definition
- Power set definition
- Fatou's lemma statement
- Commutativity of addition statement
- Tautology definition
- Proof of strong induction from ordinary induction proof
- Upper and lower Darboux integrals definition
- Uniform convergence definition
- Sum of a finite geometric series statement
- Radius of convergence definition
- Convergent series definition
- Sine and cosine definition
- Proof of the binomial theorem by induction proof
- Antisymmetric relation definition
- Reflexive relation definition
- Transitive relation definition
- Higher derivative definition
- Proof that the complex numbers form a field proof
- Complement definition
- Interval definition
- Function definition
- Dominated convergence theorem statement
- Logical equivalence definition
- Uniform convergence on a set definition
- Strong induction statement
- Sum of a series definition
- Series of functions definition
- Absolute convergence definition
- Binomial theorem statement
- Preorder definition
- Taylor polynomial definition
- Continuously differentiable function definition
- Proof of the epsilon-delta form of continuity proof
- Proof of the epsilon-delta form of the limit of a function proof
- Sigma-algebra definition
- Injective function definition
- Indicator function definition
- Preimage of a set definition
- The complex numbers form a field statement
- Proof of the well-ordering principle from strong induction proof
- Proof of the double negation law by a truth table proof
- Partial order definition
- Smooth function definition
- Monotone function definition
- Epsilon-delta definition of continuity statement
- Epsilon-delta definition of a limit statement
- Countable set definition
- Event definition
- Dynkin system definition
- Double negation law statement
- Well-ordering principle statement
- Borel sigma-algebra definition
- Total order definition
- Uniform continuity definition
- Composition of continuous functions is continuous statement
- Probability axioms concept
- Taylor series definition
- Proof by contradiction concept
- Proof that every sequence has a monotone subsequence, by peaks proof
- Uniform continuity on a set definition
- Maclaurin series definition
- Probability measure definition
- Proof that Lipschitz functions are uniformly continuous proof
- Proof that the reals form an ordered field, with the Cauchy sequence construction proof
- Every sequence has a monotone subsequence statement
- Dirac measure definition
- Probability distribution definition
- Lipschitz functions are uniformly continuous statement
- Probability space definition
- The reals form an ordered field statement
- Absolute value definition
- Conditional probability definition
- Random variable definition
- Proof of the approximation property of the supremum proof
- Proof of the existence of square roots of nonnegative reals proof
- Proof of the existence of the infimum by negation proof
- Cumulative distribution function definition
- Law of a random variable definition
- Proof of the triangle inequality for real numbers proof
- Proof that the absolute value is multiplicative proof
- Independence of two events definition
- Discrete random variable definition
- Random variable with a density definition
- Proof of the epsilon-N definition of the limit of a sequence proof
- Existence of square roots of nonnegative reals statement
- Approximation property of the supremum statement
- Existence of the infimum statement
- Convergence in distribution definition
- Identically distributed random variables definition
- Joint probability distribution definition
- Triangle inequality statement
- Absolute value is multiplicative statement
- Independence of two random variables definition
- Probability density function definition
- Probability mass function definition
- Expected value definition
- Mutual independence of events definition
- Square root definition
- Epsilon-N definition of the limit of a sequence statement
- Proof that one-sided limits of a monotone function exist proof
- Proof of the intermediate value theorem by the supremum proof
- Proof that the reals are Archimedean from the completeness axiom proof
- Marginal distribution definition
- Proof of the reverse triangle inequality proof
- Proof that differentiable functions are continuous proof
- Variance definition
- Modulus of a complex number definition
- Proof that limits preserve non-strict inequalities proof
- Law of the unconscious statistician statement
- Proof of the squeeze theorem for sequences proof
- Density of the normal distribution definition
- Proof of the uniqueness of limits proof
- Proof of the limit of a sum of sequences proof
- Independent sigma-algebras definition
- Linearity of expectation statement
- Intermediate value theorem statement
- Proof of the linearity of the integral proof
- Proof that convergent sequences are bounded proof
- Proof that convergent sequences are Cauchy proof
- The reals are Archimedean statement
- Proof that Cauchy sequences are bounded proof
- Proof of the term test proof
- Proof that subsequences of a convergent sequence converge to the same limit proof
- The sequence 1/n tends to zero example
- Proof of the monotone convergence theorem for sequences proof
- Reverse triangle inequality statement
- Proof that a complex number times its conjugate is the square of its modulus proof
- Differentiable functions are continuous statement
- Normal distribution definition
- Proof of the probability of the complement proof
- Moment definition
- Independence of random variables definition
- Proof that independence means the joint law is the product of the marginals proof
- Linearity of the integral statement
- Proof of the monotonicity of the integral proof
- Limits preserve non-strict inequalities statement
- Floor function definition
- Proof that there is a natural number n with 1/n below any positive epsilon proof
- Uniqueness of limits statement
- Limit of a sum of sequences statement
- Proof of the ratio formula for the radius of convergence proof
- Squeeze theorem statement
- Convergent sequences are bounded statement
- Proof that Darboux and Riemann integrals agree proof
- Convergent sequences are Cauchy statement
- Subsequences of a convergent sequence converge to the same limit statement
- Cauchy sequences are bounded statement
- Monotone convergence theorem for sequences statement
- A complex number times its conjugate statement
- Independence means the joint law is the product of the marginals statement
- Independent and identically distributed random variables definition
- Probability of the complement statement
- Moment-generating function definition
- Proof of the limit of a product of sequences proof
- Monotonicity of the integral statement
- Darboux and Riemann integrals agree statement
- One-sided limits of a monotone function exist statement
- There is a natural number n with 1/n below any positive epsilon statement
- Term test statement
- Proof that a series of nonnegative terms converges iff its partial sums are bounded proof
- The sequence r^n tends to zero for |r| < 1 example
- Proof that a decreasing sequence bounded below converges proof
- Proof that the modulus is multiplicative proof
- Proof of the monotonicity of probability proof
- Proof of the sequential characterization of limits proof
- Proof that continuity is equivalent to sequential continuity proof
- Limit of a product of sequences statement
- Geometric series example
- Decreasing sequence bounded below converges statement
- Proof of Riemann's criterion for integrability proof
- A series of nonnegative terms converges iff its partial sums are bounded statement
- Modulus is multiplicative statement
- Monotonicity of probability statement
- Proof of Euler's formula by power series proof
- Continuity is equivalent to sequential continuity statement
- Riemann's criterion for integrability statement
- Proof of the expectation of a product of independent random variables by simple functions proof
- Sequential characterization of limits statement
- Proof that the Cauchy product of absolutely convergent series converges absolutely to the product proof
- Proof of the root test proof
- Proof of the ratio test proof
- Proof of the Cauchy–Hadamard theorem proof
- Proof of the comparison test proof
- Proof that exponentials dominate powers in sequences, by the ratio of consecutive terms proof
- Proof of the Bolzano–Weierstrass theorem by a monotone subsequence proof
- Euler's formula statement
- Proof of the continuity of probability measures proof
- Expectation of a product of independent random variables statement
- Proof of the chain rule with an auxiliary difference quotient proof
- Proof of the product rule proof
- Proof of the linearity of differentiation proof
- Comparison test statement
- Proof that sums and products of continuous functions are continuous proof
- Cauchy product of absolutely convergent series statement
- Proof of the additivity of the integral over intervals proof
- Bolzano–Weierstrass theorem statement
- Exponentials dominate powers in sequences statement
- Continuity of probability measures statement
- Chain rule statement
- Characteristic function definition
- Product rule statement
- Product of continuous functions is continuous statement
- Additivity of the integral over intervals statement
- Proof of the product of exponentials by the Cauchy product proof
- Proof that continuous functions on a closed bounded interval are uniformly continuous proof
- Linearity of differentiation statement
- Ratio test statement
- Root test statement
- Proof of the boundedness theorem by Bolzano–Weierstrass proof
- Proof of the Cauchy criterion for sequences by the Bolzano–Weierstrass theorem proof
- The characteristic function determines the distribution statement
- Product of exponentials statement
- Proof of the power rule by induction proof
- Continuous functions on a closed bounded interval are uniformly continuous statement
- Proof of the constant multiple rule proof
- Boundedness theorem statement
- Proof of the first fundamental theorem of calculus proof
- Proof of the comparison test for improper integrals proof
- Ratio formula for the radius of convergence statement
- Cauchy–Hadamard theorem statement
- Cauchy criterion for sequences statement
- Lévy's continuity theorem statement
- Power rule statement
- Constant multiple rule statement
- Comparison test for improper integrals statement
- Proof of the product formula for the characteristic function of a sum of independent random variables proof
- Proof of the extreme value theorem by the Bolzano–Weierstrass theorem proof
- Uniformly Cauchy sequence of functions definition
- Proof of the Cauchy criterion for series proof
- Characteristic function of a sum of independent random variables statement
- Extreme value theorem statement
- Proof of the formula for the derivative of a polynomial proof
- Proof of Fermat's theorem on stationary points proof
- Cauchy criterion for series statement
- Derivative of a polynomial statement
- Proof that continuous functions are Riemann integrable proof
- Proof that absolutely convergent series converge proof
- Fermat's theorem on stationary points statement
- Continuous functions are Riemann integrable statement
- Absolutely convergent series converge statement
- Proof of Rolle's theorem proof
- Rolle's theorem statement
- Proof of the mean value theorem for integrals proof
- Proof of the Weierstrass M-test proof
- Proof of the Cauchy mean value theorem from Rolle's theorem proof
- Proof of the mean value theorem from Rolle's theorem proof
- Mean value theorem for integrals statement
- Weierstrass M-test statement
- Mean value theorem statement
- First fundamental theorem of calculus statement
- Proof that power series converge uniformly on smaller intervals inside the radius of convergence proof
- Cauchy mean value theorem statement
- Proof that a function with zero derivative on an open interval is constant proof
- Proof that the integral of a continuous function is an antiderivative proof
- Proof that uniform convergence of derivatives allows term-by-term differentiation proof
- Power series converge uniformly on smaller discs inside the radius of convergence statement
- Proof of the second fundamental theorem of calculus proof
- A function with zero derivative is constant statement
- The integral of a continuous function is an antiderivative statement
- Proof of Taylor's theorem with the Lagrange remainder by the Cauchy mean value theorem proof
- Uniform convergence of derivatives allows term-by-term differentiation statement
- Second fundamental theorem of calculus statement
- Proof that the exponential series has infinite radius of convergence proof
- Taylor's theorem with the Lagrange remainder statement
- Proof of the fundamental theorem of calculus proof
- Proof of integration by parts proof
- Proof of integration by substitution proof
- Proof of term-by-term differentiation proof
- The exponential series has infinite radius of convergence statement
- Integration by substitution statement
- Fundamental theorem of calculus statement
- Integration by parts statement
- Term-by-term differentiation statement
- Exponential function definition
- Proof of the exponential of a sum by the Cauchy product proof
- Proof that power series are differentiable inside the radius of convergence proof
- Exponential of a sum statement
- Power series are differentiable inside the radius of convergence statement
- Proof of the formula for the moment-generating function of the normal distribution proof
- Proof that the exponential function is its own derivative, by term-by-term differentiation proof
- Proof of the derivative of cosine by term-by-term differentiation proof
- Proof of the derivative of sine by term-by-term differentiation proof
- The exponential function is its own derivative statement
- Moment-generating function of the normal distribution statement
- Derivative of cosine statement
- Derivative of sine statement
- Proof of the integral of the exponential function proof
- Proof of the power series of the exponential function proof
- Proof of the angle addition formulas by differentiation proof
- Integral of the exponential function statement
- Power series of the exponential function statement
- Angle addition formulas statement
- Integral of exp(-x) over the half line example
- Proof of the formula for the characteristic function of the normal distribution proof
- Characteristic function of the normal distribution statement
- Proof of the central limit theorem by characteristic functions proof
Where this leads
15 pages build on this one.
- De Moivre–Laplace theorem
- Central limit theorem
- Koksma–Hlawka inequality
- Asymptotic normality of the maximum likelihood estimator
- Edgeworth expansion
- Erdős–Kac theorem
- Proof of the de Moivre–Laplace theorem from the central limit theorem
- Monte Carlo integration
- Delta method
- Berry–Esseen theorem
- Ideal chain
- Flory–Huggins solution theory
- Reptation
- Monte Carlo methods in finance
- Worm-like chain
Further reading
- Web https://en.wikipedia.org/wiki/Central_limit_theorem, Proof of classical CLT
- Web https://sites.math.duke.edu/~rtd/PTE/PTE5_011119.pdf, Theorem 3.4.1 and Lemma 3.4.3
About this page
Markdown · JSON · Edit on GitHub
What this page needs for W1
- an inventory row: the row of the inventory that the node accounts for (0 of 1)
The writing levels say how complete the text of a page is. They do not measure its truth.
What links here
No page links to this page yet.