Probability theory and stochastic processes Proof

Proof that moments are derivatives of the moment-generating function at zero

Builds on Moment-generating function Moment Expected value Linearity of expectation Power series of the exponential function Power series Radius of convergence Power series are differentiable inside the radius of convergence

Proof

We expand $e^{tX}$ in the exponential series, bound the tail, and then differentiate the resulting power series.

Let $X$ be a real random variable and let $h > 0$ with $M_X(t) = E[e^{tX}] < \infty$ for all $t \in (-h, h)$ . Here $M_X$ is the moment-generating function.
We use two properties of the expected value. If $0 \le U \le W$ then $E[U] \le E[W]$ . If $Y$ is integrable then $\abs{E[Y]} \le E[\abs{Y}]$ .
Let $0 \le s < h$ . One of $e^{sX}$ and $e^{-sX}$ equals $e^{s\abs{X}}$ , and the other is positive. So $e^{s\abs{X}} \le e^{sX} + e^{-sX}$ .
By steps 2 and 3, $E[e^{s\abs{X}}] \le M_X(s) + M_X(-s) < \infty$ .
Fix $k \ge 0$ and $s \in (0, h)$ . By the exponential series, whose terms are nonnegative for a nonnegative argument, $e^{s\abs{x}} \ge (s\abs{x})^k / k!$ .
So $\abs{X}^k \le k! \, s^{-k} e^{s\abs{X}}$ . By steps 2 and 4, $E[\abs{X}^k] < \infty$ . Thus $X$ has finite moments of all orders.
Fix $t$ with $\abs{t} < h$ . Choose $s$ with $\abs{t} < s < h$ , and let $r = \abs{t}/s \in [0, 1)$ .
For $N \ge 0$ and real $y$ , let $P_N(y) = \sum_{k=0}^{N} y^k / k!$ . By the exponential series, $\abs{e^y - P_N(y)} \le \sum_{k > N} \abs{y}^k / k!$ .
For $k \ge N + 1$ , $\abs{tX}^k = r^k \abs{sX}^k \le r^{N+1} \abs{sX}^k$ , since $r < 1$ .
By steps 8 and 9, $\abs{e^{tX} - P_N(tX)} \le r^{N+1} \sum_{k > N} \abs{sX}^k / k! \le r^{N+1} e^{s\abs{X}}$ .
By step 6 and linearity of expectation, $P_N(tX)$ is integrable and $E[P_N(tX)] = \sum_{k=0}^{N} E[X^k] \, t^k / k!$ .
The variable $e^{tX}$ is integrable, since $M_X(t) < \infty$ . By steps 2, 10 and 11, $\abs{M_X(t) - \sum_{k=0}^{N} \frac{E[X^k]}{k!} t^k} \le r^{N+1} E[e^{s\abs{X}}].$
By step 4, the right side is a finite constant times $r^{N+1}$ , which tends to $0$ as $N \to \infty$ .
So $M_X(t) = \sum_{k=0}^{\infty} E[X^k] \, t^k / k!$ for every $t \in (-h, h)$ .
Let $a_k = E[X^k]/k!$ . The power series $\sum a_k t^k$ converges at each $t \in (-h, h)$ . So its terms $a_k t^k$ are bounded for each such $t$ .
By the definition of the radius of convergence, the radius of $\sum a_k t^k$ is at least $\abs{t}$ for each $t \in (-h, h)$ . So it is at least $h$ .
Power series are differentiable inside the radius of convergence, and the derived series has the same radius. By induction on $j$ , $M_X$ is $j$ times differentiable on $(-h, h)$ for each $j$ .
The same induction gives, for $\abs{t} < h$ , $M_X^{(j)}(t) = \sum_{k=j}^{\infty} \frac{k!}{(k - j)!} \, a_k t^{k-j}.$
At $t = 0$ , only the term $k = j$ survives. So $M_X^{(j)}(0) = j! \, a_j = E[X^j]$ for each integer $j \ge 0$ .
Together with step 6 and step 14, this proves all claims.

Idea

Near $0$ the variable $e^{s\abs{X}}$ is integrable, and it dominates every power $\abs{X}^k$ and every tail of the series of $e^{tX}$ for $\abs{t} < s$ . So the expectation can be taken term by term. Then $M_X$ is a power series with coefficients $E[X^k]/k!$ , and its derivatives at $0$ read off these coefficients.

Reading path

To understand this page from the ground up, read these 269 pages in order. The foundations come first. The path takes the proofs Proof of the Cauchy–Hadamard theorem, Proof of the Weierstrass M-test, Proof of the limit of a sum of sequences, Proof of Rolle's theorem, Proof of the approximation property of the supremum, Proof that every sequence has a monotone subsequence, by peaks, Proof of the formula for the derivative of a polynomial, Proof of the commutativity of addition by induction, Proof of term-by-term differentiation, Proof of the epsilon-delta form of continuity, Proof of the power rule by induction, Proof that absolutely convergent series converge, Proof of the sum of a finite geometric series, Proof that convergent sequences are Cauchy, Proof that there is a natural number n with 1/n below any positive epsilon, Proof of the chain rule with an auxiliary difference quotient, Proof of the Cauchy criterion for series, Proof of the Cauchy criterion for sequences by the Bolzano–Weierstrass theorem, Proof that the exponential series has infinite radius of convergence, Proof that the reals form an ordered field, with the Cauchy sequence construction, Proof of the root test, Proof of the double negation law by a truth table, Proof that power series converge uniformly on smaller intervals inside the radius of convergence, Proof of the extreme value theorem by the Bolzano–Weierstrass theorem, Proof of the uniqueness of limits, Proof of strong induction from ordinary induction, Proof that power series are differentiable inside the radius of convergence, Proof of the limit of a product of sequences, Proof that uniform convergence of derivatives allows term-by-term differentiation, Proof that the absolute value is multiplicative, Proof of the squeeze theorem for sequences, Proof of Pascal's rule from the recursive definition, Proof of the linearity of differentiation, Proof of the sequential characterization of limits, Proof that Cauchy sequences are bounded, Proof of the triangle inequality for real numbers, Proof of the epsilon-N definition of the limit of a sequence, Proof of the comparison test, Proof of Fermat's theorem on stationary points, Proof that limits preserve non-strict inequalities, Proof of the factorial formula for binomial coefficients by induction, Proof of the binomial theorem by induction, Proof that exponentials dominate powers in sequences, by the ratio of consecutive terms, Proof that differentiable functions are continuous, Proof of the epsilon-delta form of the limit of a function, Proof of the well-ordering principle from strong induction, Proof of the Bolzano–Weierstrass theorem by a monotone subsequence, Proof of the Archimedean property in an Archimedean ordered field, Proof that a composition of continuous functions is continuous, Proof of the exponential of a sum by the Cauchy product, Proof that a decreasing sequence bounded below converges, Proof of the term test, Proof that the exponential function is its own derivative, by term-by-term differentiation, Proof that the reals are Archimedean from the completeness axiom, Proof of the ratio test, Proof of the power series of the exponential function, Proof that convergent sequences are bounded, Proof of the product rule, Proof of the monotone convergence theorem for sequences, Proof that continuity is equivalent to sequential continuity, Proof of the boundedness theorem by Bolzano–Weierstrass, Proof of the ratio formula for the radius of convergence, Proof that a series of nonnegative terms converges iff its partial sums are bounded, Proof of the mean value theorem from Rolle's theorem, Proof that the Cauchy product of absolutely convergent series converges absolutely to the product, Proof of the constant multiple rule.

Binomial coefficient definition
Construction of the reals from Cauchy sequences concept
Definition by recursion concept
Element definition
Factorial definition
Group concept
Integers object
Limit point of a set definition
Local maximum definition
Mathematical induction concept
Natural numbers object
Ordered field definition
Peano axioms concept
Proposition concept
Random experiment concept
Rational numbers object
Real numbers object
Sequence definition
Set bounded above definition
Proof of Pascal's rule from the recursive definition proof
Set definition
Ring definition
Ring of integers statement
Limit of a function definition
Local minimum definition
Archimedean ordered field definition
Successor function definition
Conjunction definition
Disjunction definition
Implication definition
Negation definition
Predicate definition
The reals form a field statement
Real sequence definition
Subsequence definition
Infimum definition
Supremum definition
Pascal's rule statement
Ordered pair definition
Commutative ring definition
Continuity at a point definition
Derivative definition
One-sided limit definition
Union definition
Addition of natural numbers definition
Sample space definition
Proof of the Archimedean property in an Archimedean ordered field proof
Biconditional definition
The rationals form a field statement
The successor function is injective statement
Truth table concept
Zero is not a successor statement
Modus ponens concept
Existential quantifier definition
Universal quantifier definition
Bounded sequence definition
Cauchy sequence definition
Geometric sequence definition
Limit of a sequence definition
Monotone sequence definition
Sequence tending to infinity definition
Series definition
Completeness axiom statement
Cartesian product definition
Proof of the factorial formula for binomial coefficients by induction proof
Continuous function definition
Differentiable function definition
One-sided derivative definition
Archimedean property statement
Proof of the commutativity of addition by induction proof
Subset definition
Order on the natural numbers definition
Propositional logic concept
The rationals form an ordered field statement
Mathematical proof concept
Uniqueness quantifier definition
Limit superior definition
Proof of the sum of a finite geometric series proof
Convergent sequence definition
Pointwise convergence definition
Sequential continuity definition
The sequence r^n tends to infinity for r > 1 example
Cauchy product definition
Partial sum definition
Power series definition
Factorial formula for binomial coefficients statement
Proof that a composition of continuous functions is continuous proof
Binary relation definition
Derivative function definition
Universal set definition
Order on the reals definition
Power set definition
Commutativity of addition statement
Proof of strong induction from ordinary induction proof
Tautology definition
Uniform convergence definition
Sum of a finite geometric series statement
Radius of convergence definition
Convergent series definition
Proof of the binomial theorem by induction proof
Antisymmetric relation definition
Reflexive relation definition
Transitive relation definition
Higher derivative definition
Complement definition
Interval definition
Function definition
Strong induction statement
Uniform convergence on a set definition
Logical equivalence definition
Sum of a series definition
Series of functions definition
Absolute convergence definition
Binomial theorem statement
Preorder definition
Continuously differentiable function definition
Taylor polynomial definition
Proof of the epsilon-delta form of continuity proof
Sigma-algebra definition
Proof of the epsilon-delta form of the limit of a function proof
Injective function definition
Preimage of a set definition
Proof of the well-ordering principle from strong induction proof
Proof of the double negation law by a truth table proof
Partial order definition
Smooth function definition
Epsilon-delta definition of continuity statement
Epsilon-delta definition of a limit statement
Event definition
Countable set definition
Well-ordering principle statement
Borel sigma-algebra definition
Double negation law statement
Total order definition
Composition of continuous functions is continuous statement
Probability axioms concept
Taylor series definition
Proof by contradiction concept
Proof that every sequence has a monotone subsequence, by peaks proof
Maclaurin series definition
Probability measure definition
Proof that the reals form an ordered field, with the Cauchy sequence construction proof
Every sequence has a monotone subsequence statement
Probability distribution definition
Probability space definition
The reals form an ordered field statement
Absolute value definition
Random variable definition
Proof of the approximation property of the supremum proof
Cumulative distribution function definition
Law of a random variable definition
Proof of the triangle inequality for real numbers proof
Proof that the absolute value is multiplicative proof
Discrete random variable definition
Random variable with a density definition
Proof of the epsilon-N definition of the limit of a sequence proof
Approximation property of the supremum statement
Triangle inequality statement
Absolute value is multiplicative statement
Probability density function definition
Probability mass function definition
Expected value definition
Proof that the reals are Archimedean from the completeness axiom proof
Epsilon-N definition of the limit of a sequence statement
Law of the unconscious statistician statement
Proof that differentiable functions are continuous proof
Proof of the limit of a sum of sequences proof
Proof of the squeeze theorem for sequences proof
Proof of the uniqueness of limits proof
Proof that limits preserve non-strict inequalities proof
Linearity of expectation statement
The reals are Archimedean statement
Proof that convergent sequences are bounded proof
Proof that convergent sequences are Cauchy proof
Proof that Cauchy sequences are bounded proof
Proof of the term test proof
The sequence 1/n tends to zero example
Proof of the monotone convergence theorem for sequences proof
Moment definition
Differentiable functions are continuous statement
Proof that there is a natural number n with 1/n below any positive epsilon proof
Limit of a sum of sequences statement
Uniqueness of limits statement
Proof of the ratio formula for the radius of convergence proof
Limits preserve non-strict inequalities statement
Convergent sequences are bounded statement
Squeeze theorem statement
Convergent sequences are Cauchy statement
Cauchy sequences are bounded statement
Monotone convergence theorem for sequences statement
Moment-generating function definition
Proof of the limit of a product of sequences proof
There is a natural number n with 1/n below any positive epsilon statement
Term test statement
Proof that a series of nonnegative terms converges iff its partial sums are bounded proof
Proof that a decreasing sequence bounded below converges proof
The sequence r^n tends to zero for |r| < 1 example
Proof of the sequential characterization of limits proof
Decreasing sequence bounded below converges statement
Proof that continuity is equivalent to sequential continuity proof
Limit of a product of sequences statement
A series of nonnegative terms converges iff its partial sums are bounded statement
Geometric series example
Continuity is equivalent to sequential continuity statement
Sequential characterization of limits statement
Proof that the Cauchy product of absolutely convergent series converges absolutely to the product proof
Proof of the root test proof
Proof of the Cauchy–Hadamard theorem proof
Proof that exponentials dominate powers in sequences, by the ratio of consecutive terms proof
Proof of the ratio test proof
Proof of the Bolzano–Weierstrass theorem by a monotone subsequence proof
Proof of the comparison test proof
Proof of the chain rule with an auxiliary difference quotient proof
Proof of the product rule proof
Proof of the linearity of differentiation proof
Comparison test statement
Cauchy product of absolutely convergent series statement
Bolzano–Weierstrass theorem statement
Exponentials dominate powers in sequences statement
Chain rule statement
Product rule statement
Linearity of differentiation statement
Ratio test statement
Root test statement
Proof of the boundedness theorem by Bolzano–Weierstrass proof
Proof of the Cauchy criterion for sequences by the Bolzano–Weierstrass theorem proof
Proof of the constant multiple rule proof
Proof of the power rule by induction proof
Boundedness theorem statement
Ratio formula for the radius of convergence statement
Cauchy–Hadamard theorem statement
Cauchy criterion for sequences statement
Constant multiple rule statement
Power rule statement
Proof of the extreme value theorem by the Bolzano–Weierstrass theorem proof
Uniformly Cauchy sequence of functions definition
Proof of the Cauchy criterion for series proof
Extreme value theorem statement
Proof of the formula for the derivative of a polynomial proof
Proof of Fermat's theorem on stationary points proof
Cauchy criterion for series statement
Derivative of a polynomial statement
Fermat's theorem on stationary points statement
Proof that absolutely convergent series converge proof
Proof of Rolle's theorem proof
Absolutely convergent series converge statement
Rolle's theorem statement
Proof of the Weierstrass M-test proof
Proof of the mean value theorem from Rolle's theorem proof
Weierstrass M-test statement
Mean value theorem statement
Proof that power series converge uniformly on smaller intervals inside the radius of convergence proof
Proof that uniform convergence of derivatives allows term-by-term differentiation proof
Power series converge uniformly on smaller discs inside the radius of convergence statement
Uniform convergence of derivatives allows term-by-term differentiation statement
Proof that the exponential series has infinite radius of convergence proof
The exponential series has infinite radius of convergence statement
Proof of term-by-term differentiation proof
Term-by-term differentiation statement
Exponential function definition
Proof of the exponential of a sum by the Cauchy product proof
Proof that power series are differentiable inside the radius of convergence proof
Exponential of a sum statement
Power series are differentiable inside the radius of convergence statement
Proof that the exponential function is its own derivative, by term-by-term differentiation proof
The exponential function is its own derivative statement
Proof of the power series of the exponential function proof
Power series of the exponential function statement
Proof that moments are derivatives of the moment-generating function at zero proof

Where this leads

2 pages build on this one.

Tag	`FMBDQVCX9T`
URI	`m2://FMBDQVCX9T`
Kind	proof
Writing	W0 stub
MSC	60E10
Proves	Moments are derivatives of the moment-generating function at zero
Uses	Moment-generating function, Moment, Expected value, Linearity of expectation, Power series of the exponential function, Power series, Radius of convergence, Power series are differentiable inside the radius of convergence
Changed	4 November 2026

Proof that moments are derivatives of the moment-generating function at zero

Proof

Idea

Reading path

Where this leads

Further reading

What this page needs for W1

What links here