Math 2.0

Probability theory and stochastic processes Definition

Large deviations theory

Builds on Probability measureTopological spaceRate functionClosed setOpen setInfimumLimit superiorLimit inferior

Definition

Let 𝒳\mathcal{X} be a topological space with its Borel σ\sigma-algebra. Let (μn)n≥1(\mu_n)_{n \ge 1} be a sequence of probability measures on 𝒳\mathcal{X}, and let I ⁣:𝒳→[0,∞]I \colon \mathcal{X} \to [0, \infty] be a rate function. For A⊆𝒳A \subseteq \mathcal{X}, write I(A)=inf⁡x∈AI(x)I(A) = \inf_{x \in A} I(x), with I(∅)=∞I(\emptyset) = \infty. The sequence (μn)(\mu_n) satisfies the large deviation principle with rate function II if both of the following hold.

  1. For every closed set F⊆𝒳F \subseteq \mathcal{X}, lim sup⁡n→∞1nlog⁡μn(F)≤−I(F)\displaystyle \limsup_{n \to \infty} \frac{1}{n} \log \mu_n(F) \le -I(F).
  2. For every open set G⊆𝒳G \subseteq \mathcal{X}, lim inf⁡n→∞1nlog⁡μn(G)≥−I(G)\displaystyle \liminf_{n \to \infty} \frac{1}{n} \log \mu_n(G) \ge -I(G).

Remarks

Here log⁡0=−∞\log 0 = -\infty. A sequence of random elements ZnZ_n of 𝒳\mathcal{X} satisfies the principle when their laws do. The factor 1/n1/n is the speed; some applications use another speed 1/ε1/\varepsilon or 1/an1/a_n with an→∞a_n \to \infty. If AA is a Borel set whose interior A∘A^\circ and closure Aˉ\bar A satisfy I(A∘)=I(Aˉ)I(A^\circ) = I(\bar A), then 1nlog⁡μn(A)→−I(A)\frac{1}{n} \log \mu_n(A) \to -I(A).

Example: let μn\mu_n be the normal law with mean 00 and variance 1/n1/n on ℝ\R, and let I(x)=x2/2I(x) = x^2/2. For an interval [a,∞)[a, \infty) with a>0a > 0, the Gaussian tail estimate gives 1nlog⁡μn([a,∞))→−a2/2=−I([a,∞))\frac{1}{n} \log \mu_n([a, \infty)) \to -a^2/2 = -I([a, \infty)). The same tail estimate gives both bounds for all closed and open sets, so (μn)(\mu_n) satisfies the principle with this II.

Non-example: the same sequence does not satisfy the principle with I(x)=x2I(x) = x^2. The upper bound fails for the closed set F=[1,∞)F = [1, \infty). Indeed 1nlog⁡μn(F)→−1/2\frac{1}{n} \log \mu_n(F) \to -1/2, while −I(F)=−1<−1/2-I(F) = -1 < -1/2.

Reading path

To understand this page from the ground up, read these 9 pages in order. The foundations come first.

Show the path as a graph
Each page uses the pages above it. The colour of the bar on a box shows how strong the evidence is, and the box also gives it as text. The list has the same pages.
  • no evidence level
  1. Closed set concept
  2. Infimum concept
  3. Limit inferior concept
  4. Limit superior concept
  5. Open set concept
  6. Probability measure concept
  7. Rate function concept
  8. Topological space concept
  9. Large deviations theory definition

Where this leads

3 pages build on this one.

Further reading

  1. Web https://en.wikipedia.org/wiki/Large_deviations_theory
About this page
TagMNPWBBNCAD
URIm2://MNPWBBNCAD
Kinddefinition
WritingW0 stub
MSC60F10
DefinesLarge deviations theory
UsesProbability measure, Topological space, Rate function, Closed set, Open set, Infimum, Limit superior, Limit inferior
Changed2 November 2026

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

Used by