Math 2.0

Probability theory and stochastic processes Definition

Detailed balance

Builds on Markov chainTransition matrixStationary distributionGraph

Definition

Let P=(pij)i,j∈SP = (p_{ij})_{i, j \in S} be the transition matrix of a time-homogeneous Markov chain on a countable set SS. A probability distribution π=(πi)i∈S\pi = (\pi_i)_{i \in S} on SS satisfies detailed balance for PP if πi pij=πj pjifor all i,j∈S.\pi_i \, p_{ij} = \pi_j \, p_{ji} \quad \text{for all } i, j \in S. The chain is then called reversible with respect to π\pi.

Remarks

Detailed balance implies that π\pi is stationary: ∑iπipij=∑iπjpji=πj\sum_i \pi_i p_{ij} = \sum_i \pi_j p_{ji} = \pi_j. If X0X_0 has law π\pi, then (X0,…,Xn)(X_0, \ldots, X_n) and (Xn,…,X0)(X_n, \ldots, X_0) have the same law. Example: on a finite connected graph with edge set EE, let pij=1/deg⁡(i)p_{ij} = 1/\deg(i) when jj is a neighbour of ii. With πi=deg⁡(i)/(2∣E∣)\pi_i = \deg(i) / (2\abs{E}), both sides equal 1/(2∣E∣)1/(2\abs{E}) for neighbours, and both vanish otherwise. Non-example: on S={1,2,3}S = \set{1, 2, 3} let the chain move deterministically 1→2→3→11 \to 2 \to 3 \to 1. The uniform law is stationary, but π1p12=1/3\pi_1 p_{12} = 1/3 while π2p21=0\pi_2 p_{21} = 0, so detailed balance fails. Kolmogorov's criterion says that an irreducible chain with a stationary distribution is reversible if and only if pi1i2pi2i3⋯pini1=pi1inpinin−1⋯pi2i1p_{i_1 i_2} p_{i_2 i_3} \cdots p_{i_n i_1} = p_{i_1 i_n} p_{i_n i_{n-1}} \cdots p_{i_2 i_1} for every finite cycle of states.

Reading path

To understand this page from the ground up, read these 54 pages in order. The foundations come first.

  1. Construction of the reals from Cauchy sequences concept
  2. Element definition
  3. Graph concept
  4. Integers object
  5. Ordered field definition
  6. Proposition concept
  7. Random experiment concept
  8. Rational numbers object
  9. Real numbers object
  10. Stationary distribution concept
  11. Transition matrix concept
  12. Set definition
  13. Ring of integers statement
  14. Disjunction definition
  15. Implication definition
  16. Predicate definition
  17. Ordered pair definition
  18. Union definition
  19. Sample space definition
  20. Existential quantifier definition
  21. The rationals form a field statement
  22. Universal quantifier definition
  23. Cartesian product definition
  24. Subset definition
  25. The rationals form an ordered field statement
  26. Uniqueness quantifier definition
  27. Binary relation definition
  28. Universal set definition
  29. Order on the reals definition
  30. Power set definition
  31. Complement definition
  32. Function definition
  33. Interval definition
  34. Injective function definition
  35. Preimage of a set definition
  36. Sigma-algebra definition
  37. Countable set definition
  38. Event definition
  39. Borel sigma-algebra definition
  40. Probability axioms concept
  41. Probability measure definition
  42. Probability space definition
  43. Conditional probability definition
  44. Random variable definition
  45. Independence of two events definition
  46. Discrete random variable definition
  47. Stochastic process concept
  48. Random variable with a density definition
  49. Conditional independence definition
  50. Expected value definition
  51. Conditional expectation definition
  52. Markov property definition
  53. Markov chain definition
  54. Detailed balance definition

Further reading

  1. Web https://en.wikipedia.org/wiki/Detailed_balance
About this page
TagC9EDBYCRAY
URIm2://C9EDBYCRAY
Kinddefinition
WritingW0 stub
MSC60J10, 82C05
DefinesDetailed balance
UsesMarkov chain, Transition matrix, Stationary distribution, Graph
Changed2 November 2026

Markdown · JSON · Edit on GitHub

What this page needs for W1

  • an inventory row: the row of the inventory that the node accounts for (0 of 1)
  • a source with a locator (0 of 1)

The writing levels say how complete the text of a page is. They do not measure its truth.

What links here

No page links to this page yet.