Skip to the content

Math 2.0

Resources / preprint

The cost of useful natural gradient updates AAH14S2JJ2

URI	`m2://res/AAH14S2JJ2`
Kind	preprint
Creators	Subhransu S. Bhattacharjee, Dylan Campbell, Rahul Shome
Date	2026-09-27
Subjects	arxiv cs.LG, arxiv cs.IT, arxiv math.IT, arxiv math.OC
Scope	border

Expressions

e1: version, preprint

Date	2026-09-27
Ids	arXiv 2609.33499

Items in this resource

The mentions of the inventory that name this resource. Each name links to the card of its inventory row.

Item	Kind	Where	Source
Padding and two-point testing	statement	lemma A.1	arxiv
Useful-step calibration with an exact natural gradient	statement	theorem B.2	arxiv
Finite KL-constrained query improvement	statement	corollary D.1	arxiv
Scalar lower bound under damping	statement	proposition E.2	arxiv
Computational hardness of useful event-tilt selection	statement	corollary 3.4	arxiv
Calibration with exact gradient and scalar Fisher information	statement	theorem 3.2	arxiv
Calibration with matched base gradients and scalar Fisher information	statement	theorem B.1	arxiv
Exact-budget margin for affine-head log-likelihood	statement	lemma J.1	arxiv
Estimating a damped natural gradient from samples	statement	proposition E.1	arxiv
Sample-only finite KL-constrained improvement	statement	corollary D.2	arxiv
Dimension dependence under coordinate-wise boundedness	statement	corollary E.3	arxiv
Sample complexity of useful event-tilt selection	statement	theorem 3.3	arxiv
Damped natural gradient estimation	statement	proposition 3.6	arxiv
Useful update and calibration	definition	definition 3.1	arxiv
Direction recovery with a well-conditioned Fisher matrix	statement	theorem 3.5	arxiv
Resolution under fixed damping	statement	proposition E.4	arxiv
Finite-candidate certification	statement	proposition F.2	arxiv
Population-KL certification	statement	proposition F.1	arxiv

Catalogue records

arxiv: 2609.33499 (work)