General framework for online-to-nonconvex conversion: Schedule-free SGD is also effective for nonconvex optimization S988ZVA1QE

URI	`m2://res/S988ZVA1QE`
Kind	preprint
Creators	Kwangjun Ahn, Gagik Magakyan, Ashok Cutkosky
Date	2024-11-11
Subjects	arxiv cs.LG, arxiv math.OC, arxiv stat.ML
Scope	border

Expressions

Date	2024-11-11
Ids	arXiv 2411.07061

The mentions of the inventory that name this resource. Each name links to the card of its inventory row.

Item	Kind	Where	Source
\bf Generic online-to-nonconvex conversion	statement	lemma 1	arxiv
\bf Generic nonconvex guarantees	statement	theorem 2	arxiv
3PEV4GDYNJ	statement	corollary 6	arxiv
5E3W2PB3AZ	statement	corollary 5	arxiv
$\bx$-iterate stability	definition	definition 5	arxiv
6S8QCWCC9A	statement	proposition 3	arxiv
96VND9SJKD	statement	lemma 11	arxiv
Exponential moving average (EMA) of iterates	definition	definition 3	arxiv
BD2NSPMJY3	statement	corollary 3	arxiv
C1EAH72F04	statement	corollary 4	arxiv
\bf $(\lambda,\eps)$-stationary point	definition	definition 1	arxiv
DHGGJZVDX1	statement	lemma 2	arxiv
HBEV8E8MT4	statement	proposition 1	arxiv
Variance decomposition lemma	statement	lemma 10	arxiv
\bf Discounted regret	definition	definition 2	arxiv
NES5DY0H30	statement	lemma 7	arxiv
PBZ8X7GMBM	statement	proposition 5	arxiv
Q660T646T1	statement	lemma 9	arxiv
RMKBWQTXVG	statement	proposition 2	arxiv
STYC7RDWSV	statement	theorem 1	arxiv
T0ED7JR95Y	statement	proposition 4	arxiv
Random index distribution	definition	definition 4	arxiv
ZXPP9XP0F7	statement	lemma 8	arxiv