Beta. Content is under active construction and has not been peer-reviewed. Report errors on
GitHub
.
Disclaimer
Theorem
Path
Curriculum
Paths
Demos
Diagnostic
Search
Quiz Hub
/
Stochastic Approximation Theory
Stochastic Approximation Theory
3 questions
Difficulty 4-7
View topic
Intermediate
0 / 3
2 intermediate
1 advanced
Adapts to your performance
1 / 3
intermediate (4/10)
conceptual
The Robbins-Monro conditions require step sizes
{
η
t
}
to satisfy two conditions for SGD convergence. Which pair is correct?
Hide and think first
A.
∑
t
=
1
∞
η
t
=
∞
and
∑
t
=
1
∞
η
t
2
<
∞
B.
η
t
=
c
for all
t
(constant step size) and
c
<
2/
L
where
L
is the Lipschitz constant
C.
∑
t
=
1
∞
η
t
<
∞
and
η
t
>
0
for all
t
D.
η
t
→
0
and
η
t
is non-increasing
Submit Answer