Preconditioned Optimizers: Shampoo, K-FAC, and Natural Gradient

2 selectedDifficulty 3-32 unseenView topic

Saved practice

Keep this quiz in your learner record

Answers count toward your profile, review queue, and next-topic suggestions. You can also use the quick practice below.

FoundationNew

0 answered

2 foundationAdapts to your performance

Question 1 of 2

120sfoundation (3/10)conceptual

Why can Adam help when different parameters have gradients on very different scales?