Gradient descent on a loss surface
Medium · Whiteboard
Draw elliptical loss contours. Sketch gradient descent paths with a learning rate that is too small, about right, and too large. Then show what momentum changes.
Create a free account to answer it and get scored on what a strong answer covers.