What is gradient descent, and how is it used to optimize models?
Reviewed by Jason Burns, Editorial Steward · Last updated
Gradient descent is an optimization algorithm that iteratively adjusts a model's parameters in the direction that most reduces a loss function, using the loss's gradient computed with respect to those parameters.