# Metadata Source URL:: https://en.wikipedia.org/wiki/Stochastic_gradient_descent Topics:: #ai, #mathematic --- # Stochastic gradient descent - Wikipedia ## Highlights > [!quote]+ Updated on 141122_092134 > > Stochastic gradient descent (often abbreviated SGD) is an iterative method for optimizing an objective function with suitable smoothness properties (e.g. differentiable or subdifferentiable). It can be regarded as a stochastic approximation of gradient descent optimization, since it replaces the actual gradient (calculated from the entire data set) by an estimate thereof (calculated from a randomly selected subset of the data). Especially in high-dimensional optimization problems this reduces the very high computational burden, achieving faster iterations in trade for a lower convergence rate