We show that the basic stochastic gradient method applied to a strongly-convex differentiable function with a constant step-size achieves a linear convergence rate (in function value and iterates) up to a constant proportional the step-size (under standard assumptions on the gradient).
No takes yet. Share an insight, caveat, or question.
Mark Schmidt (2014) studied this question.