Cool, glad to have helped. It seems I have caused a further minor point of confusion though, so a correction to the correction: The original Nesterov Accelerated Gradient paper is about gradient descent, it's just not…
It's always useful to see different SGD methods written with a consistent nomenclature. A few thoughts: 1. Is the 1999 Qian paper on momentum really the most appropriate one, given the comparison of the publication date…
Cool, glad to have helped. It seems I have caused a further minor point of confusion though, so a correction to the correction: The original Nesterov Accelerated Gradient paper is about gradient descent, it's just not…
It's always useful to see different SGD methods written with a consistent nomenclature. A few thoughts: 1. Is the 1999 Qian paper on momentum really the most appropriate one, given the comparison of the publication date…