I used to have this confusion when I study a basic concept. I would understand it very well, but when I tried to recap it in my mind, there was always this gap I couldn’t fill. In this blog, I’ll try to explain the confusion I had while refreshing my memory of mini-batch SGD. If… Continue reading Mini-batch SGD