Non Léon Bottou Notation ? (SGD/2SGD)

[fi0112358]

Hello! I'm struggling to find the initial equation forms for SGD/2SGD in the notes. I see that we have GD defined as $w_{t+1} = w_t - \nu \nabla_w E_{in}(w_t)$ and also 2GD defined w/similar notation, but can't find the SGD/2SGD versions.

Any help would be appreciated! Thanks:)

[YiqiSun1]

I think for SGD and 2SGD, we just use the formula on Bottous's paper

[fi0112358]

Great -- thank you so much! I wasn't sure if there was an alternative notation that we had covered.