Video Backpropagation

Last updated: January 4, 2023

This third video (14 min) by 3Blue1Brown explains backpropagation.

Note: there is one minor terminology error in this video.

When using mini-batches (instead of all training examples) before re-calculating the weights and biases, they talk about stochastic gradient descent. In fact, what they are describing in the video is called mini-batch gradient descent. Stochastic gradient descent uses a single example in each iteration.