Gradient descent

The update rule that nudges each weight a small step in whichever direction would have reduced the error, repeated over many examples until the weights converge.

See it explained in full