online learning

Noun

 * 1)  The training of a neural network using stochastic gradient descent with a mini-batch size of one; only one input is used for training at a time.