rectified linear unit

Etymology
Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969

Noun

 * 1) A unit (artificial neuron) in an artificial neural network that employs a rectifier
 * 2) The rectifier function itself

Synonyms

 * ReLU