activation

activation

/ˌæktəˈveɪʃən/

🔮 Neural Computation

the output of a neuron after applying a non-linear function

ReLU activation introduces non-linearity to the network.

Origin: Latin activus (active) + -ation