Math functions that calculate weighted sum of inputs and adds bias to give non-linearity to output of neuron.