Softmax: Why neural networks need non-linearity? life isn't straight-line simple

Math functions that calculate weighted sum of inputs and adds bias to give non-linearity to output of neuron.