They introduce non-linearities into the output of a neuron, allowing the network to learn complex functions.
They are used to compute the weighted sum of the inputs to a neuron.
They are used to regularize the weights in a neural network.
They ensure that the output of a neuron is always positive.
All courses were automatically generated using OpenAI's GPT-3. Your feedback helps us improve as we cannot manually review every course. Thank you!