Which of the following is a challenge in training deep neural networks?
Answer options
A
All neurons activating at once
B
Linear activation functions
C
Vanishing/Exploding gradients
D
Too few neurons
E
Small datasets
Correct answer: Vanishing/Exploding gradients
Explanation
The source marks the correct answer as: Vanishing/Exploding gradients.