How to know whether your model is suffering from the problem of Exploding Gradients?
There are a few ways by which you can get an idea of whether your model is suffering from exploding gradients or not. They are:
- If the model weights become unexpectedly large in the end.
- Your model has a poor loss
- Or the model displays NaN loss whilst training.
- The gradient value for error persists over 1.0 for every subsequent iteration during training.