Investigate how to use learning rate schedulers
Some code is already available in the current version to use learning rate schedulers, but none is used during the training (value is always None). We should investigate how we can use one and if it can improve the training.
Refs: