I am struggling with implementing LearningRate Annealing algorithm during the training.
I founded that modulus.loss.aggregator has LRAnnealing class so that we can implement Learning rate annealing for loss aggregation, but how can I use this LRAnnealing class in Constraint class?
For example, if I have two constraints,
BC = PointwiseBoundaryConstraint(…)
interior = PointwiseInteriorConstraint(…)
and want to balance the loss between BC and interior with learning rate annealing algorithm, how do I implement it?
I also founded custom_aggregator.py at modulus.examples.turbulent_channel directory, but this aggregator class was not used in example code.
Any suggestions, links, or advice(any sample code for loss aggregation) would be highly appreciated.