center-loss | This branch is developed for contrastive loss | Computer Vision library

There are two types of weights:

• Trainable = Updated automatically by the optimizer with backpropagation
• Untrainable = Not updated by backpropagation

For the trainable weights, it's really not recommended to use updates, you will be mixing the optimizer's updates with your own updates and that could cause many issues

For the untrainable weights, you can do whatever you want. Sometimes you want constants and you will do nothing, sometimes, you want these weights to change (but not via backpropagation)

Notice how in that example the weights updated by the user are untrainable: