Checkpoint with the "_reg"

[Joanna-0421]

Hello, thanks for the great work!
I notice that in Infinity repo, you said model with '_reg' using some regularizations. Are the regularizations corresponding to the parameter "use_decay_factor"? How is the regularization implemented?

[MasterBin-IIAU]

Hi, thanks for the appreciation of our work.
No, "use_decay_factor" is not the regularizations we used. The regularization includes randomly dropping some quantization layers in the multi-scale residual quantizer, etc. This alleviates the difficulties in training the next-scale prediction Transformer, being quite useful especially when training on high-resolution images.

[smileyenot983]

Hi, thanks for the appreciation of our work. No, "use_decay_factor" is not the regularizations we used. The regularization includes randomly dropping some quantization layers in the multi-scale residual quantizer, etc. This alleviates the difficulties in training the next-scale prediction Transformer, being quite useful especially when training on high-resolution images.

Is the regularization available in this repository?