Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I change the scale for training? #97

Open
AlexzQQQ opened this issue Dec 5, 2024 · 3 comments
Open

How can I change the scale for training? #97

AlexzQQQ opened this issue Dec 5, 2024 · 3 comments

Comments

@AlexzQQQ
Copy link

AlexzQQQ commented Dec 5, 2024

Thanks for the excellent work, I tried to change the default scale to others scale(e.g like 3 6 10),it can't work and the output is noise. and I wonder if it is ok to change the default scale without retrain for vqvae

@AlexzQQQ
Copy link
Author

AlexzQQQ commented Dec 5, 2024

when i tried i change var.py class VAR's patch_nums, class VARHF's patch_nums,and arg_util.py pn

@JeyesHan
Copy link

It's OK to slightly change the scale schedule for vqvae since it adopts a CNN architecture. It could still encodes and decodes images normally but with a slight performance drop.
However, VAR relys on the predefined scale schedule in the training stage. If you change the scale schedule without training VAR, it may generates noisy results. We suggest you fine-tune VAR if you change the scale schedule. The results will improves quickly.

@iFighting
Copy link
Contributor

@AlexzQQQ You can also train var with dynamic scale schedule, which means that you can random drop some scales, when testing, you can use dynamic scale schedule. However i strongly recommend you to fine-tune VAR if you change the scale schedule.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants