New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

训练超参设置 #52

Open

blue-blue272 opened this issue Jul 10, 2024 · 0 comments

blue-blue272 commented Jul 10, 2024

您好，有几个训练的问题想请假一下：

第一阶段是32卡，单卡batch size设置为8， lr按照config的设置为3e-5吗？
第二阶段的训练配置（lr, batchsize等）和第一阶段一样吗？是从第一阶段的模型初始化，用不同的数据进行训练吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment