Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error with nested models "Caffe2 uses a lazy allocation..." #1129

Open
Emanuele97x opened this issue Jul 26, 2023 · 0 comments
Open

Error with nested models "Caffe2 uses a lazy allocation..." #1129

Emanuele97x opened this issue Jul 26, 2023 · 0 comments

Comments

@Emanuele97x
Copy link

I am trying to run a FSDP training built on top of metaseq:

I have a model with two other models nested inside it:

  • FSDP(model);
    • FSDP(submodel)
    • FSDP(submodel);

However I get this error: ""RuntimeError: The tensor has a non-zero number of elements, but its data is not allocated yet. Caffe2 uses a lazy allocation, so you will need to call mutable_data() or raw_mutable"" during the forward pass of the first submodule, do you ever encountered this error? Thanks a lot!

@Emanuele97x Emanuele97x changed the title Error with nested models Error with nested models "Caffe2 uses a lazy allocation..." Jul 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant