You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to run a FSDP training built on top of metaseq:
I have a model with two other models nested inside it:
FSDP(model);
FSDP(submodel)
FSDP(submodel);
However I get this error: ""RuntimeError: The tensor has a non-zero number of elements, but its data is not allocated yet. Caffe2 uses a lazy allocation, so you will need to call mutable_data() or raw_mutable"" during the forward pass of the first submodule, do you ever encountered this error? Thanks a lot!
The text was updated successfully, but these errors were encountered:
Emanuele97x
changed the title
Error with nested models
Error with nested models "Caffe2 uses a lazy allocation..."
Jul 26, 2023
I am trying to run a FSDP training built on top of metaseq:
I have a model with two other models nested inside it:
However I get this error: ""RuntimeError: The tensor has a non-zero number of elements, but its data is not allocated yet. Caffe2 uses a lazy allocation, so you will need to call mutable_data() or raw_mutable"" during the forward pass of the first submodule, do you ever encountered this error? Thanks a lot!
The text was updated successfully, but these errors were encountered: