Fix type error in ZeROOrderedDict (#6794)

As @keskival pointed in 3d5cf73#r149582004, I've confirmed there's a type error, which this PR fixes. I didn't run into this because our internal version still use `*r2`. Co-authored-by: Tero Keski-Valkama <[email protected]> Co-authored-by: Logan Adams <[email protected]>
microsoft · Dec 10, 2024 · 9e31252 · 9e31252
1 parent 1b58ba5
commit 9e31252
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/deepspeed/runtime/zero/parameter_offload.py b/deepspeed/runtime/zero/parameter_offload.py
@@ -52,7 +52,7 @@ def __init__(self, parent_module, *args, **kwargs):
 
     def __reduce__(self):
         r0, _, *r2 = super().__reduce__()
-        return (r0, (self._parent_module, )) + r2
+        return (r0, (self._parent_module, )) + tuple(r2)
 
     def __getitem__(self, key):
         param = super().__getitem__(key)