请教：ColossalAI 和 微软开源的DeepSpeed chat 的定位差异、优势是什么，谢谢 #3843
Unanswered
yanni-code
asked this question in
Community | Q&A
Replies: 3 comments
-
|
据我用的结果来看 DeepSpeed chat在张量并行方面做的一般，ColossalAI主要在原来的数据并行、流水线并行基础上进一步强化了模型并行的张量并行部分 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
之前上手train resnet的时候觉得colossal AI更user friendly, 详见medium |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
好像唯一的区别/优点就是基于chunk的异构内存管理，但是效果也不是特别明显 个人粗浅理解，望雅正 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
你好！请教个问题，ColossalAI 和 微软开源的DeepSpeed chat 的定位差异、优势是什么？ 因为我分别了看了ColossalAI 和 DeepSpeed chat的公开的比较材料都在说比对方的性能好，非常困惑，还请抽空解答一下，非常感谢。
Beta Was this translation helpful? Give feedback.
All reactions