Does pytorch lightning have good support for FSDP 2? #20978
Unanswered
jlu-figma
asked this question in
DDP / multi-GPU / multi-node
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi! Just curious if pytorch lightning code primarily uses FSDP 2 or FSDP 1. I see some references to
fully_shardso there seems to be some FSDP 2 usage, but most FSDP code seems to be using FSDP 1.Are there plans to support FSDP 2 more thoroughly in the future?
Beta Was this translation helpful? Give feedback.
All reactions