Add multigpu pt#288

Draft

gkumbhat wants to merge 10 commits intocaikit:mainfrom

gkumbhat:add_multigpu_pt

Commits on Nov 26, 2023

:construction: Initiate HF Trainer

gkumbhat
and
alex-jw-brooks
committed
:construction: Replace custom training loop with HF Trainer

gkumbhat
and
alex-jw-brooks
committed

Commits on Nov 30, 2023

Commits on Dec 1, 2023

:construction: Add FSDP configuration for executing training across multi-gpu

gkumbhat
and
alex-jw-brooks
committed