distributed training bug fix, to maintain same order for mem queue fo…#642

Open

zhaoyuac09 wants to merge 8 commits intoKevinMusgrave:devfrom

zhaoyuac09:master

Commits on Jun 18, 2023

Commits on Jun 20, 2023

distributed training bug fix, to maintain same order for mem queue for all workers
zhaoyuac09
committed

Commits on Jun 27, 2023

Added efficient xbm loss distributed wrapper. Added tester. Note: the efficient xbm loss distributed wrapper will maintain same grad as non-efficient version.
zhaoyuac09
committed

Commits on Jul 6, 2023

fixed distributed regular loss efficient flag bug. formatted xbm queue tester.
zhaoyuac09
committed

Commits on Dec 11, 2023

Temporary debug print statements in test_distributed
KevinMusgrave
committed