Add DeepSeekV3 and figure out what's needed to support it#29

Draft

fmassa wants to merge 30 commits intomainfrom

fmassa/deepseekv3

Commits on Jul 18, 2025

[WIP] Add basic DeepSeekV3

fmassa
authored and
wconstab
committed
Lint

fmassa
authored and
wconstab
committed
Workarounds to make graph capture pass

fmassa
authored and
wconstab
committed
Add dummy propagation rules just to see what we need to implement

fmassa
authored and
wconstab
committed
Cleanup

fmassa
authored and
wconstab
committed
prims.fma comes from softmax_backward

fmassa
authored and
wconstab
committed
Make _geenrate_dummy_strategy more generic

fmassa
authored and
wconstab
committed
Add proper redistribute_cost to dummy strategies

fmassa
authored and
wconstab
committed
Hack around missing dtypes in compute estimation and handle grouped_mm cases with invalid strides

fmassa
authored and
wconstab
committed
Add representative batch size

fmassa
authored and
wconstab
committed
Fix grouped_mm stride issue
wconstab
committed
get DS3 running forward, OOM at backward
wconstab
committed

Commits on Jul 19, 2025

WIP factory_strategy
wconstab
committed

Commits on Jul 25, 2025

Commits on Jul 26, 2025

Commits on Jul 27, 2025

Commits on Jul 30, 2025

Commits on Jul 31, 2025

Merge branch 'main' of github.com:pytorch-labs/autoparallel into fmassa/deepseekv3
fmassa
committed

Commits on Aug 4, 2025

Merge branch 'main' of github.com:pytorch-labs/autoparallel into fmassa/deepseekv3
fmassa
committed

Commits on Aug 9, 2025

Commits on Sep 4, 2025