Mamba fix#123

Merged

lchu6 merged 33 commits intomainfrom

Dec 18, 2024

Commits on Aug 5, 2024

make mamba
lchu6
committed

Commits on Aug 10, 2024

Commits on Nov 11, 2024

Learning rate scheduler changed (Constant)
divya-kumari32
committed

Commits on Nov 12, 2024

Mamba config restore
divya-kumari32
committed

Commits on Dec 17, 2024

Cosine 0.01 decay

divya-kumari32
authored and
daviswer
committed
Add AutoHandler
daviswer
committed
Add Auto cfg option for AutoHAndler
daviswer
committed
Len gets called before open
daviswer
committed
path/filepath typo fix
daviswer
committed
Partitioning fix from mup-search
daviswer
committed
Warmup interval change

divya-kumari32
authored and
daviswer
committed
Schedule change

divya-kumari32
authored and
daviswer
committed
Constant schedule

divya-kumari32
authored and
daviswer
committed
LR schedule change (cool down and constant lr)

divya-kumari32
authored and
daviswer
committed
Update dataset_utils.py

divya-kumari32
authored and
daviswer
committed
LR schedule change (Warmup + constant)

divya-kumari32
authored and
daviswer
committed
Update main_training.py

divya-kumari32
authored and
daviswer
committed
Mirror doc len check into AHandler, fix mypy in autoHandler
daviswer
committed
Linting
daviswer
committed
Further linting
daviswer
committed
More mypy type fix
daviswer
committed
Rename main_training.py to main_training_mamba.py

divya-kumari32
authored and
daviswer
committed
Added main_training_llama.py file

divya-kumari32
authored and
daviswer
committed
Rename fms_to_hf.py to fms_to_hf_mamba.py

divya-kumari32
authored and
daviswer
committed
Added fms_to_hf_llama.py file

divya-kumari32
authored and
daviswer
committed
Delete fms_fsdp/utils/config_utils.py

divya-kumari32
authored and
daviswer
committed
Added mamba variant 9.8b

divya-kumari32
authored and
daviswer
committed
Incremental mypy fix
daviswer
committed
Fix imports (mypy)
daviswer
committed
Rename adapters to work correctly

ani300
authored and
daviswer
committed
linting

ani300
authored and
daviswer
committed