Skip to content

Pull requests: ROCm/Megatron-LM

New pull request New
8 Open 45 Closed
8 Open 45 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: add LoRA adapter layer and Mixtral LoRA training
#53 opened Jan 31, 2025 by mpashkovskii • Draft
Add FSDP arguments and example script to train model with FSDP-v2
#52 opened Jan 28, 2025 by ryang-amd Loading…
12
[Perf] Skip creating attention mask in llama dataloader
#40 opened Dec 13, 2024 by billishyahao Loading…
3
Deepseek v2 16b enablement
#34 opened Dec 10, 2024 by hakankiymaz-amd Loading…
17
Enable pretraining qwen2 model
#33 opened Dec 10, 2024 by billishyahao Loading…
Make llama dataset preparation more generic.
#32 opened Dec 10, 2024 by lcskrishna Loading…
5
Renwuli/disable te qwen1.5
#27 opened Nov 21, 2024 by amdrenwuli Loading…
1
Renwuli/disable te qwen
#26 opened Nov 21, 2024 by amdrenwuli Loading…
2
ProTip! Adding no:label will show everything without a label.