Skip to content

Pull requests: huggingface/trl

New pull request New
80 Open 2,280 Closed
80 Open 2,280 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[GRPOTrainer]: Add SAPO Loss
#4600 opened Nov 28, 2025 by pramodith Loading…
3 of 5 tasks
4
[online-dpo] add vllm lora adapter support
#4590 opened Nov 27, 2025 by kashif Loading…
5 tasks
4
[WIP] Clean up model preparation
#4577 opened Nov 26, 2025 by qgallouedec Loading…
4
🚚 Move RLOO to trl.experimental
#4576 opened Nov 25, 2025 by neha222222 Loading…
3 tasks done
1
🚚 Move KTO to trl.experimental
#4575 opened Nov 25, 2025 by neha222222 Loading…
1
Support async reward functions and parallelize call to reward functions.
#4567 opened Nov 24, 2025 by pramodith Loading…
3 of 5 tasks
1
6
Add cross-tokenizer distillation support for GKD and MiniLLM trainers
#4561 opened Nov 22, 2025 by sambhavnoobcoder Loading…
1
Add PSPO trust region method as alternative to clipping in GRPOTrainer
#4548 opened Nov 19, 2025 by MCDwyer Loading…
2 of 5 tasks
@kashif
4
fix: add vllm_group_port
#4545 opened Nov 19, 2025 by pointerhacker Loading…
3 of 5 tasks
1
4
Add compute_metrics parameter for GRPOTrainer
#4534 opened Nov 17, 2025 by colinzhaoxp Loading…
3
[GRPO] Sequence-level TIS & MIS
#4530 opened Nov 16, 2025 by LeonEricsson Loading…
5 tasks
20
Add Qwen3VLGRPOTrainer for Qwen3-VL GRPO training
#4529 opened Nov 16, 2025 by NDNM1408 Loading…
1
Make skip_special_tokens configurable
#4521 opened Nov 13, 2025 by taha-yassine Loading…
3 of 5 tasks
1
5
[GRPO] switch grpo liger loss to triton version
#4519 opened Nov 13, 2025 by kashif Loading…
5 tasks
6
adding [SimPER](https://arxiv.org/abs/2502.00883)
#4486 opened Nov 6, 2025 by leeparkuky Loading…
2 of 5 tasks
1
Move RLOOTrainer to trl.experimental.rloo
#4484 opened Nov 6, 2025 by behroozazarkhalili Loading…
1
1
Move KTOTrainer to experimental module
#4475 opened Nov 5, 2025 by behroozazarkhalili Loading…
1
1
added 10 papers (+trainer cross-links) for #4407
#4441 opened Nov 3, 2025 by SSusantAchary Loading…
4 tasks done
24
refactor: Move Mergekit integration to experimental submodule
#4438 opened Nov 3, 2025 by behroozazarkhalili Loading…
1
3
docs: Unify model examples to use trl-lib namespace
#4431 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
docs: Expand speeding up training guide with acceleration methods
#4428 opened Nov 2, 2025 by behroozazarkhalili Loading…
1
6
docs: Expand training customization examples
#4427 opened Nov 2, 2025 by behroozazarkhalili Loading…
4 tasks done
1
5
[ALST/Ulysses] Added ALST/Ulysses documentation
#4420 opened Nov 1, 2025 by kashif • Draft
2 of 9 tasks
15
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
4
refactor: simplify parameter freezing in modeling_base.py
#4305 opened Oct 20, 2025 by Ki-Seki Loading…
2 of 5 tasks
2
ProTip! Adding no:label will show everything without a label.