[Tracking issue] Integrate native liger-kernel losses

[qgallouedec]

~80% memory reduction with native liger-kernel losses. For more information, see https://github.com/linkedin/Liger-Kernel/releases/tag/v0.5.0

• DPO [Liger] liger DPO support #2568
• BCO
• ORPO [Liger] add native liger-kernel orpo loss #2482
• SimPO (in CPO) [Liger] Integrate Liger CPO & SimPO #2506
• JSD (in GKD) [WIP] [Liger] liger JSD support #2573
• GRPO 🐯 Integrate Liger GRPO Loss to GRPO Trainer #3184
• KTO [Liger] Liger KTO support #2812

[Mecoli1219]

Hi, I want to check that SimPO is in CPO instead of DPO, right?

[qgallouedec]

Hi, I want to check that SimPO is in CPO instead of DPO, right?

Correct! Message modified

[Palmik]

Any plan to also add the native KTO loss?

[Superskyyy]

And GRPO? linkedin/Liger-Kernel#548

[vaibhavjindal]

Hi, I am working on integrating the kto loss: #2812

[SalmanMohammadi]

Hi - I'd like to take on GRPO once linkedin/Liger-Kernel#553 lands

edit: I'd also be happy to pick up any of the other integrations if the related PRs are stale.