Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add dpop training #5339

Closed
wants to merge 2 commits into from
Closed

add dpop training #5339

wants to merge 2 commits into from

Conversation

threestone965
Copy link

@threestone965 threestone965 commented Sep 3, 2024 •
edited
Loading

What does this PR do?

 新增dpop的训练代码，重写了self.dpo_loss方法（只是新增了计算惩罚项）

Before submitting

@threestone965
Copy link
Author

官方代码实现链接
abacusai/smaug#2 (comment)

@hiyouga hiyouga added the pending This problem is yet to be addressed label Sep 3, 2024
@hiyouga hiyouga closed this Feb 12, 2025
@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed labels Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@threestone965 @hiyouga