Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/dpo #806

Open
wants to merge 36 commits into
base: master
Choose a base branch
from
Open
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
549ec1b
make some changes for the auto trainer using the DPO trainer
pengwei715 Mar 6, 2024
cca1e7e
adding the dpo from trl
pengwei715 Mar 6, 2024
2157574
Merge branch 'development' into feature/dpo
pengwei715 Mar 17, 2024
01c1d08
should use dpo_trainer for dpo training
pengwei715 Mar 18, 2024
c691afc
adding the req
pengwei715 Mar 18, 2024
c010d6d
using the dpo trainer
pengwei715 Mar 18, 2024
95b5ce5
adding the mlrun
pengwei715 Mar 18, 2024
4915919
adding the dpo trainer
pengwei715 Mar 18, 2024
96c08f4
add dpo trainer
pengwei715 Mar 18, 2024
1cb999e
added dpo trainer
pengwei715 Mar 18, 2024
ad8cbc3
Merge branch 'feature/dpo' of github.com:pengwei715/functions_old int…
pengwei715 Mar 18, 2024
7e6af5f
continue the coding
pengwei715 Mar 18, 2024
d4e0940
should be the same as trainer
pengwei715 Mar 19, 2024
1c26ef1
try generate the function.yaml
pengwei715 Mar 19, 2024
93beb7b
adding the dop_trainer
pengwei715 Mar 19, 2024
a3c7862
update item
pengwei715 Mar 19, 2024
e44d870
add function yaml file
pengwei715 Mar 19, 2024
b343632
rename the trainer
pengwei715 Mar 19, 2024
6b28938
get rid of the older version
pengwei715 Mar 19, 2024
5239e55
can trigger the run. seems don't need override the dataloader
pengwei715 Mar 20, 2024
1f059b8
adding the maxlength
pengwei715 Mar 20, 2024
e5d0792
get rid of the trainer interface
pengwei715 Mar 20, 2024
eb300fd
override
pengwei715 Mar 20, 2024
69d3605
Merge branch 'feature/dpo' of github.com:pengwei715/functions_old int…
pengwei715 Mar 20, 2024
14be776
training job can run but the artifact can't store
pengwei715 Mar 26, 2024
8ed0555
why the artifact can be stored?
pengwei715 Mar 27, 2024
465c208
solved the naming issue, now can store the artifact
pengwei715 Mar 27, 2024
308d94f
testing
pengwei715 Apr 1, 2024
b660dd7
fmt
pengwei715 Apr 1, 2024
3fe1451
update the function yaml file
pengwei715 Apr 1, 2024
bbc2fa2
update the test case
pengwei715 Apr 1, 2024
c781ecf
passed the test case
pengwei715 Apr 1, 2024
2f5361e
adding the function yaml to the test case
pengwei715 Apr 1, 2024
d63b755
should be good for the notebook
pengwei715 Apr 1, 2024
5d1ccc4
adding the notebook and raise the PR
pengwei715 Apr 1, 2024
bf66dfd
raise the PR
pengwei715 Apr 1, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
371 changes: 371 additions & 0 deletions huggingface_dpo/function.yaml

Large diffs are not rendered by default.

Loading