Skip to content

add option to use guided loss gistembedloss #584

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 25 commits into
base: main
Choose a base branch
from
Open

add option to use guided loss gistembedloss #584

wants to merge 25 commits into from

Conversation

DemirTonchev
Copy link
Contributor

title

DemirTonchev and others added 25 commits December 20, 2024 15:03
@DemirTonchev
fixed to work with processing_class instead tokenizer after transform…
cb4e803 
…ers 4.45.2
@DemirTonchev
refactor attempt for ContrastiveDataset so that it does not blow RAM …
6a69303 
…with bigger dataset
@DemirTonchev
added Samplit strategy enum
09869e1
@DemirTonchev
improved logic and fixed iterator pattern
82474dc
@DemirTonchev
fix for negative samples formula
d01dc36
@DemirTonchev
added multilalbel support as in the original implementation
53eaace
@DemirTonchev
ContrastiveDataset iterator refactor
3e3fa5f
@DemirTonchev
trainer fixed to work with ContrastiveDataset iter method
2d5e29b
@DemirTonchev
ContrastiveDistillationDataset iter refactor
1c905b1
@DemirTonchev
typing fix
9cafa02
@tomaarsen
Merge branch 'main' into pr-579
421b1e5
@tomaarsen
TypeAlias will be deprecated in 3.12 again, so let's avoid it
ea088ff 
It also doesn't exist in 3.9 yet.
https://docs.python.org/3/library/typing.html#typing.TypeAlias
@tomaarsen
Remove args.sampling_strategy from ContrastiveDistillationDataset init
467c507
@tomaarsen
Run formatting
9784485
@tomaarsen
Add 'save_strategy="no"' in tests to counteract transformers v4.48.0 bug
3f67190
@DemirTonchev
fix some autocomplete mistake
509ee68
@DemirTonchev
Merge branch 'refactor-contrds' of github.com:DemirTonchev/setfit int…
8fdbbb3 
…o refactor-contrds
@DemirTonchev
cleanup leftovers attributes from old logic
7d9119b
@DemirTonchev
docs
fe30eaa
@DemirTonchev
fix to correctly specify positives and negatives when passing num_ite…
e7f9cf0 
…rations
@DemirTonchev
fix for negative or positive examples only(not really possible)
d989f22
@DemirTonchev
removed unnecessary np uses and casting
d229add
@DemirTonchev
safeguard for oversampling strategy, when DS is negatives only or sin…
ea88e9b 
…gle pos pair
@DemirTonchev
added guide model feature to args and trainer
781c5fa
@DemirTonchev
Merge branch 'huggingface:main' into feature/gistembed
117f36e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@DemirTonchev @tomaarsen