Avoid downloading HF models in CI pipelines #1263
Merged
+67
−62
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…into baijumeswani/avoid-downloading-models
…into baijumeswani/avoid-downloading-models
ajindal1
approved these changes
Feb 20, 2025
|
|
RyanUnderhill
approved these changes
Feb 20, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull-request makes changes to the tests so that the HuggingFace models are not downloaded if these are already available on the machine under some directory. The directory it expects the models to be located in is
If the models are not found in that location, the test script will download from huggingface_hub.
The models are not made available on macos as we don't have a way to add those models to the macos vm yet.
This pull-request also changes how many models are converted in the CI pipeline to onnx to being only phi-2, and qwen-2.5 for now. I'll create a separate pull-request to enable more models for the nightly build.