Skip to content

Conversation

abukhoy
Copy link
Contributor

@abukhoy abukhoy commented Jul 28, 2025

This PR updates the following dependencies to their latest CPU-only versions:

  • PyTorch: 2.7.1+cpu
  • Torchvision: 0.22.1+cpu

Additionally, it updates the Python version requirement to:

  • Python: >=3.9

Reference: https://pytorch.org/get-started/previous-versions/

Testing

  • Multimodal Example Scripts have been tested successfully, such as Llama4, gemma3, whisper, granite vision, intern, mLlama.

  • The following Causal models have been tested and verified to work correctly with the updated dependencies:

  • DeepSeek-R1-Distill-Qwen-32B

  • EleutherAI/gpt-j-6b

  • OpenGVLab/InternVL2_5-1B

  • bigcode/starcoder

  • bigcode/starcoder2-15b

  • codellama/CodeLlama-13b-hf

  • codellama/CodeLlama-34b-hf

  • codellama/CodeLlama-7b-hf

  • google/codegemma-2b

  • google/codegemma-7b

  • google/gemma-2-27b

  • google/gemma-2-2b

  • google/gemma-2-9b

  • google/gemma-2b

  • google/gemma-7b

  • ibm-granite/granite-20b-code-base-8k

  • ibm-granite/granite-20b-code-instruct-8k

  • ibm-granite/granite-3.1-8b-instruct

  • ibm-granite/granite-guardian-3.1-8b

  • inceptionai/jais-adapted-13b-chat

  • inceptionai/jais-adapted-7b

  • lmsys/vicuna-13b-delta-v0

  • lmsys/vicuna-13b-v1.3

  • lmsys/vicuna-13b-v1.5

  • meta-llama/Llama-2-13b-chat-hf

  • meta-llama/Llama-2-7b-chat-hf

  • meta-llama/Llama-3.1-8B

  • meta-llama/Llama-3.2-1B

  • meta-llama/Llama-3.2-3B

  • meta-llama/Meta-Llama-3-8B

  • microsoft/Phi-3-mini-4k-instruct

  • mistralai/Codestral-22B-v0.1

  • mistralai/Mistral-7B-Instruct-v0.1

  • mistralai/Mixtral-8x7B-Instruct-v0.1

  • mistralai/Mixtral-8x7B-v0.1

  • mosaicml/mpt-7b

  • openai-community/gpt2

  • tiiuae/falcon-40b

  • Qwen/Qwen2-1.5B-Instruct

  • deepseek-ai/DeepSeek-R1-Distill-Llama-70B

  • meta-llama/Meta-Llama-3-70B

  • meta-llama/Llama-2-70b-chat-hf

  • inceptionai/jais-adapted-70b

  • meta-llama/Llama-3.1-70B

@quic-hemagnih
Copy link
Contributor

Lets run CI and all the models manually which are not currently covered under CI. Once all are passing then we can go ahead and merge it.

@abukhoy abukhoy changed the title Update PyTorch to 2.7.0+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Aug 7, 2025
@abukhoy abukhoy changed the title Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.1+cpu, and Python Requirement to >=3.9 Aug 12, 2025
@quic-hemagnih
Copy link
Contributor

Where are we on this PR?, Have we executed all the CI test cases and models which are not covered in CI?

@abukhoy
Copy link
Contributor Author

abukhoy commented Sep 1, 2025

Where are we on this PR?, Have we executed all the CI test cases and models which are not covered in CI?

Few Vision-Language Models are remaining to test such as Llama4 and Gemma3, these are getting tested as these are big models getting machine issue sometimes. Although these are present in CI with single or double layer, but I am testing full models locally.

@quic-hemagnih
Copy link
Contributor

Can we run all the models with 2.7.0 pytorch, and then plan to merge

@abukhoy abukhoy closed this Sep 25, 2025
@abukhoy
Copy link
Contributor Author

abukhoy commented Sep 25, 2025

Addressing this change to #542

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants