Code

Use AWS Neuron sdk 2.21#754

Code

Open

dacorvo wants to merge 18 commits intomainhuggingface/optimum-neuron:mainfrom aws_neuron_sdk_2.21huggingface/optimum-neuron:aws_neuron_sdk_2.21Copy head branch name to clipboard

+959-308

Commits

Commits on Jan 7, 2025

• chore: use AWS Neuron 2.21.0 SDK

  dacorvo

  committed
  b9f13bd

  Copy full SHA for b9f13bd

• chore: use AWS Neuron SDK 2.21.0 pip packages

  dacorvo

  committed
  aca7d98

  Copy full SHA for aca7d98

• chore(tgi): use AWS Neuron SDK 2.21.0

  dacorvo

  committed
  e5fd062

  Copy full SHA for e5fd062

• ci: use AWS Neuron SDK 2.21 system packages

  dacorvo

  committed
  9f35529

  Copy full SHA for 9f35529

• refactor(qwen2): adapt to latest TnX

  dacorvo

  committed
  7506d99

  Copy full SHA for 7506d99

• refactor(granite): align modeling with latest TnX

  dacorvo

  committed
  8dd93d0

  Copy full SHA for 8dd93d0

• test: fix neuronx_distributed import

  dacorvo

  committed
  2454d3b

  Copy full SHA for 2454d3b

• test(distributed): adapt to new torch_neuronx initialization

  dacorvo

  committed
  c548a87

  Copy full SHA for c548a87

• fix(distributed): skip non pickable attr duplication

  dacorvo

  committed
  81610f4

  Copy full SHA for 81610f4

• test(sd): export to bf16

  Show description for 13a428c
  dacorvo

  committed
  13a428c

  Copy full SHA for 13a428c

• test(tgi): fix gpt2 sample expectations

  dacorvo

  committed
  466d6d9

  Copy full SHA for 466d6d9

Commits on Jan 14, 2025

• [WIP] fix GQA QKV

  michaelbenayoun

  committed
  56e03c5

  Copy full SHA for 56e03c5

Commits on Jan 15, 2025

• [WIP] GQA checkpointing works, but output_proj does not work

  michaelbenayoun

  committed
  0489424

  Copy full SHA for 0489424

• Fix output_proj

  michaelbenayoun

  committed
  9c2165c

  Copy full SHA for 9c2165c

• Styling

  michaelbenayoun

  committed
  01d4a18

  Copy full SHA for 01d4a18

• Remove comment

  michaelbenayoun

  committed
  0a58c8e

  Copy full SHA for 0a58c8e

Commits on Jan 16, 2025

• nits

  michaelbenayoun

  committed
  0e0ca88

  Copy full SHA for 0e0ca88

• Fix lora

  michaelbenayoun

  committed
  d2a7487

  Copy full SHA for d2a7487