Code

Loss too big when using TP#740

Code

Draft

michaelbenayoun wants to merge 5 commits intomainhuggingface/optimum-neuron:mainfrom loss_too_big_tphuggingface/optimum-neuron:loss_too_big_tpCopy head branch name to clipboard

+171-70

Commits

Commits on Jan 28, 2025

• Investigating

  michaelbenayoun

  committed
  f8a065d

  Copy full SHA for f8a065d

• Investigating

  michaelbenayoun

  committed
  010ed93

  Copy full SHA for 010ed93

• Fix gradient accumulation

  michaelbenayoun

  committed
  a3880a1

  Copy full SHA for a3880a1

• [WIP] integrate NxDOptimizer

  michaelbenayoun

  committed
  9d38084

  Copy full SHA for 9d38084

• Changes the order of creation / preparation

  michaelbenayoun

  committed
  0a23be3

  Copy full SHA for 0a23be3