Code

SFT Training update tutorials#769

Code

Merged

tengomucho merged 14 commits intomainhuggingface/optimum-neuron:mainfrom training-update-tutorialshuggingface/optimum-neuron:training-update-tutorialsCopy head branch name to clipboardJan 29, 2025

+124-72

Commits

Commits on Jan 29, 2025

• fix(doc): remove reference to slurm

  Show description for ddb8632
  tengomucho

  committed
  ddb8632

  Copy full SHA for ddb8632

• fix(doc): correct typo on training tutorial

  tengomucho

  committed
  01ee4b5

  Copy full SHA for 01ee4b5

• fix(doc): correct dataset citation on training tutorial

  tengomucho

  committed
  94ecb4c

  Copy full SHA for 94ecb4c

• chore(doc): update TOC to reflect content

  tengomucho

  committed
  47320d7

  Copy full SHA for 47320d7

• fix(doc): correct link

  tengomucho

  committed
  19c1744

  Copy full SHA for 19c1744

• doc(training): update SFT tutorial's wording, separate shell script

  Show description for 5b95050
  tengomucho

  committed
  5b95050

  Copy full SHA for 5b95050

• feat(doc): add model merge after weights consolidation in SFT tutorial

  tengomucho

  committed
  c25fb7e

  Copy full SHA for c25fb7e

• doc(tutorial): adapt evaluation section

  Show description for d32de69
  tengomucho

  committed
  d32de69

  Copy full SHA for d32de69

• chore(training): add TRL and PEFT as dependencies

  Show description for 3d483b6
  tengomucho

  committed
  3d483b6

  Copy full SHA for 3d483b6

• fix(doc): remove tip tag

  tengomucho

  committed
  9d85e40

  Copy full SHA for 9d85e40

• chore(dependencies): create "training" extra with dependencies

  Show description for c11dda7
  tengomucho

  committed
  c11dda7

  Copy full SHA for c11dda7

• chore(doc): update sft training tutorial to install training extra

  tengomucho

  committed
  4ce9b9a

  Copy full SHA for 4ce9b9a

• doc(tutorial): remove cmd option --zero_1 false

  tengomucho

  committed
  5c0bcee

  Copy full SHA for 5c0bcee

• chore(dependencies): add neuronx-distributed for training extra

  tengomucho

  committed
  15408fe

  Copy full SHA for 15408fe