Code

🎯 [SFT] add token accuracy metric#2597

Code

Merged

qgallouedec merged 8 commits intomainhuggingface/trl:mainfrom mean_token_accuracyhuggingface/trl:mean_token_accuracyCopy head branch name to clipboardFeb 7, 2025

+126-2

Commits

Commits on Jan 21, 2025

• add token accuracy metric

  kashif

  committed
  947922f

  Copy full SHA for 947922f

• fix return type

  kashif

  committed
  cee4f01

  Copy full SHA for cee4f01

• shift tokens

  kashif

  committed
  a937906

  Copy full SHA for a937906

• use compute_loss so that the model is called only once

  kashif

  committed
  cd92904

  Copy full SHA for cd92904

Commits on Feb 4, 2025

• Merge branch 'main' into mean_token_accuracy

  kashif

  authored
  d8cdc39

  Copy full SHA for d8cdc39

• add to logs

  kashif

  committed
  9a22b94

  Copy full SHA for 9a22b94

• log from main process

  kashif

  committed
  8a9f916

  Copy full SHA for 8a9f916

Commits on Feb 7, 2025

• Merge branch 'main' into mean_token_accuracy

  qgallouedec

  authored
  dfe218c

  Copy full SHA for dfe218c