Skip to content

fix(data): count Hugging Face samples after token packing - #387

Open
Linxiushen wants to merge 1 commit into
Tencent:mainfrom
Linxiushen:fix/hf-text-packing
Open

Linxiushen wants to merge 1 commit into
Tencent:mainfrom
Linxiushen:fix/hf-text-packing

Commits

Commits on Sep 27, 2026