Skip to content

Commit 185668b

Browse files
authored
Fetch Muse Glimmer serving tokenizer files from the non-GGUF repo (#24137)
The CUDA solo-text-batching serving smoke downloaded tokenizer_config.json and chat_template.jinja from ${HF_MODEL} (meta-models/Muse-Glimmer-30B-GGUF). That repo only ships GGUF weights, so the download 404s and the job has failed recently even if the main test passed. Fetch both files from $TOKENIZER_URL (meta-models/Muse-Glimmer-30B), which is where tokenizer.json already comes from. Use `curl -f` so a missing file still fails the job. Test plan: ran the new download loop locally against $TOKENIZER_URL; both files downloaded and tokenizer_config.json parses as JSON. `bash -n` passes. CI: test-muse-glimmer-cuda-e2e-kquant-17gb-solo-text-batching (ciflow/cuda).
1 parent ea5cd99 commit 185668b

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

‎.ci/scripts/test_model_e2e.sh‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -618,7 +618,9 @@ if [ "$DEVICE" = "cuda" ] && [ "$MODEL_NAME" = "muse_glimmer" ] && [ "$MODE" = "
618618
--mode requests --requests 5 --prompt_tokens 600 --max_new_tokens 64 --stagger_ms 200
619619

620620
pip install -r examples/llm_server/python/requirements.txt
621-
python -c "from huggingface_hub import hf_hub_download; [hf_hub_download('${HF_MODEL}', f, local_dir='${MODEL_DIR}') for f in ('tokenizer_config.json', 'chat_template.jinja')]"
621+
for f in tokenizer_config.json chat_template.jinja; do
622+
curl -fL --retry 3 --retry-all-errors "$TOKENIZER_URL/$f" -o "$MODEL_DIR/$f"
623+
done
622624
PORT=$(python - <<'PY'
623625
import socket
624626

0 commit comments

Comments
 (0)