Skip to content

Commit 498e666

Browse files
authored
fix: add hf secret to guide (#3384)
Signed-off-by: alec-flowers <[email protected]>
1 parent dcbf9df commit 498e666

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docs/kubernetes/README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,6 +53,12 @@ Each backend has deployment examples and configuration options:
5353
export NAMESPACE=dynamo-cloud
5454
kubectl create namespace ${NAMESPACE}
5555

56+
# to pull model from HF
57+
export HF_TOKEN=<Token-Here>
58+
kubectl create secret generic hf-token-secret \
59+
--from-literal=HF_TOKEN="$HF_TOKEN" \
60+
-n ${NAMESPACE};
61+
5662
# Deploy any example (this uses vLLM with Qwen model using aggregated serving)
5763
kubectl apply -f components/backends/vllm/deploy/agg.yaml -n ${NAMESPACE}
5864

0 commit comments

Comments
 (0)