Skip to content
This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Commit 462abfe

Browse files
dmarascoSageMoore
authored andcommitted
[Bugfix] Remove key sorting for guided_json parameter in OpenAi compatible Server (vllm-project#3945)
1 parent fba0984 commit 462abfe

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/guided_decoding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -91,7 +91,7 @@ def _get_guide_and_mode(
9191
json = request.guided_json
9292
if isinstance(json, dict):
9393
# turn dict into hashable string
94-
json = json_dumps(json, sort_keys=True)
94+
json = json_dumps(json)
9595
elif isinstance(json, BaseModel):
9696
# use pydantic signature so that different model classes
9797
# with the same fields will get hashed the same

0 commit comments

Comments
 (0)