Skip to content

Commit 9aa2b1e

Browse files
committed
fix(aibrix): add default_decision to aibrix values.yaml for PII fallback
The aibrix profile uses static YAML configuration (not CRDs). The PII policy checker has a fallback to 'default_decision' when no decision name is provided, but aibrix didn't define this decision. This caused all PII detection requests to be allowed (0% accuracy). Adding default_decision with PII enabled (pii_types_allowed: []) ensures that the fallback logic works correctly for aibrix, matching the behavior expected by the E2E PII detection tests. Related to vllm-project#648 Signed-off-by: Yossi Ovadia <[email protected]>
1 parent 4ce1bbc commit 9aa2b1e

File tree

1 file changed

+17
-0
lines changed
  • deploy/kubernetes/aibrix/semantic-router-values

1 file changed

+17
-0
lines changed

deploy/kubernetes/aibrix/semantic-router-values/values.yaml

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -381,6 +381,23 @@ config:
381381
system_prompt: "You are a thinking expert, should think multiple steps before answering. Please answer the question step by step."
382382
mode: "replace"
383383

384+
- name: default_decision
385+
description: "Default fallback decision for requests without specific routing"
386+
priority: 1
387+
rules:
388+
operator: "OR"
389+
conditions:
390+
- type: "domain"
391+
name: "other"
392+
modelRefs:
393+
- model: vllm-llama3-8b-instruct
394+
use_reasoning: false
395+
plugins:
396+
- type: "pii"
397+
configuration:
398+
enabled: true
399+
pii_types_allowed: []
400+
384401
# Strategy for selecting between multiple matching decisions
385402
# Options: "priority" (use decision with highest priority) or "confidence" (use decision with highest confidence)
386403
strategy: "priority"

0 commit comments

Comments
 (0)