Skip to content

Commit 87de552

Browse files
aeron-ghaeron-gh
committed
docs: fix the router ConfigMap example key and nesting
Signed-off-by: aeron-gh <agab0323@gmail.com>
1 parent b8d1ac7 commit 87de552

6 files changed

Lines changed: 188 additions & 182 deletions

File tree

‎docs/kthena/docs/user-guide/config-router.md‎

Lines changed: 34 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -69,39 +69,40 @@ metadata:
6969
name: kthena-router-config
7070
namespace: default
7171
data:
72-
schedulerConfiguration: |-
73-
pluginConfig:
74-
- name: least-request
75-
args:
76-
maxWaitingRequests: 10
77-
- name: least-latency
78-
args:
79-
TTFTTPOTWeightFactor: 0.5
80-
- name: prefix-cache
81-
args:
82-
blockSizeToHash: 64
83-
maxBlocksToMatch: 128
84-
maxHashCacheSize: 50000
85-
- name: kvcache-aware
86-
args:
87-
blockSizeToHash: 16
88-
maxBlocksToMatch: 128
89-
plugins:
90-
Filter:
91-
enabled:
92-
- least-request
93-
disabled:
94-
- lora-affinity
95-
Score:
96-
enabled:
97-
- name: least-request
98-
weight: 1
99-
- name: kvcache-aware
100-
weight: 1
101-
- name: least-latency
102-
weight: 1
103-
- name: prefix-cache
104-
weight: 1
72+
routerConfiguration: |-
73+
scheduler:
74+
pluginConfig:
75+
- name: least-request
76+
args:
77+
maxWaitingRequests: 10
78+
- name: least-latency
79+
args:
80+
TTFTTPOTWeightFactor: 0.5
81+
- name: prefix-cache
82+
args:
83+
blockSizeToHash: 64
84+
maxBlocksToMatch: 128
85+
maxHashCacheSize: 50000
86+
- name: kvcache-aware
87+
args:
88+
blockSizeToHash: 16
89+
maxBlocksToMatch: 128
90+
plugins:
91+
Filter:
92+
enabled:
93+
- least-request
94+
disabled:
95+
- lora-affinity
96+
Score:
97+
enabled:
98+
- name: least-request
99+
weight: 1
100+
- name: kvcache-aware
101+
weight: 1
102+
- name: least-latency
103+
weight: 1
104+
- name: prefix-cache
105+
weight: 1
105106
```
106107
107108
If you want to use Authentication feature of router. Here is an example:

‎docs/kthena/versioned_docs/version-v0.1.0/user-guide/config-router.md‎

Lines changed: 30 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -65,35 +65,36 @@ metadata:
6565
name: kthena-router-config
6666
namespace: default
6767
data:
68-
schedulerConfiguration: |-
69-
pluginConfig:
70-
- name: least-request
71-
args:
72-
maxWaitingRequests: 10
73-
- name: least-latency
74-
args:
75-
TTFTTPOTWeightFactor: 0.5
76-
- name: prefix-cache
77-
args:
78-
blockSizeToHash: 64
79-
maxBlocksToMatch: 128
80-
maxHashCacheSize: 50000
81-
plugins:
82-
Filter:
83-
enabled:
84-
- least-request
85-
disabled:
86-
- lora-affinity
87-
Score:
88-
enabled:
89-
- name: least-request
90-
weight: 1
91-
- name: kv-cache
92-
weight: 1
93-
- name: least-latency
94-
weight: 1
95-
- name: prefix-cache
96-
weight: 1
68+
routerConfiguration: |-
69+
scheduler:
70+
pluginConfig:
71+
- name: least-request
72+
args:
73+
maxWaitingRequests: 10
74+
- name: least-latency
75+
args:
76+
TTFTTPOTWeightFactor: 0.5
77+
- name: prefix-cache
78+
args:
79+
blockSizeToHash: 64
80+
maxBlocksToMatch: 128
81+
maxHashCacheSize: 50000
82+
plugins:
83+
Filter:
84+
enabled:
85+
- least-request
86+
disabled:
87+
- lora-affinity
88+
Score:
89+
enabled:
90+
- name: least-request
91+
weight: 1
92+
- name: kv-cache
93+
weight: 1
94+
- name: least-latency
95+
weight: 1
96+
- name: prefix-cache
97+
weight: 1
9798
```
9899
99100
If you want to use Authentication feature of router. Here is an example:

‎docs/kthena/versioned_docs/version-v0.2.0/user-guide/config-router.md‎

Lines changed: 30 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -65,35 +65,36 @@ metadata:
6565
name: kthena-router-config
6666
namespace: default
6767
data:
68-
schedulerConfiguration: |-
69-
pluginConfig:
70-
- name: least-request
71-
args:
72-
maxWaitingRequests: 10
73-
- name: least-latency
74-
args:
75-
TTFTTPOTWeightFactor: 0.5
76-
- name: prefix-cache
77-
args:
78-
blockSizeToHash: 64
79-
maxBlocksToMatch: 128
80-
maxHashCacheSize: 50000
81-
plugins:
82-
Filter:
83-
enabled:
84-
- least-request
85-
disabled:
86-
- lora-affinity
87-
Score:
88-
enabled:
89-
- name: least-request
90-
weight: 1
91-
- name: kv-cache
92-
weight: 1
93-
- name: least-latency
94-
weight: 1
95-
- name: prefix-cache
96-
weight: 1
68+
routerConfiguration: |-
69+
scheduler:
70+
pluginConfig:
71+
- name: least-request
72+
args:
73+
maxWaitingRequests: 10
74+
- name: least-latency
75+
args:
76+
TTFTTPOTWeightFactor: 0.5
77+
- name: prefix-cache
78+
args:
79+
blockSizeToHash: 64
80+
maxBlocksToMatch: 128
81+
maxHashCacheSize: 50000
82+
plugins:
83+
Filter:
84+
enabled:
85+
- least-request
86+
disabled:
87+
- lora-affinity
88+
Score:
89+
enabled:
90+
- name: least-request
91+
weight: 1
92+
- name: kv-cache
93+
weight: 1
94+
- name: least-latency
95+
weight: 1
96+
- name: prefix-cache
97+
weight: 1
9798
```
9899
99100
If you want to use Authentication feature of router. Here is an example:

‎docs/kthena/versioned_docs/version-v0.3.0/user-guide/config-router.md‎

Lines changed: 30 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -65,35 +65,36 @@ metadata:
6565
name: kthena-router-config
6666
namespace: default
6767
data:
68-
schedulerConfiguration: |-
69-
pluginConfig:
70-
- name: least-request
71-
args:
72-
maxWaitingRequests: 10
73-
- name: least-latency
74-
args:
75-
TTFTTPOTWeightFactor: 0.5
76-
- name: prefix-cache
77-
args:
78-
blockSizeToHash: 64
79-
maxBlocksToMatch: 128
80-
maxHashCacheSize: 50000
81-
plugins:
82-
Filter:
83-
enabled:
84-
- least-request
85-
disabled:
86-
- lora-affinity
87-
Score:
88-
enabled:
89-
- name: least-request
90-
weight: 1
91-
- name: kv-cache
92-
weight: 1
93-
- name: least-latency
94-
weight: 1
95-
- name: prefix-cache
96-
weight: 1
68+
routerConfiguration: |-
69+
scheduler:
70+
pluginConfig:
71+
- name: least-request
72+
args:
73+
maxWaitingRequests: 10
74+
- name: least-latency
75+
args:
76+
TTFTTPOTWeightFactor: 0.5
77+
- name: prefix-cache
78+
args:
79+
blockSizeToHash: 64
80+
maxBlocksToMatch: 128
81+
maxHashCacheSize: 50000
82+
plugins:
83+
Filter:
84+
enabled:
85+
- least-request
86+
disabled:
87+
- lora-affinity
88+
Score:
89+
enabled:
90+
- name: least-request
91+
weight: 1
92+
- name: kv-cache
93+
weight: 1
94+
- name: least-latency
95+
weight: 1
96+
- name: prefix-cache
97+
weight: 1
9798
```
9899
99100
If you want to use Authentication feature of router. Here is an example:

‎docs/kthena/versioned_docs/version-v0.4.0/user-guide/config-router.md‎

Lines changed: 30 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -65,35 +65,36 @@ metadata:
6565
name: kthena-router-config
6666
namespace: default
6767
data:
68-
schedulerConfiguration: |-
69-
pluginConfig:
70-
- name: least-request
71-
args:
72-
maxWaitingRequests: 10
73-
- name: least-latency
74-
args:
75-
TTFTTPOTWeightFactor: 0.5
76-
- name: prefix-cache
77-
args:
78-
blockSizeToHash: 64
79-
maxBlocksToMatch: 128
80-
maxHashCacheSize: 50000
81-
plugins:
82-
Filter:
83-
enabled:
84-
- least-request
85-
disabled:
86-
- lora-affinity
87-
Score:
88-
enabled:
89-
- name: least-request
90-
weight: 1
91-
- name: kv-cache
92-
weight: 1
93-
- name: least-latency
94-
weight: 1
95-
- name: prefix-cache
96-
weight: 1
68+
routerConfiguration: |-
69+
scheduler:
70+
pluginConfig:
71+
- name: least-request
72+
args:
73+
maxWaitingRequests: 10
74+
- name: least-latency
75+
args:
76+
TTFTTPOTWeightFactor: 0.5
77+
- name: prefix-cache
78+
args:
79+
blockSizeToHash: 64
80+
maxBlocksToMatch: 128
81+
maxHashCacheSize: 50000
82+
plugins:
83+
Filter:
84+
enabled:
85+
- least-request
86+
disabled:
87+
- lora-affinity
88+
Score:
89+
enabled:
90+
- name: least-request
91+
weight: 1
92+
- name: kv-cache
93+
weight: 1
94+
- name: least-latency
95+
weight: 1
96+
- name: prefix-cache
97+
weight: 1
9798
```
9899
99100
If you want to use Authentication feature of router. Here is an example:

0 commit comments

Comments
 (0)