Skip to content

Commit a23a1fb

Browse files
author
fochan
committed
update
1 parent 35ab723 commit a23a1fb

File tree

4 files changed

+20
-17
lines changed

4 files changed

+20
-17
lines changed

docs/_static/intro/Untitled.png

684 KB
Loading

docs/_static/intro/kasm-1.png

-66.5 KB
Binary file not shown.

docs/class5/class5.rst

Lines changed: 18 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -84,15 +84,15 @@ For details, please refer to official documentation. Here a brief description.
8484
- path: /simply-chat
8585
policy: ai-deliver-optimize-pol
8686
schema: openai
87-
8887
8988
**Policies** - The policies section allows you to use different profiles based on different selectors.
9089

9190
.. NOTE::
9291
Example uses **rag-ai-chatbot-prompt-pol** policy which mapped to **rag-ai-chatbot-prompt** profiles.
9392

9493
.. code-block:: yaml
95-
94+
:caption: AIGW profiles - "rag-ai-chatbot-prompt" mapped to AIGW policy - "rag-ai-chatbot-prompt-pol".
95+
9696
policies:
9797
- name: rag-ai-chatbot-prompt-pol
9898
profiles:
@@ -105,6 +105,7 @@ For details, please refer to official documentation. Here a brief description.
105105
Example uses **rag-ai-chatbot-prompt** profiles which defined the **prompt-injection** processor at the **inputStages** which uses **ollama/llama3.2** service.
106106

107107
.. code-block:: yaml
108+
:caption: AIGW profiles - "rag-ai-chatbot-prompt" with "prompt-injection" processor and uses "ollama/llama3.2" service. Profile will be applied on AIGW inputStage.
108109
109110
profiles:
110111
- name: rag-ai-chatbot-prompt
@@ -122,6 +123,7 @@ For details, please refer to official documentation. Here a brief description.
122123
Processor definition for **prompt-injection**
123124

124125
.. code-block:: yaml
126+
:caption: Configuration of an external AIGW Processor - "prompt-injection" processor.
125127
126128
processors:
127129
- name: prompt-injection
@@ -140,6 +142,7 @@ For details, please refer to official documentation. Here a brief description.
140142
Example shown service for ollama/llama3.2 (upstream LLM). This is the service that AIGW will send to. Option for executor are ollama, openai, anthropic or http. Endpoint URL is where the upstream LLM API.
141143

142144
.. code-block:: yaml
145+
:caption: Service definition for upstream LLM - "ollama/llama3.2".
143146
144147
- name: ollama/llama3.2
145148
type: llama3.2
@@ -157,15 +160,20 @@ For details, please refer to official documentation. Here a brief description.
157160
.. image:: ./_static/class5-2-0.png
158161

159162
.. code-block:: bash
163+
:caption: Switch to ai-gateway K8S by changing to the directory. ai-gateway kubeconfig will automatically loaded.
160164
161165
cd ~/ai-gateway/aigw-v0.1/charts/aigw
162166
167+
163168
.. code-block:: bash
169+
:caption: Create ai-gateway namespace to host AIGW core container.
164170
165171
kubectl create ns ai-gateway
166172
167173
168174
.. code-block:: bash
175+
:caption: Create a secret for AIGW license token.
176+
169177
170178
kubectl -n ai-gateway create secret generic f5-license \
171179
--from-literal=license=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzUxMiJ9.eyJzdWIiOiJteSBmYWtlIGxpY2Vuc2UiLCJpc3MiOiJGNSBJbmMuIiwgImF1ZCI6InVybjpmNTp0ZWVtIiwgImY1X29yZGVyX3R5cGUiOiJwYWlkIiwgImY1X29yZGVyX3N1YnR5cGUiOiIiLCAiZjVfc2F0IjogMTg2MTk5MjAwMH0.LZgZn7R1h5wrtXhUo3XYiW-YNBZUn_3n5b_l8hz-VxhZU3CBG5EkVRrejtIb97rWEvbx7btKtz3JKAk-DPqjONJ9A0WehGNItr3ExAxmmnvop9HL2d85L4mFwnyNYQwejvOlax3Athsv1rFqyNGmuGOrtv2M6K6a2FaO_jb96FV92FjaWWpiPr1pxl-nKj6wN-YRMZwLeTYXAHiQXEIoRrFNbSMG8OqTzVfB5xi_ZwaqHv_7Z1d2664BBqQkyFU2o7eOh3Lm8FKM7l0okK2QOSTrFYJKUQoB3cxKfIzyC-38RAZM0fwlo7K1QtoSPIZT9qNXUnFzdo-nZDPoRrrxyg
@@ -184,17 +192,20 @@ Install AIGW Core helm charts
184192

185193

186194
.. code-block:: bash
195+
:caption: Install AIGW Core helm chart. Helm chart will deploy AIGW core container based on info in values file.
187196
188197
helm -n ai-gateway install aigw -f values-ai-gateway-base.yaml .
189198
190199
.. Note::
191200
**values-ai-gateway-base.yaml** is the base aigw.yaml configuration - without any policy configuration. **values-ai-gateway.yaml** contains configuration with policies. We can either use API to create configuration dynamically or create configuration/policy as part of the deployment. Please do notes that configuration created via API will not survive on reboot or restart. For this class, we will use API to create AIGW configuration.
192201

193202
.. code-block:: bash
203+
:caption: Retrieves and displays all Pods and Services within the ai-gateway namespace
194204
195205
kubectl -n ai-gateway get po,svc
196206
197207
.. code-block:: bash
208+
:caption: Fetches logs from all pods in the ai-gateway namespace that have the label app.kubernetes.io/instance=aigw
198209
199210
kubectl -n ai-gateway logs -l app.kubernetes.io/instance=aigw
200211
@@ -217,19 +228,23 @@ AIGW Core is running and listening for traffic.
217228
This AI GW UI is an interim UI for AI GW. **AIGW UI will change in future.**
218229

219230
.. code-block:: bash
231+
:caption: Switch to AIGW manifest file directory.
220232
221233
cd ~/ai-gateway/aigw-v0.1/aigw-ui-manifest
222234
223235
.. code-block:: bash
236+
:caption: Updates K8S resources using aigw-config.yaml file.
224237
225238
kubectl -n ai-gateway apply -f aigw-config.yaml
226239
227240
.. code-block:: bash
241+
:caption: Updates K8S resources using ui-deploy.yaml file.
228242
229243
kubectl -n ai-gateway apply -f ui-deploy.yaml
230244
231245
.. code-block:: bash
232-
246+
:caption: Retrieves and displays all Pods and Services within the ai-gateway namespace
247+
233248
kubectl -n ai-gateway get po,svc
234249
235250
AIGW UI is running.

docs/prerequisite/prerequisite.rst

Lines changed: 2 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -87,22 +87,11 @@ KASM desktop
8787
------------
8888
Alternatively, if you don't have access to RDP or ssh client from your laptop due to company security policy, you can use KASM desktop (via https) to do the lab.
8989

90+
Launch Chrome browser (via KASM-Desktop link).
9091

9192
.. image:: /_static/intro/kasm-0.png
9293

9394

94-
Login to Desktop browser (Chrome) with the following credential.
95-
96-
+----------------+---------------+
97-
| **Username** | f5 |
98-
+----------------+---------------+
99-
| **Password** | F5Passw0rd |
100-
+----------------+---------------+
101-
102-
103-
.. image:: /_static/intro/kasm-1.png
104-
105-
10695
Access Kasm Desktop from the bookmark as shown below.
10796

10897
Ensure you allow text and images copies to the clipboard.
@@ -112,8 +101,7 @@ Ensure you allow text and images copies to the clipboard.
112101

113102
.. image:: /_static/intro/kasm-2.png
114103

115-
Please notes that KASM desktop username is different from the Desktop (Chrome) browser.
116-
104+
Please use the following username and password to login to KASM desktop.
117105

118106
+----------------+---------------+
119107
| **Username** | kasm_user |

0 commit comments

Comments
 (0)