You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If you just performed Class 4, skip to `part 2 - Deploy F5 AI Gateway <#deploy-f5-ai-gateway>`_
162
+
160
163
Before you continue with this lab, here is a recap on what has been done/completed and what the pending/to-do task. This lab is to learn how to deploy F5 AI Gateway and configure AIGW policy.
161
164
162
165
.. image:: ./_static/class5-1-0-0.png
@@ -168,10 +171,14 @@ RDP to access Windows10 Jumphost.
168
171
169
172
.. image:: ../_static/intro/intro-5.png
170
173
174
+
.. attention::
175
+
Some user workstations do not permit outbound RDP. If RDP is not working, use the HTTP KASM Jumphost. Instructions here: https://clouddocs.f5.com/training/community/genai/html/prerequisite/prerequisite.html#kasm-desktop
176
+
171
177
Windows 10 RDP login password can be obtained as following
172
178
173
179
.. image:: ../_static/intro/intro-6.png
174
180
181
+
175
182
Window 10 Jumphost
176
183
177
184
.. image:: ../_static/intro/intro-7.png
@@ -513,43 +520,73 @@ Use the following credentials
513
520
514
521
.. image:: ../class3/_static/class3-15-1.png
515
522
516
-
Under Chatflows, click arcadia-rag
523
+
Click the icon to change Flowise UI to dark mode.
517
524
518
-
Currently, GenAI RAG chatbot pointing to a different Ollama API endpoint. Lets update GenAI RAG Chatbot to point to AIGW API endpoint.
525
+
.. image:: ./_static/class5-12-b.png
526
+
527
+
Click **arcadia-rag**
528
+
529
+
.. image:: ./_static/class5-12-c.png
530
+
531
+
Currently, GenAI RAG chatbot points to a different Ollama API endpoint. Lets update GenAI RAG Chatbot to point to AIGW API endpoint.
519
532
520
533
.. Attention::
521
534
522
-
By default **ChatOllama** node to point to Ollama API endpoint as shown below. We need to update LLM orchestrator to point to AIGW API endpoint. This require changes to **ChatOpenAI Custom** node. We are using OpenAI API schema to connect to AIGW API endpoint.
535
+
By default **ChatOllama** node points to Ollama API endpoint. We need to update LLM orchestrator to point to AIGW API endpoint. This require changes to **ChatOpenAI Custom** node. We are using OpenAI API schema to connect to AIGW API endpoint.
536
+
537
+
538
+
Pan the Flowise UI to the top right by holding left-click and moving the mouse.
523
539
540
+
.. image:: ./_static/class5-12-d.png
524
541
525
-
Click the “+” button in the Flowise UI and search using keyword “custom”. We are going to use **ChatOpenAI Custom** node
542
+
Click the “+” button in the Flowise UI
526
543
527
-
Drag the **ChatOpenAI Custom** node onto the FlowiseAI canvas.
544
+
.. image:: ./_static/class5-12-e.png
528
545
529
-
.. image:: ./_static/class5-12.png
546
+
Search using keyword “custom”. We are going to use **ChatOpenAI Custom** node
530
547
531
-
Here a series of task that you may need to perform.
548
+
Drag the **ChatOpenAI Custom** node onto the FlowiseAI canvas to the top-right of the space (above the other objects).
549
+
550
+
.. image:: ./_static/class5-12-f.png
551
+
552
+
Overview - We will be performing multiple tasks on this node.
532
553
533
554
.. image:: ./_static/class5-13.png
534
555
535
-
1. Create a **Connect Credential.** We are going to use a dummy account
556
+
1. Create a **Connect Credential** by clicking once in the empty field. We are going to create a dummy account called dummy-api-key.
536
557
537
558
.. image:: ./_static/class5-13-1.png
538
559
539
-
OpenAI API Key can be a dummy value. Example value: 42
540
560
541
-
.. image:: ./_static/class5-13-2.png
561
+
562
+
Enter the following credentials.
563
+
564
+
565
+
+---------------------+---------------+
566
+
| **CREDENTIAL NAME** | dummy-api-key |
567
+
+---------------------+---------------+
568
+
| **OpenAI Api Key** | 42 |
569
+
+---------------------+---------------+
570
+
571
+
572
+
Then click Add.
573
+
574
+
.. image:: ./_static/class5-13-2-a.png
542
575
543
576
2. You need to provide the model name - **llama3.2:1b**
544
577
545
578
.. image:: ./_static/class5-13-3.png
546
579
547
580
548
-
1. You need to add the AIGW API endpoint (**https://aigw.ai.local/rag/v1**) via **Additional Parameters**. **Streaming** is currently experimental support from version 1.2.0 onwards. We can leave streaming as default enabled.
581
+
3. You need to add the AIGW API endpoint (**https://aigw.ai.local/rag/v1**) via **Additional Parameters**. **Streaming** is currently experimental support from version 1.2.0 onwards. We can leave streaming as default enabled.
549
582
550
583
.. image:: ./_static/class5-13-4.png
551
584
552
-
4. Click the “x” on the link to break the link between **ChatOllama with Conversational Retrieval QA Chain** and connect **Conversational Retrieval QA Chain** to **ChatOpenAI Custom** node. Click on save icon to save chatflow.
585
+
4. Click the “x” on the link to break the link between **ChatOllama with Conversational Retrieval QA Chain**
586
+
587
+
.. image:: ./_static/class5-14-a.png
588
+
589
+
5. Connect **Conversational Retrieval QA Chain** to **ChatOpenAI Custom** node. Click on save icon to save chatflow.
0 commit comments