Skip to content

Commit 5665ac7

Browse files
Merge pull request #3 from megamattzilla/main
class5 standalone update #3 - Add KASM reminder link and extra flowise screenshots
2 parents ba5bbe5 + 1582c61 commit 5665ac7

File tree

8 files changed

+51
-14
lines changed

8 files changed

+51
-14
lines changed
162 KB
Loading
180 KB
Loading
493 KB
Loading
460 KB
Loading
538 KB
Loading
153 KB
Loading
263 KB
Loading

docs/class5/class5.rst

Lines changed: 51 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -155,8 +155,11 @@ For details, please refer to official documentation. Here a brief description.
155155
targets:
156156
apiKey: GPUAAS_API_KEY
157157
158-
Recap when starting at Class 5. If you just performed Class 4, skip to 2 - Deploy F5 AI Gateway.
159-
------------------------------------------------------------------------------------------------
158+
Recap when starting at Class 5.
159+
-------------------------------
160+
161+
If you just performed Class 4, skip to `part 2 - Deploy F5 AI Gateway <#deploy-f5-ai-gateway>`_
162+
160163
Before you continue with this lab, here is a recap on what has been done/completed and what the pending/to-do task. This lab is to learn how to deploy F5 AI Gateway and configure AIGW policy.
161164

162165
.. image:: ./_static/class5-1-0-0.png
@@ -168,10 +171,14 @@ RDP to access Windows10 Jumphost.
168171

169172
.. image:: ../_static/intro/intro-5.png
170173

174+
.. attention::
175+
Some user workstations do not permit outbound RDP. If RDP is not working, use the HTTP KASM Jumphost. Instructions here: https://clouddocs.f5.com/training/community/genai/html/prerequisite/prerequisite.html#kasm-desktop
176+
171177
Windows 10 RDP login password can be obtained as following
172178

173179
.. image:: ../_static/intro/intro-6.png
174180

181+
175182
Window 10 Jumphost
176183

177184
.. image:: ../_static/intro/intro-7.png
@@ -513,43 +520,73 @@ Use the following credentials
513520

514521
.. image:: ../class3/_static/class3-15-1.png
515522

516-
Under Chatflows, click arcadia-rag
523+
Click the icon to change Flowise UI to dark mode.
517524

518-
Currently, GenAI RAG chatbot pointing to a different Ollama API endpoint. Lets update GenAI RAG Chatbot to point to AIGW API endpoint.
525+
.. image:: ./_static/class5-12-b.png
526+
527+
Click **arcadia-rag**
528+
529+
.. image:: ./_static/class5-12-c.png
530+
531+
Currently, GenAI RAG chatbot points to a different Ollama API endpoint. Lets update GenAI RAG Chatbot to point to AIGW API endpoint.
519532

520533
.. Attention::
521534

522-
By default **ChatOllama** node to point to Ollama API endpoint as shown below. We need to update LLM orchestrator to point to AIGW API endpoint. This require changes to **ChatOpenAI Custom** node. We are using OpenAI API schema to connect to AIGW API endpoint.
535+
By default **ChatOllama** node points to Ollama API endpoint. We need to update LLM orchestrator to point to AIGW API endpoint. This require changes to **ChatOpenAI Custom** node. We are using OpenAI API schema to connect to AIGW API endpoint.
536+
537+
538+
Pan the Flowise UI to the top right by holding left-click and moving the mouse.
523539

540+
.. image:: ./_static/class5-12-d.png
524541

525-
Click the “+” button in the Flowise UI and search using keyword “custom”. We are going to use **ChatOpenAI Custom** node
542+
Click the “+” button in the Flowise UI
526543

527-
Drag the **ChatOpenAI Custom** node onto the FlowiseAI canvas.
544+
.. image:: ./_static/class5-12-e.png
528545

529-
.. image:: ./_static/class5-12.png
546+
Search using keyword “custom”. We are going to use **ChatOpenAI Custom** node
530547

531-
Here a series of task that you may need to perform.
548+
Drag the **ChatOpenAI Custom** node onto the FlowiseAI canvas to the top-right of the space (above the other objects).
549+
550+
.. image:: ./_static/class5-12-f.png
551+
552+
Overview - We will be performing multiple tasks on this node.
532553

533554
.. image:: ./_static/class5-13.png
534555

535-
1. Create a **Connect Credential.** We are going to use a dummy account
556+
1. Create a **Connect Credential** by clicking once in the empty field. We are going to create a dummy account called dummy-api-key.
536557

537558
.. image:: ./_static/class5-13-1.png
538559

539-
OpenAI API Key can be a dummy value. Example value: 42
540560

541-
.. image:: ./_static/class5-13-2.png
561+
562+
Enter the following credentials.
563+
564+
565+
+---------------------+---------------+
566+
| **CREDENTIAL NAME** | dummy-api-key |
567+
+---------------------+---------------+
568+
| **OpenAI Api Key** | 42 |
569+
+---------------------+---------------+
570+
571+
572+
Then click Add.
573+
574+
.. image:: ./_static/class5-13-2-a.png
542575

543576
2. You need to provide the model name - **llama3.2:1b**
544577

545578
.. image:: ./_static/class5-13-3.png
546579

547580

548-
1. You need to add the AIGW API endpoint (**https://aigw.ai.local/rag/v1**) via **Additional Parameters**. **Streaming** is currently experimental support from version 1.2.0 onwards. We can leave streaming as default enabled.
581+
3. You need to add the AIGW API endpoint (**https://aigw.ai.local/rag/v1**) via **Additional Parameters**. **Streaming** is currently experimental support from version 1.2.0 onwards. We can leave streaming as default enabled.
549582

550583
.. image:: ./_static/class5-13-4.png
551584

552-
4. Click the “x” on the link to break the link between **ChatOllama with Conversational Retrieval QA Chain** and connect **Conversational Retrieval QA Chain** to **ChatOpenAI Custom** node. Click on save icon to save chatflow.
585+
4. Click the “x” on the link to break the link between **ChatOllama with Conversational Retrieval QA Chain**
586+
587+
.. image:: ./_static/class5-14-a.png
588+
589+
5. Connect **Conversational Retrieval QA Chain** to **ChatOpenAI Custom** node. Click on save icon to save chatflow.
553590

554591
.. image:: ./_static/class5-14.png
555592

0 commit comments

Comments
 (0)