Skip to content

Commit 1c24379

Browse files
author
fochan
committed
update with new cases
1 parent 5dce697 commit 1c24379

16 files changed

+449
-7
lines changed
138 KB
Loading
174 KB
Loading
119 KB
Loading

docs/class3/_static/class3-25.png

208 KB
Loading

docs/class3/class3.rst

Lines changed: 55 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -182,6 +182,8 @@ Repeat the above to download the following LLM model
182182
+----------------------------+---------------------------------------------+
183183
| llama3.2:1b | Meta Llama3.2 (1b) |
184184
+----------------------------+---------------------------------------------+
185+
| llama3 | Meta Llama 3 (8b) - only use for GPUaaS |
186+
+----------------------------+---------------------------------------------+
185187
| qwen2.5:1.5b | Alibaba Cloud Qwen2 (1.5b) |
186188
+----------------------------+---------------------------------------------+
187189
| hangyang/rakutenai-7b-chat | Rakuten AI (7b) |
@@ -365,7 +367,16 @@ Import arcadia RAG chatflow into flowise. Select **Add New**, click **Settings i
365367

366368
A copy of the chatflow located on the jumphost **Documents** directory. Select the chatflow json file.
367369

368-
.. image:: ./_static/class3-17.png
370+
371+
.. Note::
372+
Ensure you choose the right json file according to the environment use cases - CPU or GPUaaS.
373+
374+
CPU - "*arcadia-rag Chatflow.json*"
375+
376+
GPUaaS - "*arcadia-rag-gpuaas Chatflow.json*"
377+
378+
379+
.. image:: ./_static/class3-17-1.png
369380

370381
Save the chatflow (arcadia-rag)
371382

@@ -376,6 +387,16 @@ Save the chatflow (arcadia-rag)
376387

377388
.. image:: ./_static/class3-18-1.png
378389

390+
.. attention::
391+
**For GPUaaS ONLY**
392+
393+
Ensure you have a valid GPUaaS API key (if your lab based on GPU) and create as following:-
394+
395+
.. image:: ./_static/class3-18-2.png
396+
397+
.. image:: ./_static/class3-18-3.png
398+
399+
379400

380401
To successfully build the full langchain pipeline / chatflow, you need to upload organization context information into the RAG pipeline. Arcadia context information file located in the **Documents** directory. Under **Text File** node, Click **Upload File**
381402

@@ -536,6 +557,35 @@ Here are some of the node/chain used.
536557
| | storage mechanism for storing/retrieving conversations. |
537558
+---------------------------------------------+-----------------------------------------------------------------------+
538559

560+
.. Attention::
561+
562+
**For GPUaaS ONLY**
563+
564+
+---------------------------------------------+-----------------------------------------------------------------------+
565+
| Node / Chain | Description |
566+
+=============================================+=======================================================================+
567+
| **ChatOpenAI Custom** | Custom/FineTuned model using OpenAI Chat compatible API. |
568+
| | |
569+
| Connect Credential | |
570+
| | |
571+
| gpuaas-key | Ensure you obtains a valid GPUaaS API key |
572+
| | |
573+
| Base URL URL: | |
574+
| | |
575+
| https://gpuaas1.xc.edgecnf.com/v1 | This is the GPUaaS API inference endpoint |
576+
| | |
577+
| Model Name: | |
578+
| | |
579+
| llama3 | llama3 will be use for the inference. Its 8B parameter model |
580+
| | |
581+
| Temperature: | |
582+
| | |
583+
| 0.9 | |
584+
+---------------------------------------------+-----------------------------------------------------------------------+
585+
586+
587+
588+
539589
Vectorize Proprietary Data
540590
~~~~~~~~~~~~~~~~~~~~~~~~~~
541591

@@ -591,7 +641,7 @@ Input on the chat box
591641
592642
593643
.. attention::
594-
You are using CPU for inference. Hence, expect some delay in the response.
644+
If you are using CPU for inference. Hence, expect some delay in the response.
595645

596646

597647
Sample RAG Chatbot conversation
@@ -619,6 +669,9 @@ Suggested sample question ask to the RAG chatbot
619669

620670
Source of inforamtion or "proprietary data" obtained from the text file store on Documents folder on the Windows jumphost.
621671

672+
.. NOTE::
673+
You can clear the chat history with the middle red button on the chat window.
674+
622675
.. image:: ./_static/class3-34.png
623676

624677
.. attention::
134 KB
Loading
39.7 KB
Loading
145 KB
Loading
175 KB
Loading

docs/class5/_static/class5-2-1.png

34.5 KB
Loading

0 commit comments

Comments
 (0)