Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phoenix Observability Edits #156

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
62 changes: 62 additions & 0 deletions en/using-flowise/observability/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,62 @@
---
description: Learn how to analyze and troubleshoot your chatflows and agentflows
---

# Observability

***

There are several observability providers Flowise integrates with:

* [LunaryAI](https://lunary.ai/)
* [Langsmith](https://smith.langchain.com/)
* [Langfuse](https://langfuse.com/)
* [LangWatch](https://langwatch.ai/)
* [Arize](https://arize.com/)
* [Phoenix](https://phoenix.arize.com/)

## Lunary

[Lunary](https://lunary.ai/) is a monitoring and analytics platform for LLM chatbots.

Flowise has partnered with Lunary to provide a complete integration supporting user tracing, feedback tracking, conversation replays and detailed LLM analytics.

Flowise users can get a 30% discount on the Teams Plan using code `FLOWISEFRIENDS` during checkout.

Read more on how to setup Lunary with Flowise [here](https://lunary.ai/docs/integrations/flowise).

## Setup

1. At the top right corner of your Chatflow or Agentflow, click **Settings** > **Configuration**

<figure><img src="../../.gitbook/assets/analytic-1.webp" alt="Screenshot of user clicking in the configuration menu" width="375"><figcaption></figcaption></figure>

2. Then go to the Analyse Chatflow section

<figure><img src="../../.gitbook/assets/analytic-2.png" alt="Screenshot of the Analyse Chatflow section with the different Analytics providers"><figcaption></figcaption></figure>

3. You will see a list of providers, along with their configuration fields

<figure><img src="../../.gitbook/assets/image (82).png" alt="Screenshot of an analytics provider with credentials fields expanded"><figcaption></figcaption></figure>

4. Fill in the credentials and other configuration details, then turn the provider **ON**. Click Save.

<figure><img src="../../.gitbook/assets/image (83).png" alt="Screenshot of analytics providers enabled"><figcaption></figcaption></figure>

## API

Once the analytic has been turned ON from the UI, you can override or provide additional configuration in the body of the [Prediction API](api.md#prediction-api):

```json
{
"question": "hi there",
"overrideConfig": {
"analytics": {
"langFuse": {
// langSmith, langFuse, lunary, langWatch
"userId": "user1"
}
}
}
}
```
29 changes: 29 additions & 0 deletions en/using-flowise/observability/arize.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
description: Learn how to setup Arize to analyze and troubleshoot your chatflows and agentflows
---

# Arize

***

## Setup

1. At the top right corner of your Chatflow or Agentflow, click **Settings** > **Configuration**

<figure><img src="../../.gitbook/assets/analytic-1.webp" alt="Screenshot of user clicking in the configuration menu" width="375"><figcaption></figcaption></figure>

2. Then go to the Analyse Chatflow section

<figure><img src="../../.gitbook/assets/analytic-2.png" alt="Screenshot of the Analyse Chatflow section with the different Analytics providers"><figcaption></figcaption></figure>

3. You will see a list of providers, along with their configuration fields. Click on Arize.

<figure><img src="../../.gitbook/assets/arize/arize-1.png" alt="Screenshot of an analytics provider with credentials fields expanded"><figcaption></figcaption></figure>

4. Create credentials for Arize. Refer to the [official guide](https://docs.arize.com/arize/llm-tracing/quickstart-llm#get-your-api-keys) on how to get the Arize API key.

<figure><img src="../../.gitbook/assets/arize/arize-2.png" alt="Screenshot of analytics providers enabled"><figcaption></figcaption></figure>

5. Fill in other configuration details, then turn the provider **ON**

<figure><img src="../../.gitbook/assets/arize/arize-3.png" alt="Screenshot of analytics providers enabled"><figcaption></figcaption></figure>
29 changes: 29 additions & 0 deletions en/using-flowise/observability/phoenix.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
description: Learn how to setup Phoenix to analyze and troubleshoot your chatflows and agentflows
---

# Phoenix

***

## Setup

1. At the top right corner of your Chatflow or Agentflow, click **Settings** > **Configuration**

<figure><img src="../../.gitbook/assets/analytic-1.webp" alt="Screenshot of user clicking in the configuration menu" width="375"><figcaption></figcaption></figure>

2. Then go to the Analyse Chatflow section

<figure><img src="../../.gitbook/assets/analytic-2.png" alt="Screenshot of the Analyse Chatflow section with the different Analytics providers"><figcaption></figcaption></figure>

3. You will see a list of providers, along with their configuration fields. Click on Phoenix.

<figure><img src="../../.gitbook/assets/phoenix/phoenix-1.png" alt="Screenshot of an analytics provider with credentials fields expanded"><figcaption></figcaption></figure>

4. Create credentials for Phoenix. Refer to the [official guide](https://docs.arize.com/phoenix/tracing/llm-traces-1) on how to get the Phoenix API key.

<figure><img src="../../.gitbook/assets/phoenix/phoenix-2.png" alt="Screenshot of analytics providers enabled"><figcaption></figcaption></figure>

5. Fill in other configuration details, then turn the provider **ON**. Click Save.

<figure><img src="../../.gitbook/assets/phoenix/phoenix-3.png" alt="Screenshot of analytics providers enabled"><figcaption></figcaption></figure>