Merge pull request #9529 from Michiel-Bijlsma/MB-GenAIPortalHowTo

Adding section about token consumption monitoring

Author: MarkvanMents

content/en/docs/appstore/use-content/platform-supported-content/modules/genai/mendix-cloud-genai/navigate_mxgenai.md

@@ -8,36 +8,37 @@ weight: 30
 
 ## Introduction
 
-The [Mendix Cloud GenAI portal](https://genai.home.mendix.com/) is an online platform that provides access to Mendix Cloud GenAI resources. These resource packs on Mendix Cloud enable seamless integration with Generative AI technology, provisioned and hosted by Mendix: 
+The [Mendix Cloud GenAI portal](https://genai.home.mendix.com/) is an online platform that provides access to Mendix Cloud GenAI resource packs. These resource packs on Mendix Cloud enable seamless integration with Generative AI technology, provisioned and hosted by Mendix: 
 
 * GenAI Model Resource Packs provide access to model resources: Anthropic's  Claude and Cohere's Embed. 
-* GenAI Knowledge Base Resource Packs provide the infrastructure to deliver RAG architecture and other GenAI use cases requiring a vector database. 
+* GenAI Knowledge Base Resource Packs provide the infrastructure to deliver retrieval-augmented generation (RAG) architecture and other GenAI use cases requiring a vector database. 
 
-GenAI resource packs accelerate the delivery of complete Generative AI solutions within Mendix apps that seamlessly integrate with GenAI technology. Learn more about [Mendix Cloud GenAI Resource Packs](https://docs.mendix.com/appstore/modules/genai/mx-cloud-genai/resource-packs/) and the [Mendix Cloud GenAI Connector](/appstore/modules/genai/mx-cloud-genai/MxGenAI-connector/). To start with a GenAI-infused Mendix application, see [creating a chatbot using the AI Bot Starter App](https://docs.mendix.com/appstore/modules/genai/using-genai/starter-template/) or [building a GenAI app from scratch with the Blank GenAI App](https://docs.mendix.com/appstore/modules/genai/using-genai/blank-app/). 
+GenAI resource packs accelerate the delivery of complete generative AI solutions within Mendix apps that seamlessly integrate with GenAI technology. Learn more by following these links to [Mendix Cloud GenAI Resource Packs](/appstore/modules/genai/mx-cloud-genai/resource-packs/) and the [Mendix Cloud GenAI Connector](/appstore/modules/genai/mx-cloud-genai/MxGenAI-connector/). To start with a GenAI-infused Mendix application, see [creating a chatbot using the AI Bot Starter App](/appstore/modules/genai/using-genai/starter-template/) or [building a GenAI app from scratch with the Blank GenAI App](/appstore/modules/genai/using-genai/blank-app/). 
 
 ## Resource Details 
 
 ### Settings
 
 {{< figure src="/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai/GenAIResource_Settings.png" >}}
 
-The **Settings** tab contains the details of a GenAI resource. Here is more information:
+The **Settings** tab contains the details of a GenAI resource. It shows the following:
 
 * **Display Name**: indicates the name of the resource.
 * **ID**: indicates the resource ID.
 * **Region**: the region where the resource is hosted.
-* **Cloud provider**: indicates the cloud provider, for example, AWS.
+* **Cloud Provider**: indicates the cloud provider, for example, AWS.
 * **Type**: this is the type of resource, for example, Text Generation, Embedding, Knowledge Base, etc.
 * **Model**: indicates which model is used, for example, Anthropic Claude Sonnet 3.5.
 * **Plan**: indicates the subscription plan used for compute resources (for example, embedding or text generation resources).
 * **Environment**: shows which environment is used, for example, test, acceptance, or production.
-* Additionally when you are looking at the knowledge base resource settings, you will see details of the associated embeddings resource and vice versa. To learn more about embeddings,  see [Embedding vector](https://docs.mendix.com/appstore/modules/genai/rag/#embedding-vector).
+
+When you are looking at the knowledge base resource settings, you will also see details of the associated embeddings resource and vice versa. To learn more about embeddings,  see the [Embedding vector](/appstore/modules/genai/rag/#embedding-vector) section of *RAG in a Mendix App*.
 
 ### Team
 
 {{< figure src="/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai/GenAIResource_Team.png" >}}
 
-The **Team** allows you to manage access to the Mendix Cloud GenAI resource. All users listed in this overview have access to the resource in the GenAI resource portal and can create new keys or invite new users. You can add new users via the **Add Member** button and remove them using the **Remove Member** button next to their name in the overview.
+The **Team** page allows you to manage access to the Mendix Cloud GenAI resource. All users listed in this overview have access to the resource in the GenAI resource portal and can create new keys or invite new users. You can add new users via the **Add Member** button and remove them using the **Remove Member** button next to their name in the overview.
 
 {{% alert color="info" %}}Currently, you can only invite people within the same organization.{{% /alert %}} 
 
@@ -47,7 +48,11 @@ The **Team** allows you to manage access to the Mendix Cloud GenAI resource. All
 
 The **Keys** tab allows you to manage configuration keys for the resources. These keys provide programmatic access to the GenAI resources. From the **Keys** tab, you can create new keys and revoke existing ones.  
 
-To create a new key, click **Create Key**, add a description, and save the changes. A pop-up message will display the key. Make sure to store it securely, as it will only be shown once.
+To create a new key, click **Create Key**, add a description, and save the changes. A pop-up message will display the key.
+
+{{% alert color="info" %}}
+Make sure to store it securely, as it will only be shown once.
+{{% /alert %}}
 
 {{< figure src="/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai/GenAIResource_KeyGeneration.png" >}}
 
@@ -63,13 +68,12 @@ On the **Content** page, you can find information on adding knowledge to your Kn
 
 Currently, you have the following options for adding data to a Knowledge Base:
 
-1. Add files (for example, TXT or PDF)
-
-2. Add data from a Mendix application
+* Add files (for example, TXT or PDF)
+* Add data from a Mendix application
 
 #### Add Files 
 
-When you select **Add Files Like .TXT or .PDF** option, you can upload documents directly to the GenAI portal. Before uploading, you also have the option to add metadata. For more information, see the [metadata](#metadata) section below.
+When you select the **Add Files Like .TXT or .PDF** option, you can upload documents directly to the GenAI portal. Before uploading, you also have the option to add metadata. For more information, see the [metadata](#metadata) section below.
 
 {{% alert color="info" %}} Only TXT and PDF files are supported. {{% /alert %}} 
 
@@ -83,4 +87,28 @@ For example, a GenAI Knowledge Base could be used to store customer support tick
 
 #### Add Data from a Mendix Application
 
-You can upload data directly from Mendix to the Knowledge Base. To do so, several operations of the Mendix Cloud GenAI Connector are required. For a detailed guide on this process, see [Add Data Chunks to Your Knowledge Base](/appstore/modules/genai/mx-cloud-genai/MxGenAI-connector/#add-data-chunks-to-your-knowledge-base).
+You can upload data directly from Mendix to the Knowledge Base. To do so, several operations of the Mendix Cloud GenAI Connector are required. For a detailed guide on this process, see the [Add Data Chunks to Your Knowledge Base](/appstore/modules/genai/mx-cloud-genai/MxGenAI-connector/#add-data-chunks-to-your-knowledge-base) section of **Mendix Cloud GenAI Connector**.
+
+## Token Consumption Monitor
+
+The **Token Consumption Monitor** shows detailed graphs of the token consumption used by the GenAI resource. Use this overview to see the current usage, insights on the usage per day, and to compare the current month with previous months.
+
+{{< figure src="/attachments/appstore/platform-supported-content/modules/genai/navigate_mxgenai/GenAIResource_TokenConsumptionMonitor.png" >}}
+
+### What Are Tokens?
+
+Tokens are what you pay for when consuming large language model services.
+
+In order for a large language model to understand text input, the text is first ‘tokenized’: broken down into smaller pieces where each piece represents a token with its unique ID. A good rule of thumb is that 100 tokens are around 75 English words, however there are always differences depending on the model or the language used. After tokenization, each token will be assigned an embeddings vector. The tokens required to feed the input prompt to the model are called ‘input tokens’. The tokens required to transform the model output vectors into, for example, text or images are called ‘output tokens’.
+
+### When Are Tokens Consumed?
+
+Text generation resources consume both input and output tokens (text sent to the model and generated by the model).
+
+Embeddings resources only consume input tokens. This is because only the generated embedding vectors are returned and the generated output is not tokenized.
+
+Knowledge base resources do not consume tokens as they only store embedding vectors. Uploading a document to a knowledge base connected to an Embeddings resource will consume tokens in the embeddings resource.
+
+### Exporting Token Consumption Data 
+
+Click **Export** to export consumption data in CSV format. The export contains basic information about input tokens, output tokens, and dates. Days with no consumption are not exported.