Add langfuse blueprint #3418
Add langfuse blueprint #3418
Conversation
Signed-off-by: Mingshi Liu <[email protected]>
mingshl
requested review from
b4sjoo,
dhrubo-os,
jngz-es,
model-collapse,
rbhavna,
ylwu-amzn,
zane-neo,
Zhangxunmt,
austintlee,
HenryL27 and
xinyual
as code owners
mingshl
temporarily deployed
to
ml-commons-cicd-env
GitHub Actions
Inactive
mingshl
had a problem deploying
to
ml-commons-cicd-env
GitHub Actions
Failure
|
|
||
| ## 2. Create Connector for Langfuse: | ||
| The following connector is connecting to the API for getting a prompt. There are other apis from Langfuse that is available to connect to, please refer to https://api.reference.langfuse.com/#get-/api/public/comments. | ||
| Note: The username:password should be Base64 encoded. The username is the Langfuse Public Key, and the password is the Langfuse Secret Key. |
There was a problem hiding this comment.
Lets make this a new line here since when we render it the sentence Note: ... gets attached to the last sentence
| Note: The username:password should be Base64 encoded. The username is the Langfuse Public Key, and the password is the Langfuse Secret Key. | |
| The following connector is connecting to the API for getting a prompt. There are other apis from Langfuse that is available to connect to, please refer to https://api.reference.langfuse.com/#get-/api/public/comments. | |
| Note: The username:password should be Base64 encoded. The username is the Langfuse Public Key, and the password is the Langfuse Secret Key. |
| "description": "The connector to Langfuse", | ||
| "protocol": "http", | ||
| "parameters": { | ||
| "promptName": "<YOUR_PROMPT_NAME>" |
There was a problem hiding this comment.
This promptName gets used in the url but also in the payload? Must you use this same promptName consistently throughout all predictions?
There was a problem hiding this comment.
the promptName need a default value in the connectors in the url. This is a GET api, so the payload is not important. But I tried and we need something in the payload, that's why put the same promptName
| } | ||
| ] | ||
| } | ||
| ``` |
There was a problem hiding this comment.
I think a mini explanation of the inference result would be a bonus
There was a problem hiding this comment.
sure, I will try add some explanations
| @@ -0,0 +1,167 @@ | |||
| ### Langfuse Connector Blueprint: | |||
|
|
|||
There was a problem hiding this comment.
Overall I think this makes sense to me but A little bit more context (in the beginning of the document) in the beginning would be great as a reader.
Description
Add langfuse blueprint to ml-commons documentation. Thanks @jngz-es for helping with the basic authentication configuration.
Check List
--signoff.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.