Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: no-log not being respected wth embeddings #8380

Open
stephaneminisini opened this issue Feb 8, 2025 · 0 comments
Open

[Bug]: no-log not being respected wth embeddings #8380

stephaneminisini opened this issue Feb 8, 2025 · 0 comments
Labels
bug Something isn't working feb 2025 langfuse

Comments

@stephaneminisini
Copy link

What happened?

a payload like :

{
"model": "cohere.embed-english-v3",
"no-log": true,
"input": "Can you please give me your the numbers after the dash?",
"metadata": {
"trace_user_id": "postman-test",
"session_id": "new-session",
"tags": [
"tag1",
"tag2"
],
"trace_metadata": {
"key": "value"
}
}
}

Should not log the request into the logging system (tested with langfuse). it works with the chat/completions endpoint but has no effect on the embeddings endpoint and will log the request whatever the value for no-log is.

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.59.8-stable

Twitter / LinkedIn details

No response

@stephaneminisini stephaneminisini added the bug Something isn't working label Feb 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working feb 2025 langfuse
Projects
None yet
Development

No branches or pull requests

2 participants