-
Notifications
You must be signed in to change notification settings - Fork 5
Closed
Description
Is your feature request related to a problem? Please describe.
The OpenAI platform has an api for completions with structured outputs
https://platform.openai.com/docs/guides/structured-outputs?api-mode=chat
In python, this is used via client.beta.chat.completions
This API is already in use by projects like DeepEval
Describe the solution you'd like
Full support: Logs, metrics and tracing for responses like we do for normal completions
Describe alternatives you've considered
Tell people to not use client.beta.chat.completions
Additional context
Others might have implemented this
- https://github.com/Arize-ai/openinference/blob/85d435be3af3de5424494cfbdd654454688b7377/js/packages/openinference-instrumentation-openai/test/openai.test.ts#L354
- https://github.com/traceloop/openllmetry/blob/f9a379b416ab6d7c8d65b36e0f30918d16a46ada/packages/sample-app/sample_app/openai_structured_outputs.py#L32
- https://github.com/openlit/openlit/blob/b0099ce877547edb1eeaaf49c68ee159c5c49d22/sdk/python/src/openlit/guard/utils.py#L92
Metadata
Metadata
Assignees
Labels
No labels