Skip to content

rinokadijk/traefik-openai-header

Repository files navigation

Traefik OpenAI Header

This is a middleware plugin gets openai request metadata as headers.

Config

chatCompletionUriRegex: /v1/chat/completions
batchUriRegex: /v1/batches
requestFields:
  model: X-OpenAI-Model
  user: X-OpenAI-User
  temperature: X-OpenAI-Temperature
  max_completion_tokens: X-OpenAI-Max-Completion-Tokens
  logprobs: X-OpenAI-Logprobs
  top_logprobs: X-OpenAI-Top-Logprobs
  tool_choice: X-OpenAI-Tool-Choice
  stream: X-OpenAI-Stream
  completion_window: X-OpenAI-Completion-Window
  oai_endpoint: X-OpenAI-Endpoint

About

Get headers from OpenAI model requests

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages