Skip to content

v.0.1.0

No due date 73% complete

Providing a buildable and usable version consisting of the POC features:

  • Unified GenAI LLM API (OpenAI and AWS Bedrock chat completions)
  • LLM Token Based usage Limiting (aka Token Ratelimiting)
  • Upstream Authorization (AWS, APIKey)

Docs should include:

  • Installation steps
  • Control Plane API Docs
  • Design overview

Providing a buildable and usable version consisting of the POC features:

  • Unified GenAI LLM API (OpenAI and AWS Bedrock chat completions)
  • LLM Token Based usage Limiting (aka Token Ratelimiting)
  • Upstream Authorization (AWS, APIKey)

Docs should include:

  • Installation steps
  • Control Plane API Docs
  • Design overview
Loading