Skip to content

Latest commit

 

History

History
12 lines (8 loc) · 435 Bytes

README.md

File metadata and controls

12 lines (8 loc) · 435 Bytes

A LAnguage Model INterface Enginee as god intended, because the rest of the standards to inference LM APIs are 💩.

I despise with pasion:

  • The fact that each provider uses a different spec for LLM requests
  • The OpenAI spec in particular
  • LiteLLM wacky codebase

So this is how it should actually be done. You are welcome.

Standards

For user manual see HOW-TO.ipynb