Pinned Loading

1. LlamaEdge LlamaEdge Public

   The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

   Rust 1.5k 133

2. llama-nexus llama-nexus Public

   A gateway service designed to manage and orchestrate OpenAI-compatible API servers with MCP support.

   Rust 12 14

3. rag-api-server rag-api-server Public

   A RAG API server written in Rust following OpenAI specs

   Rust 57 12

4. sd-api-server sd-api-server Public

   The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

   Rust 23 2

5. whisper-api-server whisper-api-server Public

   The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

   Rust 23 4

6. tts-api-server tts-api-server Public

   The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

   Rust 11 2