Popular repositories Loading

1. llm-d-interactive-demo llm-d-interactive-demo Public

   interactive walkthrough of llm-d distributed inference — pick your industry and role, see how the pieces fit and why they matter

   TypeScript

2. llm-d-inference-routing-landscape llm-d-inference-routing-landscape Public

   interactive map of inference routing approaches — cache-aware, prefix-aware, priority-based, disaggregated

   HTML

3. llm-d-roi-calculator llm-d-roi-calculator Public

   rough out what llm-d saves you vs dedicated GPUs — TCO, utilization, payback, every assumption editable

   CSS

4. llm-d-agentic-visualizer llm-d-agentic-visualizer Public

   simulated agentic traffic hitting an llm-d cluster — bursts, priority queues, auto-scaling

   HTML

5. llm-d-choose-your-stack llm-d-choose-your-stack Public

   answer 5 questions, get an llm-d architecture and Helm values for your situation

   HTML

6. llm-d-transparent-cluster llm-d-transparent-cluster Public

   look inside a running llm-d cluster — watch requests route, caches fill, and GPUs light up

   HTML