Skip to content

kilocode.md

Latest commit

 

History

History
69 lines (51 loc) · 1.2 KB

kilocode.md

File metadata and controls

69 lines (51 loc) · 1.2 KB
Raw

Kilo Code + xInfer (OpenAI-compatible endpoint)

This guide connects Kilo Code directly to xInfer using the built-in OpenAI-compatible /v1/chat_completions API.

Kilo Code -> xInfer (OpenAI-compatible)

1) Start xInfer on port 8000

# Rust
xinfer --m Qwen/Qwen3.5-35B-A3B-FP8 --server --d 0

# Different model
xinfer --m Qwen/Qwen3.5-27B-FP8 --d 0 --server

# Python
python3 -m xinfer.server --m Qwen/Qwen3-Coder-Next-FP8 --d 0,1

2) Configure Kilo Code

Install Kilo Code (CLI)

npm install -g @kilocode/cli

Export config into ~/.config/kilo/config.json

{
  "$schema": "https://opencode.ai/config.json",
  "provider": {
    "xinfer": {
      "npm": "@ai-sdk/openai-compatible",
      "name": "xInfer Local",
      "options": {
        "baseURL": "http://localhost:8000/v1"
      },
      "models": {
        "qwen3-coder": {
          "name": "Qwen3 Coder"
        }
      }
    }
  },
  "model": "xinfer/qwen3-coder"
}

3) Run Kilo Code

run Kilo Code (CLI)

kilo

Trouble shooting

  1. Use the chat logger to monitor detailed interactions between Kilo Code and xInfer.
# Log into files (in folder ./log)
export XINFER_CHAT_LOGGER=1