Real conversation should not leave you waiting after a single sentence, nor should it grind to a halt just because the Agent is looking something up, calling a tool, or working on a task.
Conversation should keep flowing, and the Agent should always be present.
That is why we built qwen-audio-agent—a realtime voice runtime that keeps Agents talking, working, and present. Whether chatting with you, thinking through a problem, or working on a task, your Agent remains in the conversation. It listens, responds, and when the task is complete, naturally tells you:
"It's ready."
- 2026-08-12 · v1.8.3 ✨ Refined prompts; 📉 reduced token usage; 🔧 fixed known issues.
- 2026-08-11 · v1.8.2 🖥️ Refreshed desktop settings with a more consistent visual experience; 🎙️ more reliable voice wake; ⏱️ long-running tasks now report progress automatically.
- 2026-08-11 · v1.8.1 🧠 Cleaner persona and memory boundaries; 🔧 more reliable tasks and reminders.
- 2026-08-09 · v1.8.0 🆕 Adds Qwen Code backend; 🔧 fixes known issues.
- 2026-08-07 · v1.7.0 🎨 The orb opens up custom skins — import your own look, compatible with pet packs from the Awesome Codex Pet community gallery; 🪟 improved Windows backend Agent startup.
- 2026-08-07 · v1.6.1 ⚡ Task delegation and permission decisions confirm instantly; 🖥️ built-in computer-use lets backend Agents operate the computer out of the box; 🎙️ more reliable wake; 📚 fully bilingual docs.
- 2026-08-06 · v1.6.0 🪟 Desktop app now officially supports Windows; 🧠 adds invisible memory with automatic extraction after each session.
- 2026-08-05 · v1.5.0 ⏰ Adds scheduled reminders and progress reporting; 🗣️ adds the voice wake word ("你好千问"); 🐧 desktop build support for Linux; the desktop app now uses a data directory isolated from the CLI.
- 2026-08-05 · v1.4.2 🔧 Improves desktop backend Agent installation, login, and status detection; refines long-term memory behavior.
- 2026-08-04 · v1.4.1 🧰 Adds one-click backend Agent install; desktop floating orb supports auto-hide and shortcut recall.
- 2026-08-04 · v1.4.0 🧠 Adds personalized rules and checklist management; desktop app supports auto-sleep and shortcut wake.
- 2026-08-03 · v1.3.0 🎙️ Adds 🤗 speech-to-speech frontend integration, supporting fully local VAD, STT, LLM, and TTS.
- 2026-08-01 · v1.2.0 ⚡ Desktop app adds auto-update, faster startup, and improved backend Agent detection.
- 2026-07-31 · v1.1.0 🤝 Adds Kimi Code CLI backend with native ACP integration.
- 2026-07-30 · v1.0.0 🚀 First stable release, introducing a macOS desktop app with a built-in Gateway.
- 2026-07-28 · v0.9.0 🌍 Project officially open-sourced; backend Agents unified under the ACP architecture.
Conversation doesn't stop for background tasks; when a task completes, the result naturally returns to the current conversation:
qwen-audio-agent-v1.mp4
- Full-duplex realtime voice interaction, natural interruption, and sustained multi-turn conversation
- One-click selection of your preferred coding Agent, reusing existing tools, MCP, and Skills
- Frontend conversation and background tasks run in parallel; ask about progress or cancel at any time
- Create multiple independent tasks executed asynchronously by the backend Agent, with continuous status tracking
- Task results automatically return to the current conversation, supporting follow-up questions and modifications
- WebUI, terminal TUI, and desktop floating orb (macOS / Windows / Linux)
- Per-user long-term personalization and cross-session memory
Questions that can be answered directly are answered immediately; when tools or sustained processing are needed, the task is delegated to the backend Agent. Throughout, the user always faces the same assistant.
| Backend Agent | Integration | Setup | Rating |
|---|---|---|---|
| None | N/A | Frontend-only mode, no config needed | ★★★★★ |
| OpenCode | Native ACP | One-click install + Bailian config | ★★★★★ |
| OpenClaw | Built-in ACP bridge | One-click install + Bailian config | ★★★★★ |
| Qoder | Native ACP | One-click install, user config required | ★★★★★ |
| Qwen Code | Native ACP | One-click install, user config required | ★★★★☆ |
| Kimi Code | Native ACP | One-click install, user config required | ★★★★★ |
| Hermes | Native ACP | One-click install, user config required | ★★★★☆ |
| CodeBuddy | Native ACP | One-click install, user config required | ★★★★☆ |
| Codex | External ACP adapter | One-click install (base + adapter), user config required | ★★★★☆ |
| Claude Code | External ACP adapter | One-click install (base + adapter), user config required | ★★★★☆ |
Ratings reflect current integration completeness, compatibility, and verification level: five stars indicate a thoroughly tested recommended integration; four stars indicate active development or not yet fully verified. For detailed configuration and capability boundaries, see the configuration guide.
Requires Node.js 22.22.2+ or 24.15.0+, npm 10+. One-click install (recommended):
npm install -g qwen-audio-agentFor building from source, installing from GitHub, and obtaining a DashScope API Key, see the installation guide.
- Create your config and fill in the API Key:
qwenaudio configDASHSCOPE_API_KEY=your-key
# Voice frontend model: qwen-audio-3.0-realtime-flash or qwen-audio-3.0-realtime-plus (default)
QWEN_AUDIO_REALTIME_MODEL=qwen-audio-3.0-realtime-plus
# Backend Agent: optional, leave empty or set to none for frontend-only mode
AGENT_PROTOCOL=openclaw
# Backend model: can be empty; if empty, uses the Agent's own user config
QWEN_AUDIO_AGENT_BACKEND_MODEL=qwen3.7-maxUses DashScope realtime voice frontend by default; alternatively, switch to a local speech-to-speech frontend, no cloud API Key needed.
- Start the Gateway, then open another terminal to start the TUI (or use
qwenaudio webuifor the browser UI):
qwenaudio # Terminal 1: Gateway
qwenaudio tui # Terminal 2: TUIFor full configuration options, speech-to-speech frontend setup, and TUI platform notes, see quick start, voice frontends, and TUI notes.
The desktop app provides a floating voice orb that stays on your desktop, with a built-in Gateway, auto-hide, shortcut recall, and voice wake word. Download the installer for your platform from the releases page, or build from source:
npm run desktop:build:local # macOS
npm run desktop:build:win # Windows
npm run desktop:build:linux # Linux (AppImage + deb, no signing)For visuals, orb behavior, and build instructions, see the desktop documentation.
AGENT_PROTOCOL is optional. Leave empty for frontend-only mode; when set,
it reuses the installed Agent's user-level models, tools, MCP, Skills, and
authentication. OpenCode and OpenClaw support one-click install with Bailian
configuration.
qwenaudio setup # View available backend AgentsFor Agent selection, persistent background service, generic ACP entry, and permission modes, see the backend Agent documentation.
User data is stored in ~/.config/qwaudio/ (ASSISTANT.md, USER.md,
MEMORY.md, tasks.json, logs/), kept local only, never
committed to the repository. See assistant profile, user preferences, and memory.
- Do not store passwords, API Keys, verification codes, or access tokens in user preferences or conversation.
- Microphone audio and realtime conversation are sent to the configured Realtime frontend service (DashScope or speech-to-speech).
- Background tasks may invoke the selected Agent's models, tools, MCP, and external services.
fullpermission allows the backend to execute commands and modify files; use only in trusted projects.- The Gateway is for local use only; do not expose it directly to the network or public internet.
- On Linux / Windows with full-duplex without echo cancellation, wear headphones.
For detailed data boundaries, see the privacy notice; for network and permission configuration, see the configuration guide.
npm install
npm run build
npm testnpm run dev # Gateway + WebUI hot reload
npm run desktop # Desktop floating orb (macOS / Windows)For more build, test, and release instructions, see CONTRIBUTING.md.
You can start discussions directly in GitHub Issues.
For users in China, scan the QR codes below to join the WeChat group. If the group QR code is full or expired, scan either maintainer's personal QR code to be invited.
| WeChat Group | Personal | Personal |
|---|---|---|
![]() |
![]() |
![]() |
- Development and contribution guide: CONTRIBUTING.md
- Security reports: SECURITY.md
- Data flow and privacy: PRIVACY.md
- Third-party notices: THIRD_PARTY_NOTICES.md




