Grunz: hosted abliterated open models, for the ones too big to run locally #7662
behrnt-slatgng
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Founder here, so weigh it accordingly.
Grunz is a chat app plus a Claude Code style coding agent running abliterated open-weight models (Qwen, DeepSeek, GLM, Kimi) with the refusal training removed.
Cloud hosted, not local — so if you already have textgen running the way you want it, this isn't a replacement and I won't pretend otherwise. Where it's useful is the models too big for your card, without the setup.
No account, free credits to start. https://grunzai.com
Two things from running these in production that might be useful regardless: abliteration costs output-format adherence more than it costs knowledge, and tool-call formatting drifts from the base model more than the eval numbers suggest.
All reactions