Skip to content

16 open whisper support#17

Merged
mschnecke merged 4 commits intomainfrom
16-open-whisper-support
Mar 23, 2026
Merged

16 open whisper support#17
mschnecke merged 4 commits intomainfrom
16-open-whisper-support

Conversation

@mschnecke
Copy link
Copy Markdown
Owner

No description provided.

mschnecke and others added 4 commits March 22, 2026 19:03
Corrected a logic error in the total calculation function causing inaccurate results. Added test cases to cover edge scenarios and ensure robustness.
Implements offline speech-to-text using `whisper-rs`, supporting model management and mode toggling between local and cloud transcription. Includes model downloads with progress indicators, customizable settings for language and model selection, modular design with lazy loading, and GPU acceleration support for Metal/Vulkan. Error handling ensures resilience during model operations.
Introduced an optional local transcription mode leveraging Whisper engine alongside existing cloud-based transcription. This includes Whisper model management (download, delete, and selection), audio resampling, and integration for model-based local inference. Updated UI components for seamless configuration.
- Fix whisper-rs-sys build on Windows: bundled bindings are Linux-only,
  causing struct size assertion failures. Add pre-generated Windows
  bindings and patch script (scripts/patch-whisper-bindings.js) that
  runs automatically via npm pretauri:dev/pretauri:build hooks.
- Add silence detection (RMS threshold) to reject dead audio before
  Whisper inference, preventing hallucinations on silent input.
- Enable suppress_blank and suppress_nst in Whisper params to filter
  hallucinated non-speech tokens (e.g. "Subtitles by Amara.org").
- Add per-crate opt-level=3 for whisper-rs-sys, whisper-rs, and rubato
  in dev profile to speed up inference during development.
- Change default model from large-v3 to small for faster CPU inference.
- Remove base model tier (unusable quality).
- Upgrade whisper-rs from 0.14 to 0.16.

Co-Authored-By: Claude Opus 4.6 (1M context) <[email protected]>
@mschnecke mschnecke self-assigned this Mar 23, 2026
@mschnecke mschnecke merged commit 9709288 into main Mar 23, 2026
2 checks passed
@mschnecke mschnecke linked an issue Mar 23, 2026 that may be closed by this pull request
@mschnecke mschnecke deleted the 16-open-whisper-support branch April 1, 2026 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Open Whisper Support

2 participants