Skip to content

feat(stt): expose Qwen3-ASR token log probabilities - #985

Open
radraccoon wants to merge 1 commit into
Blaizzy:mainfrom
radraccoon:expose-qwen3-asr-logprobs
Open

radraccoon wants to merge 1 commit into
Blaizzy:mainfrom
radraccoon:expose-qwen3-asr-logprobs

Conversation

@radraccoon

Copy link
Copy Markdown

Summary

  • preserve each selected token log probability in Qwen3-ASR segments
  • expose avg_logprob and min_logprob summaries
  • cover both sequential and batched chunk decoding
  • document the new segment field and add focused tests

The model already computes these distributions and stream_generate() already yields them. The high-level path previously discarded them. This keeps the data available without changing decoded text or sampling behavior.

Closes #984.

Validation

  • focused metadata and sequential decode tests pass on Apple Silicon
  • black --check passes
  • git diff --check passes

@github-actions

github-actions Bot commented Oct 3, 2026

Copy link
Copy Markdown

⚠️ The pre-commit checks failed in CI.

Run the following from the repository root, then commit and push any changes:

python -m pip install pre-commit
pre-commit run --all-files

The project's pre-commit configuration includes Black and the other required formatters.

@lucasnewman

Copy link
Copy Markdown
Collaborator

@radraccoon Please run pre-commit run --all to clear the formatter.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Expose generated-token log probabilities in STT results

2 participants