feat: bilingual barge-in + Gemini/CV AI interviewee, Cloud-TTS Hebrew, style-based characters; add demo#1
Merged
Conversation
…, style-based characters; add demo - Bilingual voice: English via browser speechSynthesis, Hebrew via Google Cloud TTS (he-IL, gendered, project ADC — no API key) - Barge-in: interrupt the interviewer mid-sentence with an echo guard so the recognizer never picks up the interviewer's own audio - AI interviewee (backend/app/sim/): a simulated candidate that hears via local STT (faster-whisper) and answers with Gemini conditioned on a CV; structural "no backdoor" (receives audio only, never the source text) - Style-based interviewer characters, always gender-consistent with the style's voice; keeps this repo's own licensed faces + manifest - Add EN/HE demo media (GIF/PNG/MP4) and embed the demo GIF in the README Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
speechSynthesis; Hebrew is real, gendered audio via Google Cloud TTS (he-IL, project ADC, no API key).backend/app/sim/). A simulated candidate that hears via local STT (faster-whisper) and answers with Gemini conditioned on a CV, with a structural no-backdoor guarantee (audio only, never source text).manifest.json(unchanged); the STYLE_CHARACTER ids already match this repo's manifest, with a gender-matched fallback for any unknown id.docs/demo/and embeds the demo GIF in the README.Licensing
No character image or manifest bytes were changed; the repo's existing licensed interviewer faces are preserved. The demo GIFs show a crop of the already-committed
data-scientist-0.jpgcharacter, so no new or unlicensed assets are introduced.Verification
tsc --noEmit: passes (exit 0)characters/voice/barge_in: 20 tests passGenerated with Claude Code