ClipTranslator

Dubb and lip-sync videos from any language to any language using ElevenLabs and VideoRetalking (Wav2Lip sequel).

Demo

Sample English --> French

betterhelpgirl-english.MOV

betterhelpgirl-lipped.MOV

Task list

• Revert back to Wav2Lip model
• Add 11labs dubbing api to pipeline
• Build simple web interface for demo
• Multiple speaker model pipeline

Credits

• ElevenLabs
• VideoRetalking