Piper Speed and Voice Over Video #9220
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi, i am fascinated from this tool. I am experimenting with piper text2speech. I found some minor issues with the automatic speed adaption using ffmpg.
I made some adaptions so that your tool can be used as semiautometd workflow for translating video with a sythetic voice.
added 2 checkboxes (no translation at the moment)
Changes:
Adapt speed (ffmpeg):
here you can switch off the ffmpeg speed calculation. ffmpeg is not that good as piper can do. I also chenged the speed
adaption slower and also faster to a certain limit. 20% Max in both directions
2 pass speed correction (piper)
Since piper can user length_scale parameter for slower or faster speed by using the pauses in between the words the results are much better. So in the first pass the length is calulated and in the second pass the correction is made to the wav output.
use voice over
This creates a new voice over channel by decompressing the original channel when the voice channel is active. This gives an automatic voice over where music or anything in the background survices when the voice over is silent.
I have not changed language files or inputmasks at the moment. Maybe we cab do that together.
would be greatto get in contact
regards Chris