I’m using Video Gen, I opened a ticket regarding dialogue, paid a lot of credits and got video where the character speaking said a completely different word than what was intended. I’m not happy about the generic answer I got on the ticket so maybe someone here has an answer.
In the video, one character says the other character’s name. Both characters are AI actors I created, so you already know the names themselves are prompts. I have two AI actors, two Image references, and 2 Audio references for their voices.
One character is supposed to speak the other character’s name, but he doesn’t. He says “Image 2” instead of the character’s name, Selvara. As you can see, it’s not even close, but the answer I got on the ticket was “due to limitations.” I want to know why a character would say a completely different word. I ca provide the prompts if necessary
Yes, I provided the character name in the prompt. Instead of speaking the character name, it said “Image 2” and Image 2 isn’t even the character that was spoken to. It highlighted the character name even…this is a screenshot of the part of the prompt where I have the character’s name.
I just removed the Image 2 reference from Seadance, and the character still said, “Image 2” instead of the actual character’s name. I may have to record the actual audio and use it explicitly I guess…
@frescalus There is likely some system prompt in the background that gets added to your prompt and you cannot see or change it. And the AI takes the words out of the system prompt and adds it to the video
Basically, this is how AI video generation works, you don’t have any fine control but can only generate another take again and again until it comes out as you like.
The AI slop videos on the Internet are full of characters who speak incorrect words, have incorrect voices or don’t even move their mouths. That’s likely because the videos are created more or less automatically and there is no quality control. As you see, the results are the same as yours.
If you already have other takes, where the name is spoken correctly, you can copy and paste the audio in a video editing software onto your video. Maybe it will work out.
I don’t have other takes. I only did 2 takes, and both did the same exact thing. The only word not spoken correctly is the character’s name, and that’s it. There’s only one occurrence of that name in the entire dialogue. So now, I’m 1600 credits down…guess it’s back to animating and rendering Houdini…
I save my AI characters not under their spoken name but under a name such as for example “Stella_AI”. That way, mentioning the name in the prompt does not result in a character reference as indicated by the high-lighted name (Selvara) in your prompt.
