Im having an issue when I export visemes from cc4 to Blender 4.2/4.3. Animations, expressions as well as blendshapes/extended blendshapes all export without issue. However, lipsync visemes are distorted. EE, Er, IH, Ah, Oh, W_OO, S_Z, Ch_J, F_V… all of the visemes have an issue where they are not fully pronounced. The mouth, jaw does not fully open nor do the teeth open when needed. The result is a lipsynced character that mumbles instead of speaks. Even in blender, for some odd reason, when I try to create a mix from two blendshapes to correct this issue, only the original blendshape/viseme is created rather than a mix of the two. I am being forced to create my own visemes from expressions and edit facial controls. But, I have not been able to fully test the results.The character is being exported from blender to React Three Fiber. The result is less than optimal. Any assistance would be greatly appreciated.
BTW, Reallusion support responded to this issue with the following:
The jaw, eyes, and tongue are controlled by bone rotation. If you need them to be mesh morphs, then check the “Convert Skinned Expressions to Morphs” box in the export settings.
@Victor.Soupday Thanks for the quick reply. I took your advice and updated the import settings. Though it seems counterintuitive to remove the Shape Key Jaw Bone and Eye Bones drivers.
The result did not resolve the issue as displayed in the screenshot I have provided below. I have set the Oh shape key to 1. As you can see, the result is a puckered lip without jaw opening. I am using the Character Creator CC4 standard model named Kevin with extended 140+ expressions blendshapes and 1:1 Visemes mapping. My current version of Blender is 4.2.10 LTS. The results are the same with Blender 4.3 as well.
I’ve tried each possible variation of importing with the Drivers options. They all produce similar results. None allow for complete control of the Jaw. The closest acceptable result is including Shape Keys Driver Jaw Bone and Shape Keys Drive Eye Bones during import. With these settings, both Ah and Oh successfully open the jaw; however, none of the other shape keys have such success.
It’s a pretty odd issue to say the least. Any support and/or suggestions would be greatly appreciated.
Sorry for off-top, can you also change the default light scheme to “Default” in the next release.
Current one after pipeline is way too cinematic. I keep switching after every import…
Brilliant! I can confirm the latest update does fix the 1:1 Visemes issue when exporting models from Character Creator 4 to Blender 4.2 LTS and above using the Blender Pipeline Plugin. Thank you.
On a side note, one work around I was exploring that did produce favorable results was to send the model to iClone 8 and then export it to Blender. Though, that would require you to own iClone 8. It would also negate the great plugin that is the Blender Pipeline Plugin. Again, thanks for you swift solution to this acute issue.
