Reallusion Products Supporting Real-Time Lip Sync for CC5 Characters in Unity?

Pipeline Unity
1

Hi everyone,

I’m building an interactive AI avatar system in Unity using a Character Creator 5 (CC5) character exported via CC AutoSetup for Unity.

The pipeline I’m targeting is:

LLM generates text → TTS converts to audio → Unity plays audio in real-time → CC5 character performs lip sync

The TTS audio is generated dynamically at runtime (not pre-baked), so I need a real-time runtime lip sync solution that works with CC5 rigs inside Unity.

My questions:

  1. Does Reallusion offer any native Unity runtime lip sync SDK or plugin** for CC5 characters? I couldn’t find one in the store, but wanted to confirm.
  2. Is AccuLips usable at Unity runtime, or is it strictly an iClone authoring-time tool?
  3. What is the officially recommended approach for real-time lip sync with CC5 characters in Unity when the audio source is dynamic (e.g., streamed TTS)?
  4. Has anyone successfully integrated SALSA LipSync Suite (CrazyMinnow) or a similar third-party plugin with a CC5 character rig in Unity? Any tips on blend shape mapping or setup?

Any guidance or product recommendations from the Reallusion team or community would be greatly appreciated!

Thanks in advance.

1 Like
2

Hi luisfynn, just wondering did u find a lipsync solution for CC5? I thought I seen recently somewhere that Salsa could do it but I’ve just checked their website and there was no mention of it, only CC3/4.

3

Salsa should be rig-agnostic so I can’t imagine it won’t work with CC5 characters. Maybe their 1 click setup solution won’t work out of the box so it might be more work to initially set it up. As a disclaimer, I currently work with Salsa and CC4 characters.

4

The visemes in CC5 are the same as CC4, so anything that works with CC4 characters should work with CC5.

One point to note: most lip sync solutions in Unity work best with the direct visemes (Ah, EE, Ih, Oh, etc…), but CC4/5 characters default to viseme pairs. You may want to ensure your characters are using the direct visemes by switching to them in the facial profile editor.