Looking for Recommendations for a Daz lip sync plugin

Hi everyone, am working on my first short film and am looking for recommendations for a good lip sync plugin. Am working with Genesis 9 and Genesis 8 characters. Any wisdom will be greatly appreciated

Comments

  • wsterdanwsterdan Posts: 3,054
    edited June 16

    My two favourite free options:

    If you have access to a computer that can run the 32-bit version of DAZ Studio, the built-in lip sync is my personal favourite, it not only does a great job on the mouth and lips, it also adds slight movement to the head and for most models adds eye blinks. The Genesis 8 mimic .dmc file will handle Genesis 3 and Genesis 8 while the Genesis 8.1 will handle Genesis 8.1 and Genesis 9, but doesn't handle automatic eye blinks, you'll have to do those yourself. It took me 90 minutes to lip synch about 5 minutes of speech audio this way.

    Here's a quick test I did using the Willow 9 character: 

    https://sterdan.com/wp-content/uploads/2025/04/TOS-Willow-Tactical-C-U.mp4

    My workflow is to use the 32-bit DAZ Studio to do all the automatic part of the  lip sync at once by doing the lip sync and saving a pose preset of just the neck and head body parts; once I have all of my pose presets ready to go, I return to the 64-bit DAZ Studio and apply the lip sync poses as needed and combining them with the rest of the scene's animation. You can have a character walking, for example, and add the lip sync preset over top of the other animation.

    ​For eye blinks for Genesis 9, you can manually do a number of eye blinks over the course of a minute, for example, and save your "eye blinks" pose preset. This preset can be applied to multiple characters in a scene at different starting points (so they don't all blink at the same time) to being a little "life" to a multi-character scene fairly quickly. 

    If you don't have access to a 32-bit computer, you can use Papagayo to help:

    https://lostmarble.com/papagayo/

    You load the audio and speech text and it generates a .dat file that you can open in a text editor and use to manually keyframe your lip synch. The .dat file lists the key frames and which viseme to apply and looks like this:

    MohoSwitch1
    -1 MBP
    1 AI
    3 rest
    5 rest
    4 etc
    6 E
    9 MBP
    11 AI
    14 etc
    18 E
    21 L
    23 etc
    26 AI
    28 

    I hope that helps.

    Post edited by wsterdan on
  • wolf359wolf359 Posts: 3,929
    edited June 16

    You just missed a sale on this one .
    https://www.daz3d.com/anilip3

    Post edited by wolf359 on
  • wsterdanwsterdan Posts: 3,054

    wolf359 said:

    You just missed a sale on this one .
    https://www.daz3d.com/anilip3

    I didn't stop to consider Windows-only options, that looks pretty sweet! I guess he'd need this as well to cover Genesis 8?

    https://www.daz3d.com/anilip3-figures-pack

  • wolf359wolf359 Posts: 3,929

    Hi Walt, I am not sure what those figure packs are TBH, but I have the older Anilip2 "basic" and it works great 
    with G8/8.1 and a few of the newer animals such as the big cat.  

  • Dark45Dark45 Posts: 94
    edited June 23
    Face Motion 3D The most expensive option I believe but if you want it to look decent, this imo is the only real option. It's made it's money back for us. If you are looking for simply good enough, all the options people have mentioned here are viable
    Post edited by Dark45 on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,039
    edited June 23

    another postwork option is FaceFusion an Ai solution that has a Lipsync option that can be used for free with ComfyUI, Pinokio or if you are a clever person, a local python environment or Google Collab

    or the paid options linked on this GitHub page

    https://github.com/facefusion/facefusion

    I use it for free in Pinokio

    https://www.pinokio.co/

     

    Post edited by WendyLuvsCatz on
  • superlativecgsuperlativecg Posts: 147
    edited June 23

    I believe FaceFusion uses the Wav2Lip AI model.  I've had some pretty good results with it.  Pretty good for a free tool.

    Post edited by superlativecg on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,039
    edited June 23

    superlativecg said:

    I believe FaceFusion uses the Wav2Lip AI model.  I've had some pretty good results with it.  Pretty good for a free tool.

    yes, indeed it does

    I see Microsoft even has a $5 paid self contained app for it

    Post edited by WendyLuvsCatz on
Sign In or Register to comment.