[Released] Anilip 2 [Commercial]

DobitDobit Posts: 92

To celebrate Anilip's 1 year anniversary, we will be offering a brand new upgrade in the next few days.
So many new things have been added that we are upgrading to version 2.
There was a long todo list we worked on last year.
Here are just the most important innovations:

  1. Anilip 2 now supports many more voices.
    • "Speech Recognition" of voice recordings
    • "Text To Speech"
    • Cloud services (Transcribe and Polly from Amazon)
    • Generic JSON interface.
  2. A new viseme model allows a wide range of speech styles (from whispers to screams). Lip animators can now also implement emotional speech.
  3. Our new tabular lip animation tool makes it easy to translate even lengthly animations.
  4. The configuration of the lip animation was exposed for all figures in an XML file. Now also figures that are not offered by us can be adapted.
  5. We put a lot of work into documentation. 4 tutorial videos, 1 manual, inline help.

A first impression is here.

 

Post edited by Dobit on
«13

Comments

  • SorelSorel Posts: 1,228

    This looks to be useful. 

  • dkgoosedkgoose Posts: 1,393

    Oh nice, I will be wishlisting this, I was finally able to get the first one recently and haven’t had time to try it out or find the program for that matter but the new features sound awesome :)

  • whfieldwhfield Posts: 32

    Is this a windows only app or can it be used on the Mac platform?

  • DobitDobit Posts: 92
    whfield said:

    Is this a windows only app or can it be used on the Mac platform?

    This is a Windows only app.

  • peterbobpeterbob Posts: 7

    Why NOT for MAC OS ?

    Many Mac user like me will buy that imediately !

  • DobitDobit Posts: 92
    peterbob said:

    Why NOT for MAC OS ?

    Many Mac user like me will buy that imediately !

    At the moment we lack on MAC developers. But good to know the demand.

  • ImagoImago Posts: 2,505

    The integration of AWS Polly sounds interesting, but I can't find any clue about the generated audio files... Can the audio created with Polly in the plugin be used in commercial products?

  • DobitDobit Posts: 92
    Imago said:

    The integration of AWS Polly sounds interesting, but I can't find any clue about the generated audio files... Can the audio created with Polly in the plugin be used in commercial products?

    I am not a lawyer and you should read the AWS legal documents. But their use cases in the polly faqs mention commercial projects.

     

  • ImagoImago Posts: 2,505
    Dobit said:
    Imago said:

    The integration of AWS Polly sounds interesting, but I can't find any clue about the generated audio files... Can the audio created with Polly in the plugin be used in commercial products?

    I am not a lawyer and you should read the AWS legal documents. But their use cases in the polly faqs mention commercial projects.

     

    Yes, it is what I found too, pretty confusing to me. I asked you because I thought you could know better since you used their API.

    Thanks for the answer!

  • I bought this plugin and I'm having serious problems with it, I'm using the supplied test scene with no edits, and following the turorial video exactly, but the viseme animation only ever produces one single viseme "ç" regardless of what or how much text I enter. 

  • DobitDobit Posts: 92
    edited January 9

    I bought this plugin and I'm having serious problems with it, I'm using the supplied test scene with no edits, and following the turorial video exactly, but the viseme animation only ever produces one single viseme "ç" regardless of what or how much text I enter. 

    You try "Text to Speech" or "Speech Recognition"? Please check the log file for error messages. (Help/Troubleshooting/View Log File...). Send a screenshot of your "Settings/Text To Speech Settings" Tab (you can use the dobit support mail). 

    Post edited by Dobit on
  • DobitDobit Posts: 92
    Imago said:
    Dobit said:
    Imago said:

    The integration of AWS Polly sounds interesting, but I can't find any clue about the generated audio files... Can the audio created with Polly in the plugin be used in commercial products?

    I am not a lawyer and you should read the AWS legal documents. But their use cases in the polly faqs mention commercial projects.

     

    Yes, it is what I found too, pretty confusing to me. I asked you because I thought you could know better since you used their API.

    Thanks for the answer!

    We use Polly sound files commercially. The AWS Service Terms have not many restrictions for audio files. Here I found a short discussion about Polly files and copyright. 

  • xyer0xyer0 Posts: 2,815

    Is there a way to smooth transitions, that is, to create intermediate incremental keyframes between frames?

  • DobitDobit Posts: 92
    edited January 9
    xyer0 said:

    Is there a way to smooth transitions, that is, to create intermediate incremental keyframes between frames?

    Yes, that's how it works. The transition between the individual phases of a viseme (keyframes start, apex, end) is generated automatically and smoothly. If you want to configure it, you can change the parameters of the TCB splines. As part of the delivery, we have a video explaining the Viseme model. There will also be discussed on the generation of key frames. More smoothing can be achieved by increasing the visemes ascent and or descent time and shorten the apex time. (I hope I understood your question ).

    Post edited by Dobit on
  • jash147jash147 Posts: 467
    Dobit said:

    I bought this plugin and I'm having serious problems with it, I'm using the supplied test scene with no edits, and following the turorial video exactly, but the viseme animation only ever produces one single viseme "ç" regardless of what or how much text I enter. 

    You try "Text to Speech" or "Speech Recognition"? Please check the log file for error messages. (Help/Troubleshooting/View Log File...). Send a screenshot of your "Settings/Text To Speech Settings" Tab (you can use the dobit support mail). 

    OK, I'm getting this.

     

    Log file:

    2019-01-09 21:19:02.015 WARNING: libpng warning: iCCP: known incorrect sRGB profile
    2019-01-09 21:21:07.246 DEBUG: Anilip 2: Phoneme with ID '4' unknown
    2019-01-09 21:21:07.246 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.359 DEBUG: Anilip 2: Phoneme with ID '104' unknown
    2019-01-09 21:21:07.359 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.509 DEBUG: Anilip 2: Phoneme with ID '601' unknown
    2019-01-09 21:21:07.509 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.569 DEBUG: Anilip 2: Phoneme with ID '108' unknown
    2019-01-09 21:21:07.569 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.659 DEBUG: Anilip 2: Phoneme with ID '111' unknown
    2019-01-09 21:21:07.659 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.719 DEBUG: Anilip 2: Phoneme with ID '865' unknown
    2019-01-09 21:21:07.729 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.809 DEBUG: Anilip 2: Phoneme with ID '650' unknown
    2019-01-09 21:21:07.809 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.869 DEBUG: Anilip 2: Phoneme with ID '4' unknown
    2019-01-09 21:21:07.869 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:23.987 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0
    2019-01-09 21:24:23.166 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0
    2019-01-09 21:27:40.820 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0

     

    I've attached settings.

    settings.JPG
    539 x 320 - 31K
  • DobitDobit Posts: 92
    jash147 said:
    Dobit said:

    I bought this plugin and I'm having serious problems with it, I'm using the supplied test scene with no edits, and following the turorial video exactly, but the viseme animation only ever produces one single viseme "ç" regardless of what or how much text I enter. 

    You try "Text to Speech" or "Speech Recognition"? Please check the log file for error messages. (Help/Troubleshooting/View Log File...). Send a screenshot of your "Settings/Text To Speech Settings" Tab (you can use the dobit support mail). 

    OK, I'm getting this.

     

    Log file:

    2019-01-09 21:19:02.015 WARNING: libpng warning: iCCP: known incorrect sRGB profile
    2019-01-09 21:21:07.246 DEBUG: Anilip 2: Phoneme with ID '4' unknown
    2019-01-09 21:21:07.246 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.359 DEBUG: Anilip 2: Phoneme with ID '104' unknown
    2019-01-09 21:21:07.359 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.509 DEBUG: Anilip 2: Phoneme with ID '601' unknown
    2019-01-09 21:21:07.509 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.569 DEBUG: Anilip 2: Phoneme with ID '108' unknown
    2019-01-09 21:21:07.569 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.659 DEBUG: Anilip 2: Phoneme with ID '111' unknown
    2019-01-09 21:21:07.659 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.719 DEBUG: Anilip 2: Phoneme with ID '865' unknown
    2019-01-09 21:21:07.729 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.809 DEBUG: Anilip 2: Phoneme with ID '650' unknown
    2019-01-09 21:21:07.809 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:07.869 DEBUG: Anilip 2: Phoneme with ID '4' unknown
    2019-01-09 21:21:07.869 DEBUG: Anilip 2: No viseme class found for phoneme ''
    2019-01-09 21:21:23.987 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0
    2019-01-09 21:24:23.166 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0
    2019-01-09 21:27:40.820 WARNING: cloud\dzcloudtasknotifier.cpp(178): peer performed orderly shutdown errno=0

     

    I've attached settings.

    There is a problem with the UK Locale. Anilip 2 uses the wrong phoneme set for this. We are currently working on a solution and will provide an update in the next few days.

  • jash147jash147 Posts: 467

    Thanks for the quick response. So if I switch to US English, should be different? I will try. Any other changes? Or is this more at a system level on the PC?

  • DobitDobit Posts: 92
    edited January 10
    jash147 said:

    Thanks for the quick response. So if I switch to US English, should be different? I will try. Any other changes? Or is this more at a system level on the PC?

    An intermediate solution is to switch to a US English voice. The manual gives some advice how to add a new language in the windows settings. There are phoneme/viseme differences between US and UK. I attached an example for "Hello World".

    UKLocale.png
    1225 x 1142 - 594K
    USLocale.png
    1237 x 1235 - 664K
    Post edited by Dobit on
  • RedzRedz Posts: 1,372
    Dobit said:
    jash147 said:

    Thanks for the quick response. So if I switch to US English, should be different? I will try. Any other changes? Or is this more at a system level on the PC?

    An intermediate solution is to switch to a US English voice. The manual gives some advice how to add a new language in the windows settings. There are phoneme/viseme differences between US and UK. I attached an example for "Hello World".

    I am also having this issue attempting to use UK voices. US voices are working for TTS.  Hoping for an update soon, thanks. 

  • jash147jash147 Posts: 467

    OK, will try. It may or may not be relevant that Daz crashed last night at some point after trying to use Anilip, so I'll watch out for that as well. I thought Windows had updated but I don't think that was what happened.

  • jash147jash147 Posts: 467

    On further investigation a reboot.

  • DobitDobit Posts: 92

    We have made new Anilip 2 binaries to fix the UK Locale issue. This is an unofficial version, which we send to users upon request. Please send an e-mail to Dobit support and we will send you information for download. We will also release a new version via Daz, but this will take some time, because we collect user feedback first.

  • RedzRedz Posts: 1,372
    Dobit said:

    We have made new Anilip 2 binaries to fix the UK Locale issue. This is an unofficial version, which we send to users upon request. Please send an e-mail to Dobit support and we will send you information for download. We will also release a new version via Daz, but this will take some time, because we collect user feedback first.

    Thank you! UK voices now appear to be working with the fix. 

  • Well, heck... I think this is what I've been looking for. I didn't even know Anilip 1 was a thing. It's gone now, in favor of 2 right?

     

    This doesn't animate anything but the mouth, right? You do the rest of the face, the neck and hear, eyes and so on, to sync right?  And are there controls to exaggerate the phonemes more or less?  For instance, in the Crispin's Day speech, there are parts where much more exaggerated mouth movements would (in my opinion) work better...

    I think what I'll do is use text to speech to do the animation, then sync voice to that, as the voice actors watch the animation - that sound right?

  • DobitDobit Posts: 92

    Well, heck... I think this is what I've been looking for. I didn't even know Anilip 1 was a thing. It's gone now, in favor of 2 right?

     

    This doesn't animate anything but the mouth, right? You do the rest of the face, the neck and hear, eyes and so on, to sync right?  And are there controls to exaggerate the phonemes more or less?  For instance, in the Crispin's Day speech, there are parts where much more exaggerated mouth movements would (in my opinion) work better...

    I think what I'll do is use text to speech to do the animation, then sync voice to that, as the voice actors watch the animation - that sound right?

    Yes, Anilip 2 Is the replacement of Anilip.

    Anilip 2 specializes in visemes. It animates the mouth and the jaw. In the promo video we used Animate 2 to sync with all the other animation parts you menttioned.

    The biggest difference to the previous version is the viseme model. This allows selected visemes to be emphasised or weakened (Even extremes like screaming or whispering are possible)

    The voice of Henry V was first recorded by a professional speaker and then animated. We used Amazon Transcribe for speech recognition.  But your workflow sounds Ok as well.

     

  • tomhbwctomhbwc Posts: 22

    Dobit, is Anilip 2, by any chance, going to be on sale this month (50% off or something like that)? I'd like to get this to use for a Daz-animated music video I'm making for a musician friend of mine on my Shadow Cloud PC (which I'm subscribed to until the 28th), but the current price of Anilip 2 is too far above what I can afford.

  • DobitDobit Posts: 92
    tomhbwc said:

    Dobit, is Anilip 2, by any chance, going to be on sale this month (50% off or something like that)? I'd like to get this to use for a Daz-animated music video I'm making for a musician friend of mine on my Shadow Cloud PC (which I'm subscribed to until the 28th), but the current price of Anilip 2 is too far above what I can afford.

    Unfortunately, we can not predict that because Daz Marketing plans these discount promotions. But a discount of 50% is unlikely.

  • tomhbwctomhbwc Posts: 22
    Dobit said:
    tomhbwc said:

    Dobit, is Anilip 2, by any chance, going to be on sale this month (50% off or something like that)? I'd like to get this to use for a Daz-animated music video I'm making for a musician friend of mine on my Shadow Cloud PC (which I'm subscribed to until the 28th), but the current price of Anilip 2 is too far above what I can afford.

    Unfortunately, we can not predict that because Daz Marketing plans these discount promotions. But a discount of 50% is unlikely.

    Nuts... Well, thank you for your answer. Just out of curiosity, do you have any advice on how to get the best results out of DAZ Studio's built-in lip sync plugin? I don't know if you have experience with the lip sync plugin, but since you made Anilip 2, I'm assuming you've used it in the past. I have had mixed results with it (some parts look believable, some don't... in the same animation sequence no less). Thank you again.

  • DobitDobit Posts: 92
    tomhbwc said:
    Dobit said:
    tomhbwc said:

    Dobit, is Anilip 2, by any chance, going to be on sale this month (50% off or something like that)? I'd like to get this to use for a Daz-animated music video I'm making for a musician friend of mine on my Shadow Cloud PC (which I'm subscribed to until the 28th), but the current price of Anilip 2 is too far above what I can afford.

    Unfortunately, we can not predict that because Daz Marketing plans these discount promotions. But a discount of 50% is unlikely.

    Nuts... Well, thank you for your answer. Just out of curiosity, do you have any advice on how to get the best results out of DAZ Studio's built-in lip sync plugin? I don't know if you have experience with the lip sync plugin, but since you made Anilip 2, I'm assuming you've used it in the past. I have had mixed results with it (some parts look believable, some don't... in the same animation sequence no less). Thank you again.

    Daz Studio does not have a built-in LipSync module.You say that you want to make a music video. If your character is to sing to music, it may be possible to animate the viseme "by hand". That works, if not too much text is to be set. The "Parameter" pane lists all visemes of your Genesis 8 or Genesis 3 figure in the path "Pose Controls / Head / Visemes". If you spread the viseme over the timeline, you can implement a simple lip animation.

  • tomhbwctomhbwc Posts: 22

    Thank you for the advice, but I found a (free) solution using papayago lip sync software and a daz studio script.

Sign In or Register to comment.