Loading...
> >

Cooking show – face capture, motion capture, character morph, and lip sync

onesandwichshortonesandwichshort Posts: 19
in The Commons

So my wife is 7 months pregnant with our 4th child. This far along means that sleep is quite difficult for her and by extension me. Because of the sleep deprivation and impending deadline of not being able to work on projects at my leisure, I foolheartedly claimed that I could do a demonstration of 3D animation for the local filmmaker group that I am a member of – Nebraska Independent Film Projects (NIFP).

 

In my sleepless haze, I thought to myself wouldn’t it be fun to live stream this crazy idea as if it were a cooking show and have the audience choose the character the actor would morph into as the “secret ingredient”?  Why not!!? After all, I have 90 minutes of meeting time to fill!

 

I have managed to convince a few other deranged individuals to go along with this crazy plan and now we are going to live stream this on our NIFP Facebook page on Aug 15th 2019 starting at 6:30pm Central Time.

 

Please join us through our Facebook page https://www.facebook.com/nifp.org/ to see if it ends in triumph or tears! I for one am hoping for both!

 

  • Use FaceGen Artist Pro to create a 3D digital stunt double
  • Capture motions using a Kinect 2 and Brekel Pro Body v2
  • Convert .BVH file from Brekel Pro Body 2 to aniblock for Genesis 3 figure
  • Capture a sentence or two of dialogue
  • Apply lip sync to the animation using AniLip 2
  • Apply the chosen secret ingredient morph the character
  • Add an appropriate background to the scene
  • Decide what if any “extra” details (proper Iray lights, blinking and eye movement, and emotional expressions) can be added in the final minutes
  • Begin the render in Daz Studio to have a completed animation within 24 hours

Comments

  • James_HJames_H Posts: 1,096

    Sounds a great session, but way over my head. And by that time in the UK I will be tucked up in bed. I hope it goes well.

  • FSMCDesignsFSMCDesigns Posts: 12,851

    Sounds cool! So you animate in iray, isn't that painfull?(long render times)

    best of luck, I'll try and check it out.

  • benniewoodellbenniewoodell Posts: 2,000
    Will you be able to keep the video on Facebook afterwards? I'm in Beijing right now working on sound for my sitcom and I'm not coming back until after the 15th and Facebook is blocked by the great firewall and I'm not dealing with VPNs. I'm excited to see someone else's process for animation! Hopefully you can but if not good luck!
  • onesandwichshortonesandwichshort Posts: 19

    I plan on leaving it on the Facebook page and editing a shorter version afterward.  The location that is hosting us - https://turbineflats.org/ - got a SlingStudio a couple weeks ago that we will be using for the live stream. We should be able to live switch between four video sources, so hopefully there will be something interesting going on between those sources. None of us have tried it yet so ... hopefully the learning curve is not difficult!

  • Leonides02Leonides02 Posts: 1,379

    I'll be very interested in watching this once it's all edited down!

  • benniewoodellbenniewoodell Posts: 2,000
    Wonderful, I'm glad to hear I'll be able to watch it when I get back home!
  • ChadCryptoChadCrypto Posts: 596

    Sounds like a cool idea. I will check it out.

  • onesandwichshortonesandwichshort Posts: 19

    Well it was largely successful. There were a couple of snags that I had to just roll with so the output is a bit shorter and the motion capture on the hands is really jerky. But I am still pleased for getting it all done in 90 min.

  • onesandwichshortonesandwichshort Posts: 19

    Trying to see if I can add a direct link to the saved live video. https://www.facebook.com/nifp.org/videos/462633751237240/

Sign In or Register to comment.