Fclone: Facial Motion Capture for animation ??

wolf359wolf359 Posts: 3,931

Hi,
I am curious if any has tried this 
I downloaded the trial, but it does not seem to recognize My web Cam.

http://f-clone.com/

«1

Comments

  • jaebeajaebea Posts: 456

    I will be trying it too.  Which webcam are you using?

  • nonesuch00nonesuch00 Posts: 18,723
    edited June 2017

    I will try it and let you know if it works for me.

    I thought that Blender had such a similar addon that was free but if you are trying this product I guess I was wrong about that. 

    Post edited by nonesuch00 on
  • wolf359wolf359 Posts: 3,931
    edited June 2017

    @Jabea,I am using the one built in to my gateway laptop.

     

    @nonesuch00 Blender Does have Motion tracking that will track face markers and retarget the data to a **Blender** Face bone rig

    However this Fclone claims to export DAZ/Poser Pz3 files, just as the older mimic pro does.

    Post edited by wolf359 on
  • JasonSWrenchJasonSWrench Posts: 386

    I downloaded it and played with it. It could capture my head movement, but nothing else. This could be a limitation of the free trial, but I don't know. Their is practically zero documentation available. I've reached out to them via Facebook and e-mail and have yet to hear anything back from them. I think it's a good idea, but not impressed with the company this far.

    J

  • nonesuch00nonesuch00 Posts: 18,723

    Thanks @wolf359. OK, I will try it sometime today or tomrrow. 

  • nonesuch00nonesuch00 Posts: 18,723

    @Wolf359 - OK, I tested and it detected my built-in webcam (which I tested in Skype to make sure it works since I've not used it before) but when it goes to actually film me so it can calibrate its SW it should it is running but the video outpout screen remains blank and when I log in there log there is a Unity log error stating the input received was not in the correct format.

    For me I think this is a poorly tested port of opensource that isn't nowhere ready to be sold to consumers let alone at the the price point they are asking for it. 

  • wolf359wolf359 Posts: 3,931
    edited June 2017

    " OK, I tested and it detected my built-in webcam (which I tested in Skype to make sure it works since I've not used it before) but when it goes to actually film me so it can calibrate its SW it should it is running but the video outpout screen remains blank and when I log in there log there is a Unity log error stating the input received was not in the correct format.
    For me I think this is a poorly tested port of opensource that isn't nowhere ready to be sold to consumers let alone at the the price point they are asking for it." 

    I suspected as much..indecision
    and they  are actually are trying to implement
    an Adobe style monthy rental model...frown

    oh well...  just thought looked interesting at the outset.

     

    Thanks guys.

    Post edited by wolf359 on
  • Kevin SandersonKevin Sanderson Posts: 1,643
    edited June 2017

    Here's their new video on YouTube that shows how it works. Wish they had more specifics on the webcams that work.

     

    Post edited by Kevin Sanderson on
  • nonesuch00nonesuch00 Posts: 18,723

    Well if you tried & failed that makes it 0 for 4. I have a built-in Webcam to one of the most commonly used brands of PC s in the world. Although I think in my case failure to access the camera by their Windows Unity App is because they didn't test on Windows 10 so they don't know security on Windows 10 has been raised as a first guess. I have a list of apps allowed to use the camera and that app made no attempt to register for that permission and so it won't have it.

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,063

    I first saw this on the Reallusion forum and asked about it here in another thread, none of them had much luck with it either so I have yet to see any successful attempts to use it.

    I will just sit back and wait until someone makes something actually useable I can afford.

  • It recognized two different webcams in my case - however, all that the animation responds to is the head rotation. Video looks like it should be working fully in demo mode but it does not. No listing of demo features anywhere either.

     

    A shame, really, something like this might be quite a useful tool if it works. I've looked at a few Blender demos for facial motion capture but that workflow seems to be extremely time consuming..

  • Kevin SandersonKevin Sanderson Posts: 1,643
    edited June 2017

    Hmmm... video shows an activation process before recording mocap data. I have not tried the program yet. I was going to use a camcorder for a webcam for better lens quality (less visual distortion), but I don't have information that it's possible.

    Post edited by Kevin Sanderson on
  • CybersoxCybersox Posts: 9,272

    Maybe this is a dumb question, but what figures are people testing this with?  Genesis 1-3 facial expressions are primarily done with morphs rather than bone, so maybe this was designed to work with the older V4 or Poser figures?     

  • wolf359wolf359 Posts: 3,931
    edited June 2017

    "Maybe this is a dumb question, but what figures are people testing this with?  Genesis 1-3 facial expressions are primarily done with morphs rather than bone, so maybe this was designed to work with the older V4 or Poser figures?     

    "

    From the site page:

    "With this software, users can create not just games but personal avatars, such as a virtual character to be the presenter in a YouTube video. This means the software can be applied to personal creation and indie animation as well.
    f-clone is able to export motion data that is fully compatible with the DAZ Studio, it is widely usable by the many individuals and hobby users who use DAZ Studio."

    No mention of poser and the Black guy character in the video is clearly one of the recent  G3 male Characters 
    (Name escapes me ATM).

     

    edited to add:  I just hit 1000 posts!!!
    is there a prize??... a HD morping Cookie perhaps ??laugh

    Post edited by wolf359 on
  • nonesuch00nonesuch00 Posts: 18,723
    wolf359 said:

    "Maybe this is a dumb question, but what figures are people testing this with?  Genesis 1-3 facial expressions are primarily done with morphs rather than bone, so maybe this was designed to work with the older V4 or Poser figures?     

    "

    From the site page:

    "With this software, users can create not just games but personal avatars, such as a virtual character to be the presenter in a YouTube video. This means the software can be applied to personal creation and indie animation as well.
    f-clone is able to export motion data that is fully compatible with the DAZ Studio, it is widely usable by the many individuals and hobby users who use DAZ Studio."

    No mention of poser and the Black guy character in the video is clearly one of the recent  G3 male Characters 
    (Name escapes me ATM).

    You should inquire with Morph 3D and ask them if they are going to add such a feature to their Personal Avatar / Avatar system they are building. After all, personal avatars are not very personal if they don't allow for including people's uniquely peculiar facial expressions.

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,063
    wolf359 said:

    "Maybe this is a dumb question, but what figures are people testing this with?  Genesis 1-3 facial expressions are primarily done with morphs rather than bone, so maybe this was designed to work with the older V4 or Poser figures?     

    "

    From the site page:

    "With this software, users can create not just games but personal avatars, such as a virtual character to be the presenter in a YouTube video. This means the software can be applied to personal creation and indie animation as well.
    f-clone is able to export motion data that is fully compatible with the DAZ Studio, it is widely usable by the many individuals and hobby users who use DAZ Studio."

    No mention of poser and the Black guy character in the video is clearly one of the recent  G3 male Characters 
    (Name escapes me ATM).

     

    edited to add:  I just hit 1000 posts!!!
    is there a prize??... a HD morping Cookie perhaps ??laugh

    the old forum gave us titles at post benchmarks culminating in addict

  • JasonSWrenchJasonSWrench Posts: 386

    OK, so I did finally get it to work. I also received an e-mail from the creator after a few days. 

    If you're having the problem I had (only recognizing head rotation), try closing out and restarting. Believe it or not, that actually fixed it a few times. I was able to get it to export into DAZ studio. It's not perfect, but it definitely can work. I think this is a good idea, but it's not really ready for prime-time yet.

    J

  • Kevin SandersonKevin Sanderson Posts: 1,643
    edited June 2017

    He has a new version up with bug fixes and has lowered the price.

    Post edited by Kevin Sanderson on
  • jaebeajaebea Posts: 456

    I haven't been able to get it to work either...only head movement.  I have been bugging the guy on FB and YouTube about getting help but is is just unwilling to respond.  I have let him know that there are quite a number of people on the Daz interested but haven't been able to get it to work either.  I told him, "Dang, I WANT to buy your product  so you would think you would be a little more willing to help a potential customer!"

  • Kevin SandersonKevin Sanderson Posts: 1,643

    Another new version on their site, and a version for Maya, too. Maybe that will work jaebea. I still don't have a webcam and am hoping I can get a camcorder to work.

  • wolf359wolf359 Posts: 3,931

    Alas Since this does not recognize my built-in web cam 
    I shall stick with mimic live+ manually added expression/aniblocks
    for my facial animation.

     

  • I purchased the personal version of the product. I attempted to capture facial motions with a webcam and a Windows Kinect  V2.  I have a Intel I7 -7700k 64 Bit Windows 10 Pro PC with 64 GB of ram. I calibrated with the Kinect and webcam and "recorded"  at least 30 motion captures. None of the captures created motion files. I ran the program as an administrator, started and restarted it many times.. nothing worked. I emailed the company three times and have not received any guidance or offers for a refund.  Unless I am overlooking something in it's use.. I consider this company as a scam business and I am grateful I only lost $58. 

  • I also purchased for personal use. With Kinect it will save video but no audio. With webcam, I can save video and audio. But audio is out of sync when dropped into Daz. Will not save calibration presets. I have tried to contact developer, get no answer. Am not willing to devote any time to tweeking, until developer gets back to me with soloutions. In the mean time I am search for an other solution to face capture for use in Daz Studio. 

  • SorelSorel Posts: 1,412

    Hopefully daz is/will be making better animation tools in the future.

  • nonesuch00nonesuch00 Posts: 18,723

    In Unity I looked today & there is a facial animation asset regular $35 onsale for $17.50. It is called LipSyncPro by Rogo Digital. I doubt thought that it is substantially better or better at all than any of the other solutions complained about in the DAZ forums - it's key point is a price more in line with reality given the lack of performance. Mimic Live is free though. There is also a LipSync Lite by RoGo Digital that is free so you can try & buy.

  • wolf359wolf359 Posts: 3,931

    " Mimic Live is free though."

     

     

    No Daz mimic live is not free.

    the basic mimic plugin , only available in the 32 bit version of DS, is Free

  • nonesuch00nonesuch00 Posts: 18,723
    wolf359 said:

    " Mimic Live is free though."

     

     

    No Daz mimic live is not free.

    the basic mimic plugin , only available in the 32 bit version of DS, is Free

    Oh, thanks for that.

  • WonderlandWonderland Posts: 7,133
    wolf359 said:

    " Mimic Live is free though."

     

     

    No Daz mimic live is not free.

    the basic mimic plugin , only available in the 32 bit version of DS, is Free

    What is the basic Mimic? What can you do with it compared to Mimic Live?

  • wolf359wolf359 Posts: 3,931

    Having to boot up a 32 bit version to do so,
    The basic mimic plug  lets you load pre-recorded audio
    and make Chracters speak it.

    Mimic live lets you speak into your computer microphone and the
    figure will speak what are saying "live"and record it as an animation
    but does not load pre recorded audio tracks
    unless you use my trick
    described here:

    https://www.daz3d.com/forums/discussion/115371/for-my-fellow-animators-using-mimic-live#latest

  • Here is an update on the resolution to my problems with F-Clone, not inherently the programs, but info that should be included when you purchase.

    My problem were and the solution were;

    Problem

    Could not record Kinect audio,  

    Solution

    Right click on audio icon in Windows tool bar, select record devices, enable all the recording devices you plan to use, in this case, Kinect NUI Audio and Webcam audio.

    Problem

    Could not save Webcam or Kinect Presets

    Solution

    Right click on F Clone application and run as Administrator

    Have to do extensive testing, and will do an update.

Sign In or Register to comment.