Fclone: Facial Motion Capture for animation ??
wolf359
Posts: 3,931
in The Commons
Hi,
I am curious if any has tried this
I downloaded the trial, but it does not seem to recognize My web Cam.

Comments
I will be trying it too. Which webcam are you using?
I will try it and let you know if it works for me.
I thought that Blender had such a similar addon that was free but if you are trying this product I guess I was wrong about that.
@Jabea,I am using the one built in to my gateway laptop.
@nonesuch00 Blender Does have Motion tracking that will track face markers and retarget the data to a **Blender** Face bone rig
However this Fclone claims to export DAZ/Poser Pz3 files, just as the older mimic pro does.
I downloaded it and played with it. It could capture my head movement, but nothing else. This could be a limitation of the free trial, but I don't know. Their is practically zero documentation available. I've reached out to them via Facebook and e-mail and have yet to hear anything back from them. I think it's a good idea, but not impressed with the company this far.
J
Thanks @wolf359. OK, I will try it sometime today or tomrrow.
@Wolf359 - OK, I tested and it detected my built-in webcam (which I tested in Skype to make sure it works since I've not used it before) but when it goes to actually film me so it can calibrate its SW it should it is running but the video outpout screen remains blank and when I log in there log there is a Unity log error stating the input received was not in the correct format.
For me I think this is a poorly tested port of opensource that isn't nowhere ready to be sold to consumers let alone at the the price point they are asking for it.
I suspected as much..

and they are actually are trying to implement
an Adobe style monthy rental model...
oh well... just thought looked interesting at the outset.
Thanks guys.
Here's their new video on YouTube that shows how it works. Wish they had more specifics on the webcams that work.
Well if you tried & failed that makes it 0 for 4. I have a built-in Webcam to one of the most commonly used brands of PC s in the world. Although I think in my case failure to access the camera by their Windows Unity App is because they didn't test on Windows 10 so they don't know security on Windows 10 has been raised as a first guess. I have a list of apps allowed to use the camera and that app made no attempt to register for that permission and so it won't have it.
I first saw this on the Reallusion forum and asked about it here in another thread, none of them had much luck with it either so I have yet to see any successful attempts to use it.
I will just sit back and wait until someone makes something actually useable I can afford.
It recognized two different webcams in my case - however, all that the animation responds to is the head rotation. Video looks like it should be working fully in demo mode but it does not. No listing of demo features anywhere either.
A shame, really, something like this might be quite a useful tool if it works. I've looked at a few Blender demos for facial motion capture but that workflow seems to be extremely time consuming..
Hmmm... video shows an activation process before recording mocap data. I have not tried the program yet. I was going to use a camcorder for a webcam for better lens quality (less visual distortion), but I don't have information that it's possible.
Maybe this is a dumb question, but what figures are people testing this with? Genesis 1-3 facial expressions are primarily done with morphs rather than bone, so maybe this was designed to work with the older V4 or Poser figures?
"
From the site page:
"With this software, users can create not just games but personal avatars, such as a virtual character to be the presenter in a YouTube video. This means the software can be applied to personal creation and indie animation as well.
f-clone is able to export motion data that is fully compatible with the DAZ Studio, it is widely usable by the many individuals and hobby users who use DAZ Studio."
No mention of poser and the Black guy character in the video is clearly one of the recent G3 male Characters
(Name escapes me ATM).
edited to add: I just hit 1000 posts!!!
is there a prize??... a HD morping Cookie perhaps ??
You should inquire with Morph 3D and ask them if they are going to add such a feature to their Personal Avatar / Avatar system they are building. After all, personal avatars are not very personal if they don't allow for including people's uniquely peculiar facial expressions.
the old forum gave us titles at post benchmarks culminating in addict
OK, so I did finally get it to work. I also received an e-mail from the creator after a few days.
If you're having the problem I had (only recognizing head rotation), try closing out and restarting. Believe it or not, that actually fixed it a few times. I was able to get it to export into DAZ studio. It's not perfect, but it definitely can work. I think this is a good idea, but it's not really ready for prime-time yet.
J
He has a new version up with bug fixes and has lowered the price.
I haven't been able to get it to work either...only head movement. I have been bugging the guy on FB and YouTube about getting help but is is just unwilling to respond. I have let him know that there are quite a number of people on the Daz interested but haven't been able to get it to work either. I told him, "Dang, I WANT to buy your product so you would think you would be a little more willing to help a potential customer!"
Another new version on their site, and a version for Maya, too. Maybe that will work jaebea. I still don't have a webcam and am hoping I can get a camcorder to work.
Alas Since this does not recognize my built-in web cam
I shall stick with mimic live+ manually added expression/aniblocks
for my facial animation.
I purchased the personal version of the product. I attempted to capture facial motions with a webcam and a Windows Kinect V2. I have a Intel I7 -7700k 64 Bit Windows 10 Pro PC with 64 GB of ram. I calibrated with the Kinect and webcam and "recorded" at least 30 motion captures. None of the captures created motion files. I ran the program as an administrator, started and restarted it many times.. nothing worked. I emailed the company three times and have not received any guidance or offers for a refund. Unless I am overlooking something in it's use.. I consider this company as a scam business and I am grateful I only lost $58.
I also purchased for personal use. With Kinect it will save video but no audio. With webcam, I can save video and audio. But audio is out of sync when dropped into Daz. Will not save calibration presets. I have tried to contact developer, get no answer. Am not willing to devote any time to tweeking, until developer gets back to me with soloutions. In the mean time I am search for an other solution to face capture for use in Daz Studio.
Hopefully daz is/will be making better animation tools in the future.
In Unity I looked today & there is a facial animation asset regular $35 onsale for $17.50. It is called LipSyncPro by Rogo Digital. I doubt thought that it is substantially better or better at all than any of the other solutions complained about in the DAZ forums - it's key point is a price more in line with reality given the lack of performance. Mimic Live is free though. There is also a LipSync Lite by RoGo Digital that is free so you can try & buy.
No Daz mimic live is not free.
the basic mimic plugin , only available in the 32 bit version of DS, is Free
Oh, thanks for that.
What is the basic Mimic? What can you do with it compared to Mimic Live?
Having to boot up a 32 bit version to do so,
The basic mimic plug lets you load pre-recorded audio
and make Chracters speak it.
Mimic live lets you speak into your computer microphone and the
figure will speak what are saying "live"and record it as an animation
but does not load pre recorded audio tracks
unless you use my trick
described here:
https://www.daz3d.com/forums/discussion/115371/for-my-fellow-animators-using-mimic-live#latest
Here is an update on the resolution to my problems with F-Clone, not inherently the programs, but info that should be included when you purchase.
My problem were and the solution were;
Problem
Could not record Kinect audio,
Solution
Right click on audio icon in Windows tool bar, select record devices, enable all the recording devices you plan to use, in this case, Kinect NUI Audio and Webcam audio.
Problem
Could not save Webcam or Kinect Presets
Solution
Right click on F Clone application and run as Administrator
Have to do extensive testing, and will do an update.