Agreed, I can see an issue where reading and especially writing files could be signifcantly slowed down.
I am considering moving my libraries to another hard drive outside of DropBox/OneDrive and seeing what impact that has.
I would use DropBox to save the DIM downloads so that I do not have to download items more than once. I then would install each item individually on my workstation and render machines.
Also, rebuilding the CMS might be a good idea too.
I may just do a clean install after backing everything up.
Great to have lobbed onto this thread as I've been suffering the incredibly slow load problems too - although for me, the saves have not been too painful. I can see from task manager, (as Aeternali noted) that during load, the computer is essentially idle, with one of my 12 cores hovering between say 60% and 90% and the others twiddling their thumbs, so maybe multithreading at loads should be a priority for the developers - heck of a down time waiting for a big file to load.
I've also been trying to figure what makes the GUI on my big scene so slow. I understand there is lots of autofitting of clothing going on, but not clear to me at all why even a camera orbit is painful. Any throughts? My GPU memory seems flat at about 3/4 utilised and GPU load is well under 50%. Like loading, only one CPU core seems engaged when orbiting so maybe it's the same problem.
And the last really painful item is re-posing using IK (on my G2M and G2F figures). Once I latch onto an IK body part and get the right gizmo handle, there is a 5 or 10 second pause (and then a refresh of any over-panes) before the part will begin to move. Again, it appears that only one core is engaged on the task and it loads up to mear max for the pause and then loads up again during movement.
Unfortunately, areg5's hack does nothing for me. The subset file is identical in size and as painful to load. Ah well!
For me it is generally 3 things that bite me in the ass and slow things down a lot.
Hair - Some hair is worse than others but really good looking hair just kills loads and drawing the viewport. I will sometimes remove hair until I render.
Clothing - You already mentioned this one but smoothing and collision settings for the clothing. I tend to keep these low until I render. This tends to impact both load and draw times.
Figure - Mesh Resolution - These settings when set high tend to really slow things down a lot. I tend to keep these lower and increase just before render. This tends to only impact draw times but load times it might have a minor impact.
I agree with your muti-threaded comment.
Also, I/O on my SSD is minimal as well during loads, which does not make sense to me. Why am I waiting if I have no CPU, GPU, I/O or memory bottle neck? What is causing the slow loads?
I stopped having my libraries on OneDrive or DropBox, this had a huge positive impact.
I stopped using connect except for connect only content. Rationale, it seems connect checks for new versions and downloads them on scene load which slows things down. DIM installed versions do not do this.
I am open to more discussion and discovery on this.
This is working for me to. Yay! Saving parts of the same scene as subsets, then merging them together and resaving as scene have reduced my loading times to 20-30 secs for two Gen 3 custom characters with geografts, custom clothing and hair in one scene. Before it was like from 10 to 30 minutes. And I haven't used fit control, or reality plugin. My scene file was also reduced from 68mb to 24mb. I don't know what causing it, but I have checked my scene many times before for hidden things, and nothing strange was found. It just happens.
In broken scenes there also was a TON of errors like is:
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
I'm a daily Daz user. I've found long save times as well. But only recently as of this evening. I discovered that it was due to a script that I had downloaded and used in my scene. Once deleting the script that I downloaded, things (the program) worked as "normal". .... I've found that 3rd party clothing and objects sometimes have a similar effect of "slowness".
I believe it's likely that some things aren't exactly coded correctly for Daz. ..but may still work in Daz.
Hmm. Thanks for the necro, as I've got a painfully slow scene as well. Gonna hafta try that.
And I'm sure this has been stated already, but saving a scene "carves in stone" a lot of stuff, whereas loading it in from the library each time involves a bit of searching by the loading routine. Opening a scene is like pulling up a photograph - everything's already there.
Ok I did find one problem with this method: Animations are not saved, even when "Check All" is selected during the save. I have a huge animation file (over 5GB so far) with the Anilip plugin and some Aniblocks and audio files. When I save it as a Scene Subset, then reload by browsing to the location, I get no animation, no audio, the AniMate2 subtracks are wiped out (only base figure tracks remain), and it drops back to 30 frames (it's 12K frames).
Bummer. Looks like my yuge file is going to have to stay yuge.
Tried the subset save , it took ages as well, this long save time issue only started a few hous ago, up till then saves were ok , 10 secs at the most , suddenly and on all scenes i have tried its taking up to 5 mins or more, relitivly simple scenes that took seconds to save now taking minutes , cant figur this out uless it my hardware breaking down
So... I have pretty simliar problems with Genesis 3 Female only. I think... it is because of the 1000000x infinity morphs I have installed for her. I have none of the problems with G8F... because I have like 2 morphs installed.
I am considering rebuilding my G3F runtime with only stuff I use... which... would be a huge drag may be really useful long term.
Here's something to try. Right click on you scene tab and put a checkmark beside "show hidden items". When I did this, I discovered literally thousands of d-formers. When I deleted them (there is an option "select all d-formers" which made this easier, but to delete all those items took hours. Still, it solved my problem.
In my case, it was because for a short while in the past, I used Reality, I know you don't, but it is a simple enough procedure that it can't hurt.
I think I will jump in on this. The last couple weeks Studio has been quite slow saving and loading files. Worse - for animations it has been taking a long time to save each image in an image series. I just tried uninstalling and reinstalling Studio, which had no effect, so now I am looking through the forums. I will add that just making a simple primitive cube (nothing else in the scene) and saving it takes about 30 seconds.
Okay ... I have an odd suggestion. I sometimes have to run my computer from a 12-volt battery through an inverter. After reading this thread, I checked an saw that after the duf and duf.png files were saved the computer resources went wild. Then I noticed the pattern (by the sounds of the inverter) that followed that it would match what it takes to clear the scene by hitting new and possibly then to load a scene. Is it possible that after saving, it is clearing and then reloading the scene? Or some similar loop?
I had used it on a couple of clothes and that apparently fills the scene itself with all those morphs and kills it.
The solution was simple, and it is already provided in the same product but I didn't use it before because I didn't think about it: Once you are done morphing a piece of clothing to your desires select the delete unused morphs script. This took down my scenes from 200 MB to 2 MB and also hugely improved load times.
Comments
Speed is the main issue, as far as I am aware.
Agreed, I can see an issue where reading and especially writing files could be signifcantly slowed down.
I am considering moving my libraries to another hard drive outside of DropBox/OneDrive and seeing what impact that has.
I would use DropBox to save the DIM downloads so that I do not have to download items more than once. I then would install each item individually on my workstation and render machines.
Also, rebuilding the CMS might be a good idea too.
I may just do a clean install after backing everything up.
Do you have other suggestions?
Great to have lobbed onto this thread as I've been suffering the incredibly slow load problems too - although for me, the saves have not been too painful. I can see from task manager, (as Aeternali noted) that during load, the computer is essentially idle, with one of my 12 cores hovering between say 60% and 90% and the others twiddling their thumbs, so maybe multithreading at loads should be a priority for the developers - heck of a down time waiting for a big file to load.
I've also been trying to figure what makes the GUI on my big scene so slow. I understand there is lots of autofitting of clothing going on, but not clear to me at all why even a camera orbit is painful. Any throughts? My GPU memory seems flat at about 3/4 utilised and GPU load is well under 50%. Like loading, only one CPU core seems engaged when orbiting so maybe it's the same problem.
And the last really painful item is re-posing using IK (on my G2M and G2F figures). Once I latch onto an IK body part and get the right gizmo handle, there is a 5 or 10 second pause (and then a refresh of any over-panes) before the part will begin to move. Again, it appears that only one core is engaged on the task and it loads up to mear max for the pause and then loads up again during movement.
Unfortunately, areg5's hack does nothing for me. The subset file is identical in size and as painful to load. Ah well!
For me it is generally 3 things that bite me in the ass and slow things down a lot.
I agree with your muti-threaded comment.
Also, I/O on my SSD is minimal as well during loads, which does not make sense to me. Why am I waiting if I have no CPU, GPU, I/O or memory bottle neck? What is causing the slow loads?
I stopped having my libraries on OneDrive or DropBox, this had a huge positive impact.
I stopped using connect except for connect only content. Rationale, it seems connect checks for new versions and downloads them on scene load which slows things down. DIM installed versions do not do this.
I am open to more discussion and discovery on this.
Take care,
This is working for me to. Yay! Saving parts of the same scene as subsets, then merging them together and resaving as scene have reduced my loading times to 20-30 secs for two Gen 3 custom characters with geografts, custom clothing and hair in one scene. Before it was like from 10 to 30 minutes. And I haven't used fit control, or reality plugin. My scene file was also reduced from 68mb to 24mb. I don't know what causing it, but I have checked my scene many times before for hidden things, and nothing strange was found. It just happens.
In broken scenes there also was a TON of errors like is:
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
2017-09-19 02:23:03.108 JSON interpreter warning: Unexpected string member: name
I'm a daily Daz user. I've found long save times as well. But only recently as of this evening. I discovered that it was due to a script that I had downloaded and used in my scene. Once deleting the script that I downloaded, things (the program) worked as "normal". .... I've found that 3rd party clothing and objects sometimes have a similar effect of "slowness".
I believe it's likely that some things aren't exactly coded correctly for Daz. ..but may still work in Daz.
Hmm. Thanks for the necro, as I've got a painfully slow scene as well. Gonna hafta try that.
And I'm sure this has been stated already, but saving a scene "carves in stone" a lot of stuff, whereas loading it in from the library each time involves a bit of searching by the loading routine. Opening a scene is like pulling up a photograph - everything's already there.
Ok I did find one problem with this method: Animations are not saved, even when "Check All" is selected during the save. I have a huge animation file (over 5GB so far) with the Anilip plugin and some Aniblocks and audio files. When I save it as a Scene Subset, then reload by browsing to the location, I get no animation, no audio, the AniMate2 subtracks are wiped out (only base figure tracks remain), and it drops back to 30 frames (it's 12K frames).
Bummer. Looks like my yuge file is going to have to stay yuge.
I don't know if it has been mentioned, but check the log to see if there are errors during load; these can have a huge impact on load-times.
Tried the subset save , it took ages as well, this long save time issue only started a few hous ago, up till then saves were ok , 10 secs at the most , suddenly and on all scenes i have tried its taking up to 5 mins or more, relitivly simple scenes that took seconds to save now taking minutes , cant figur this out uless it my hardware breaking down
So... I have pretty simliar problems with Genesis 3 Female only. I think... it is because of the 1000000x infinity morphs I have installed for her. I have none of the problems with G8F... because I have like 2 morphs installed.
I am considering rebuilding my G3F runtime with only stuff I use... which... would be a huge drag may be really useful long term.
Here's something to try. Right click on you scene tab and put a checkmark beside "show hidden items". When I did this, I discovered literally thousands of d-formers. When I deleted them (there is an option "select all d-formers" which made this easier, but to delete all those items took hours. Still, it solved my problem.
In my case, it was because for a short while in the past, I used Reality, I know you don't, but it is a simple enough procedure that it can't hurt.
I think I will jump in on this. The last couple weeks Studio has been quite slow saving and loading files. Worse - for animations it has been taking a long time to save each image in an image series. I just tried uninstalling and reinstalling Studio, which had no effect, so now I am looking through the forums. I will add that just making a simple primitive cube (nothing else in the scene) and saving it takes about 30 seconds.
Okay ... I have an odd suggestion. I sometimes have to run my computer from a 12-volt battery through an inverter. After reading this thread, I checked an saw that after the duf and duf.png files were saved the computer resources went wild. Then I noticed the pattern (by the sounds of the inverter) that followed that it would match what it takes to clear the scene by hitting new and possibly then to load a scene. Is it possible that after saving, it is clearing and then reloading the scene? Or some similar loop?
Sorry for necroing this thread yet again but maybe it will help some other people as well.
I found myself with huge load times on some of the scenes and also some of them taking around 200 Mb which seems waay to much for a scene.
After reading through it, the problem was https://www.daz3d.com/fit-control-add-on-for-genesis-3--8-female.
I had used it on a couple of clothes and that apparently fills the scene itself with all those morphs and kills it.
The solution was simple, and it is already provided in the same product but I didn't use it before because I didn't think about it: Once you are done morphing a piece of clothing to your desires select the delete unused morphs script. This took down my scenes from 200 MB to 2 MB and also hugely improved load times.