Using AI to "predict" final render image
kliv_berberi
Posts: 0
in The Commons
I can't be the only one thinking that one can train a neural network to estimate the final Iray render, using one (or several) other real-time renders like texture shaded, PBR etc. I would like to know if something along this lines has been tried before.
Daz 3D is part of 
Connect
DAZ Productions, Inc.
224 S 200 W, Suite #250
Salt Lake City, UT 84101
Licensing Agreement | Terms of Service | Privacy Policy | EULA
© 2024 Daz Productions Inc. All Rights Reserved.
Comments
I doubt it, at least for the foreseeable future. Maybe for a limited set of visual topics (a face perhaps).
You need to train an AI first, so you would need to render an awful lot of images first, which kind of defeats the purpose :)
That's not say the denoiser might become a whole lot better first, or use limited predictive power here and there.
Yes. There are AI denoisers. The Nvidia one is included in DAZ Studio. https://developer.nvidia.com/optix-denoiser
Intel also has a standalone denoiser. https://www.openimagedenoise.org/
That is the denoiser, I think OP means that AI can predict the path tracing and just fills the render a lot quicker with pre-trained material.
That's what the denoiser is doing. You give it a set of low sampled scene's pixels and the AI perdicts what the final image is. The denoisers have already gone through the training images.
I'm not sure what you mean exactly by predicting a final render. If you're talking about AI enhancing a lower quality render then yes but it's not going to look that similar to what it would looke like if you were to render it fully.
Here's an example using it on GTA V:
I can't find any examples but I saw someone use AI to make the faces from Daz Studio renders more realistic. Here's my attempt: downloaded the rendered image from google images, blurred it in photoshop, then passed it through an AI face filter.