Remixing your art with AI

FirstBastion

wolf359 said:

[snip]

 I really liked this cartoon appreciation video.  Both the lyrics and music were catchy.

Martirilla

An experiment with a very basic Poser 13 real-time Preview render 'enhanced' with a Stable Diffusion 1.5 model. Got a repeatable and pleasing graphic style, held steady by a Controlnet and output to a reasonable 1024px output. A blending layer set to 'Color' then brings back the Poser colors and thus gives consistent color from frame to frame throughout a comic. The figure/background can also be masked, since the shape-registration between the Poser renders and the SD image is exact. It is possible. (Space backdrop by Glitterato plugin).

 

EndlessSummerdays

I am sorry if this is asked before but I would like to know are we allowed to use pictures that we have rendered with DAZ Studio to teach AI to create consistent characters for use on AI videos or anything else? At least OpenArt has this feature where you can give it a picture or pictures of a character from one or multiple angles and make it learn how to create a consistent character. I would guess this is allowed by Daz and we can also use those commercially with only basic licenses of products.

WendyLuvsCatz

EndlessSummerdays said:

I am sorry if this is asked before but I would like to know are we allowed to use pictures that we have rendered with DAZ Studio to teach AI to create consistent characters for use on AI videos or anything else? At least OpenArt has this feature where you can give it a picture or pictures of a character from one or multiple angles and make it learn how to create a consistent character. I would guess this is allowed by Daz and we can also use those commercially with only basic licenses of products.

definitely not to redistribute as LoRas or Embeddings

for your own renders 3D or Ai I cannot see why not, just another form of editing

it would be like using photographs of others without permission 

WendyLuvsCatz

another Ai lipsynced and animated render movie

Wan2.1 and FaceFusion on my PC

EndlessSummerdays

WendyLuvsCatz said:

EndlessSummerdays said:

I am sorry if this is asked before but I would like to know are we allowed to use pictures that we have rendered with DAZ Studio to teach AI to create consistent characters for use on AI videos or anything else? At least OpenArt has this feature where you can give it a picture or pictures of a character from one or multiple angles and make it learn how to create a consistent character. I would guess this is allowed by Daz and we can also use those commercially with only basic licenses of products.

definitely not to redistribute as LoRas or Embeddings

for your own renders 3D or Ai I cannot see why not, just another form of editing

it would be like using photographs of others without permission 

Thank you, Wendy. Thank you for taking time to answer me. I take your answer as it is allowed for my own Daz renders even commercially. That is also what I was thinking and might also do it if its ok to do. Not sure if anything will ever be commercially used but I would like to know if it is allowed. I guess I kind of hoped for you to answer to my post when I was writing it as I think there was your comment on another thread where you told that training AI with Daz renders is not allowed but I had a feeling it meant that the base algorithms or what ever those are called are not allowed to be trained with Daz renders. I don't think AI sites actually use user pictures to train their AI. Also I know of your interest in AI and animation so your insights were appreciated along with your kindness and time you used to answer me. I often read these forums and I therefore somewhat know about you.

WendyLuvsCatz

EndlessSummerdays said:

WendyLuvsCatz said:

EndlessSummerdays said:

I am sorry if this is asked before but I would like to know are we allowed to use pictures that we have rendered with DAZ Studio to teach AI to create consistent characters for use on AI videos or anything else? At least OpenArt has this feature where you can give it a picture or pictures of a character from one or multiple angles and make it learn how to create a consistent character. I would guess this is allowed by Daz and we can also use those commercially with only basic licenses of products.

definitely not to redistribute as LoRas or Embeddings

for your own renders 3D or Ai I cannot see why not, just another form of editing

it would be like using photographs of others without permission 

Thank you, Wendy. Thank you for taking time to answer me. I take your answer as it is allowed for my own Daz renders even commercially. That is also what I was thinking and might also do it if its ok to do. Not sure if anything will ever be commercially used but I would like to know if it is allowed. I guess I kind of hoped for you to answer to my post when I was writing it as I think there was your comment on another thread where you told that training AI with Daz renders is not allowed but I had a feeling it meant that the base algorithms or what ever those are called are not allowed to be trained with Daz renders. I don't think AI sites actually use user pictures to train their AI. Also I know of your interest in AI and animation so your insights were appreciated along with your kindness and time you used to answer me. I often read these forums and I therefore somewhat know about you.

 it was written in the EULA, not checked the latest one

I wasn't just giving an opinion 

WendyLuvsCatz

cloudflare makes checking anything difficult

the Content License expressly excludes the use, incorporation, or input of any Content, in whole or in part, in connection with i) any AI engine, program, or system (including, without limitation, Image.ai, Nightcafe, Artbreeder, chatGPT, Shutterstock, DALL-E 2, Deep Dream Generator, Hotpot ai, DeepAI) with capabilities or instructions to auto-generate materials that are derivative, imitative, or otherwise plagiaristic of the Content; and ii) any activity contrary to the intended use of the Content License, or otherwise to circumvent the terms, restrictions, or safeguards applicable to this Content License. For the purposes of this EULA, "AI" means any method of artificial intelligence such as deep learning, neural networks, or any other similar technologies intended to consume and analyze content for the intent of auto-generating ne

WendyLuvsCatz

I don't train LoRas on DAZ content even for my own use

I have and do train them on my own photographs of myself, my mother and my cat for example 

I only edit renders I made using it as postwork 

be it adding realism by inpainting or animating them

I especially avoided the topic of commercially as cannot answer that

only said for your own renders, what you do on your own computer is your own business 

DAZ explicitly forbids the redistribution of any assets 

a finished 2D render is however allowed and that's all 

EndlessSummerdays

WendyLuvsCatz said:

I don't train LoRas on DAZ content even for my own use

I have and do train them on my own photographs of myself, my mother and my cat for example 

I only edit renders I made using it as postwork 

be it adding realism by inpainting or animating them

I especially avoided the topic of commercially as cannot answer that

only said for your own renders, what you do on your own computer is your own business 

DAZ explicitly forbids the redistribution of any assets 

a finished 2D render is however allowed and that's all 

Thank you for the clarification Wendy. The issue isn't so clear though as I hoped it would be. That bit of EULA almost makes it look like anything AI made or AI edits might not be allowed to use with Daz renders. In reality this seems to happen quite often even on these forums and people post tips how to use AI with their art and I think Daz has never said you can't do it or remove threads from these forums because of anything like that. Even some Daz products seem to have bits like backgrounds made with AI. Also programs like Photoshop has AI now so it is hard and quite limiting to avoid AI tools. You could even argue that Photoshop has always (not sure if the first Photoshop had these) had AI with its image sharpening and color editing tools. Part of the reason I mentioned commercial use is because I would like to understand the limits of my licenses and understand that clearly. Before I thought that anyhing that I rendered (meaning the picture file I created with DAZ Studio) was free to use the way I like to use it and I had full ownership of this art. Only realtime rendering (like on games) was where you had to have interactive license. I guess that would also include if you would include Daz products in game code for example.

Well, I asked my original question from Daz as well. I will see what they tell me.

EndlessSummerdays

Adding to my earlier post I guess that phrase "any Content" on EULA can mean Daz products and probably does mean Daz products and does not include our rendered pictures.

WendyLuvsCatz

well I meant DAZ content cannot be used to train

you can do what you like with your 2D render be it an image or video

but training is the thing forbidden and creating derivative works is highly frowned upon too

IE using Facetransfer to copy an entire PAs catalogue of characters from the promotional images would be very questionable, likewise taking promotional images and using them for backgrounds

this is not even an Ai example 

if you are training a LoRa on a specific PAs character even in your own render, that could be equally derivative but if you are only using that LoRA on your own PC likely fair use as you bought the license to render the character anyway 

distributing LoRAs trained on your renders to others would be the big issue 

so simply put, don't train Ai on your renders and distribute the trained model to others

as it would be derivative 

EndlessSummerdays

I would never take someone's promotional pictures and make money or art with that. I know you only told it as an example but I wanted to mention that. I am also happy to pay to Daz and to all of these PAs for their great work.

EndlessSummerdays

I probably should have originally had some links to example videos of what I meant by my original question.

Here are three example videos. These don't use DAZ Studio but you can probably see that you could do those various angle pictures with DAZ Studio. Also those two first videos have characters that are inspired by Star Wars and I know Star Wars is copyrighted but these videos are here only as an example of the process.

WendyLuvsCatz

EndlessSummerdays said:

I would never take someone's promotional pictures and make money or art with that. I know you only told it as an example but I wanted to mention that. I am also happy to pay to Daz and to all of these PAs for their great work.

it was just meant as an example

Ai has in effect the ability to reverse engineer art

and feeding it renders of a specific character to train it sort of is that

but your own original character dialed up with your own parameters would be a lot more acceptable to train a LoRa or Embedding than a click and loaded  as is PA character ... or Vicky 9 for example 

WendyLuvsCatz

OMG

 

wsterdan

Impressive stuff, for sure. I tested the Kling implementation in Openart, very cool stuff, and getting better constantly.

WendyLuvsCatz

NeuralNote is an awesome Midi extractor

https://github.com/DamRsn/NeuralNote

not tried it on singing or playing someting myself yet but it can record too

FirstBastion

WendyLuvsCatz said:

OMG

 

 OMG indeed!  The car, the rocket, and the first sinkhole were all impressive.

Artini

Thanks for the information. Just wonder how many credits generation of video will take.

WendyLuvsCatz

Mixed Medium 
3D CGI DAZ3D and Meshy Ai characters, 
DAZ studio iray renders, 
Ai animation (Wan2.1) and Ai generated music with sound FX from YouTube Audio Library

Artini

Very well made, @WendyLuvsCatz

I enjoyed watching it.

 

WendyLuvsCatz

Artini said:

Very well made, @WendyLuvsCatz

I enjoyed watching it.

 

thanks 

as a side note 

took 12 hours to render the 48 clips but uses a lot less power and VRAM  than iray 

the issue is there are set lowVRAM configurations and the next one up exceeds my VRAM

a choice between 8GB VRAM 16GB ram or 12GB VRAM 32GB ram and I have 11GB VRAM 32GB ram

so it plods without utilising all my hardware barely reaching 60°C on the GPU

and not drawing a lot of power

which is good for my power bill so not complaining just slow

wsterdan

Nicey done, as always! A good example of some of the stuff that can be done with a little imagination.

WendyLuvsCatz

wsterdan said:

Nicey done, as always! A good example of some of the stuff that can be done with a little imagination.

little indeed

it doesn't even follow my prompts 

Martirilla

Poser real-time render to fine watercolour, a demo with workflow.

Leana

WendyLuvsCatz said:

OMG

 

Impressive.

The launch pad flying off with the rocket in the second attempt made me laugh, but those were great examples.

Diomede

Has anyone been following Moonvalley?  It is advertised as an ethically trained model (database derived only from licenses content, no scraping etc) for professional quality film makers.  Has tiered subscription so might be good for non-professionals going for a photorealistic result.  Is it overkill?  Does it fail to address a significant concern?  Is it just right?  Here is a link to article discussing it.

https://www.msn.com/en-us/news/technology/the-first-ethically-trained-and-commercially-safe-ai-video-model-is-finally-released-into-the-world/ar-AA1Inb2A?ocid=winp2fptaskbar&cvid=626333c97fdd483dca7e9907ac8038c7&ei=21

WendyLuvsCatz

Using a cool lipsync Ai on my PC to animate a render

WendyLuvsCatz

full Vampire Hunter Video