ai training data

WendyLuvsCatzWendyLuvsCatz Posts: 40,879
edited May 10 in The Commons

https://www.daz3d.com/ai-training-data

sooo.. what is this???

not really sure which forum to ask in so moving it to the commons as not technically DAZ ai Studio

Post edited by WendyLuvsCatz on
«1

Comments

  • backgroundbackground Posts: 816
    edited May 10

    I'm guessing it's intended for creating 'loras', effectively adding data to an AI image generator so that it can produce repeatable characters or other elements, usually triggered by some keyword that directs it so use data from the selected lora.

    Post edited by background on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879
    edited May 10

    I know what a LoRa is, I train them myself on family and pets

    but the EULA explicitly forbids this using DAZ content for redistribution

    II have used some renders to train one for my own use but mostly go the other way dialing up DAZ characters based on my AI ones and also using the AI characters in Face Transfer 

    Post edited by WendyLuvsCatz on
  • backgroundbackground Posts: 816

    I think they would have more luck selling bikinis to Eskimos, but who knows ( not having a go at you Wendy, just based on how AI has been generaly  regarded by folks here ).

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879
    edited May 10

    Notwithstanding anything to the contrary contained herein, the Content License expressly excludes the use, incorporation, or input of any Content, in whole or in part, in connection with i) any AI engine, program, or system (including, without limitation, Image.ai, Nightcafe, Artbreeder, chatGPT, Shutterstock, DALL-E 2, Deep Dream Generator, Hotpot ai, DeepAI) with capabilities or instructions to auto-generate materials that are derivative, imitative, or otherwise plagiaristic of the Content; and ii) any activity contrary to the intended use of the Content License, or otherwise to circumvent the terms, restrictions, or safeguards applicable to this Content License. For the purposes of this EULA, "AI" means any method of artificial intelligence such as deep learning, neural networks, or any other similar technologies intended to consume and analyze content for the intent of auto-generating new content.

    https://www.daz3d.com/eula 

    this

    as I said, I have used my own 2D renders, customised to the way I wanted my character to look to train one, and only one LoRa ever, I hardly have touched it though because of the ambiguity of the EULA regarding 2D renders for one's own use and training, preferring to just modify by inpainting and animate the DAZ renders of that character using AI instead, I don't train LoRas on DAZ characters ie Victoria , Michael, PA characters etc

    Post edited by WendyLuvsCatz on
  • NylonGirlNylonGirl Posts: 2,300

    I wonder what might be the source of those "millions" of 3D assets the page says will be available for training AI.

  • backgroundbackground Posts: 816
    edited May 10

    I can understand if they forbade using DAZ images to train an AI engine, because that would basically involve giving away their IP to help another company make a profit, so yes it's confusing. It's really up to DAZ to make very clear what is allowed, since users are not Intellectual Property lawyers.

    Post edited by background on
  • 3DIO3DIO Posts: 342
    edited May 10

    This is quite a concern actually, and I'm glad it was brought up!

    I had no idea they added that stuff about AI to the "Standard Licence".  Every Daz product I ever purchased was purchased believing the licence could not restrict what I do with rendered images of Daz content, and as far as I'm concerned, that right was always covered by default in the Standard Licence.

    So just to be clear, are they saying I cannot use my renders of Daz Characters to train LoRAs of Daz content to use in my own AI generated movies for release commercially?  Or are they simply referring to restriction of inputting the raw Daz content files to an AI system to generate a derivative product?  If I render a character from different angles, then the result is a bunch of renders for which I own the copyright.

    This by law would surely mean that I'm free to do whatever I like with my own renders?

    Attached is Luxiana, the first custom character I rendered on my Linux install.  She's based on Victoria 9.  If she were an actual product she'd be "Luxiana for Victoria 9".  So are Daz saying that if I were to take this render of Luxiana, and multiple more from different angles, that I would not be permitted by Daz to use those renders to train my own LoRA for use in any AI assisted commercial movie I might make?

    It would be great to have some clarification on this since it's kinda hard to tell from what I just read, whether such a thing would be prohibited.  Same with scenes, I expect to be able to input as many renders of a scene from as many angles as I wish, in order to train a LoRA for the same reason.


    C1.jpg
    1800 x 1800 - 1M
    Post edited by 3DIO on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879
    edited May 10

    what I too would like to know

    mine is a custom character too, loosely based on G2F Bijou with other features dialed in, who is whom I use for my DAZ renders but at the same time not, it was actually trained on AI altered images of her to look more realistic, human, not raw renders

    her renders used in Canny in controlNet Fooocus SDXL1.5 to be specific to create my training images

    I still thought that was too derivative according to the EULA so don't use that LoRa

    I wouldn't share that LoRa though, I would like clarification for my own use in images and videos though from DAZ

    the only video I did using that LoRa

    Post edited by WendyLuvsCatz on
  • 3DIO3DIO Posts: 342
    edited May 10

    @Wendy
    I cannot wait to see what my characters would look like put through AI, especially ComfyUI with all the control that it gives!

    And that's another thing.  Surely there would need to be a different set of rules for remote and local LoRA generation.  I'll never use a remote AI system, so it's impossible for me to feed some AI corporate with any data.  It's done locally on my computer, and as with yourself, it would be purely to train my own LoRAs.

     

    Post edited by 3DIO on
  • backgroundbackground Posts: 816
    edited May 10

    Well that was dammned scary! That image at about 2 seconds in is the spitting image of a lovely lady I used to know many decades ago. It's so close it could be a photo of her, expression, eye colour,  hair an all. I definitely felt a chill seeing that unexpectedly. Her name was Jean, haven't thought about for years until today.

    Post edited by background on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879

    3DIO said:

    @Wendy
    I cannot wait to see what my characters would look like put through AI, especially ComfyUI with all the control that it gives!

    And that's another thing.  Surely there would need to be a different set of rules for remote and local LoRa generation.  I'll never use a remote AI system, so it's impossible for me to feed some AI corporate with any data.  It's done locally on my computer, and as with yourself, it would be purely to train my own LoRas.

     

    I train mine locally with One Trainer

    as I said though, mostly on real photos not renders, I want real people 

    I have uploaded renders and AI enhaced renders to sites to animate them, nothing more

    but do that too on my own PC using Pinokio to run Wan, LTX and other AI animation models

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879

    background said:

    Well that was dammned scary! That image at about 2 seconds in is the spitting image of a lovely lady I used to know many decades ago. It's so close it could be a photo of her, expression, eye colour,  hair an all. I definitely felt a chill seeing that unexpectedly. Her name was Jean, haven't thought about for years until today.

    she definitely is not a 3D render, I honestly never saw the point of training on one 

     

  • backgroundbackground Posts: 816

     The person I'm thinking of had two children and was engaged to be married ( her first husband having sadly been killed in a climbing accident ).I really hope she had a happy life, or hopefully is still enjoying one.. We were just friends, but she was the sort of person that made you smile as soon as you saw her.

  • 3DIO3DIO Posts: 342
    edited May 10

    WendyLuvsCatz said:

    she definitely is not a 3D render, I honestly never saw the point of training on one 

    Custom actors and actresses to your exact specification of course!

    I intend to create a node setup in ComfyUI that will take my renders, train a LoRA on them, and give me a controllable amount of "fix" to fix the anatomy so that when used in a movie, the characters bahave perfectly, and look correct from all angles.

    Once you have that, you can basically sit in front of any standard camera, and do the acting yourself.  It then attaches your custom LoRA-trained characters to your movement.  You can even design the vocal characteristics of each character, and it will speak as fluently as you do yourself, using the AI vocal charateristic to mimic what you spoke yourself.  The results are indistinguishable from a real human sat in front of a real camera.

    It's pretty damn mind-blowing really, and all of it done locally on even moderately powered cards these days.

     

    Post edited by 3DIO on
  • HavosHavos Posts: 5,656

    When I saw that link I assumed that DAZ was aiming at large companies who could train there AI models using DAZ assets (either renders or the models themselves). Note that there is no price quoted, just a "contact us", so these are definitely not intended for the vast majority of the customers here.

    The advantage of training on 3D models is you can supply lots of key words with the images, that in theory would make it easier to train, and there would also be no backgrounds to filter out first in order to understand the look of the main subject.

  • Richard HaseltineRichard Haseltine Posts: 110,173

    Havos said:

    When I saw that link I assumed that DAZ was aiming at large companies who could train there AI models using DAZ assets (either renders or the models themselves). Note that there is no price quoted, just a "contact us", so these are definitely not intended for the vast majority of the customers here.

    It's certainly only the Daz-owned assets, I'm not sure but I think the 3D content rather than renders. PAs are not included (unless, possibly, they opt in) and certainly end-user art is not included.

    The advantage of training on 3D models is you can supply lots of key words with the images, that in theory would make it easier to train, and there would also be no backgrounds to filter out first in order to understand the look of the main subject.

  • Richard HaseltineRichard Haseltine Posts: 110,173

    WendyLuvsCatz said:

    Notwithstanding anything to the contrary contained herein, the Content License expressly excludes the use, incorporation, or input of any Content, in whole or in part, in connection with i) any AI engine, program, or system (including, without limitation, Image.ai, Nightcafe, Artbreeder, chatGPT, Shutterstock, DALL-E 2, Deep Dream Generator, Hotpot ai, DeepAI) with capabilities or instructions to auto-generate materials that are derivative, imitative, or otherwise plagiaristic of the Content; and ii) any activity contrary to the intended use of the Content License, or otherwise to circumvent the terms, restrictions, or safeguards applicable to this Content License. For the purposes of this EULA, "AI" means any method of artificial intelligence such as deep learning, neural networks, or any other similar technologies intended to consume and analyze content for the intent of auto-generating new content.

    https://www.daz3d.com/eula 

    this

    as I said, I have used my own 2D renders, customised to the way I wanted my character to look to train one, and only one LoRa ever, I hardly have touched it though because of the ambiguity of the EULA regarding 2D renders for one's own use and training, preferring to just modify by inpainting and animate the DAZ renders of that character using AI instead, I don't train LoRas on DAZ characters ie Victoria , Michael, PA characters etc

    I can ask for clarification, but I would think that covers sharing the training results (as the license forbids sharing derivatives of the 3D models) rather than using AI to train for your own image production..

  • ArtiniArtini Posts: 10,674

    Richard Haseltine said:

    WendyLuvsCatz said:

    Notwithstanding anything to the contrary contained herein, the Content License expressly excludes the use, incorporation, or input of any Content, in whole or in part, in connection with i) any AI engine, program, or system (including, without limitation, Image.ai, Nightcafe, Artbreeder, chatGPT, Shutterstock, DALL-E 2, Deep Dream Generator, Hotpot ai, DeepAI) with capabilities or instructions to auto-generate materials that are derivative, imitative, or otherwise plagiaristic of the Content; and ii) any activity contrary to the intended use of the Content License, or otherwise to circumvent the terms, restrictions, or safeguards applicable to this Content License. For the purposes of this EULA, "AI" means any method of artificial intelligence such as deep learning, neural networks, or any other similar technologies intended to consume and analyze content for the intent of auto-generating new content.

    https://www.daz3d.com/eula 

    this

    as I said, I have used my own 2D renders, customised to the way I wanted my character to look to train one, and only one LoRa ever, I hardly have touched it though because of the ambiguity of the EULA regarding 2D renders for one's own use and training, preferring to just modify by inpainting and animate the DAZ renders of that character using AI instead, I don't train LoRas on DAZ characters ie Victoria , Michael, PA characters etc

    I can ask for clarification, but I would think that covers sharing the training results (as the license forbids sharing derivatives of the 3D models) rather than using AI to train for your own image production..

    Please ask for clarification, @Richard Haseltine

    I have not used Daz Studio renders in that way, but will be good to know for future plans.

     

  • TriCounterTriCounter Posts: 600

    WendyLuvsCatz said:

    what I too would like to know

    mine is a custom character too, loosely based on G2F Bijou with other features dialed in, who is whom I use for my DAZ renders but at the same time not, it was actually trained on AI altered images of her to look more realistic, human, not raw renders

    her renders used in Canny in controlNet Fooocus SDXL1.5 to be specific to create my training images

    I still thought that was too derivative according to the EULA so don't use that LoRa

    I wouldn't share that LoRa though, I would like clarification for my own use in images and videos though from DAZ

    the only video I did using that LoRa

    It' seems straight forward.....You can't do it with the characters you've purchased due to the license .... but they can sell you their data if you want to use it with AI in a separate license

  • Matt_CastleMatt_Castle Posts: 3,146

    WendyLuvsCatz said:

    but the EULA explicitly forbids this using DAZ content for redistribution

    This comes with a massive dose of "I am not a lawyer", but Daz has the option to sell content under different licences.

    We're already familar with this with the Interactive and 3D print licences, which provide permissions that allow you to do things the standard licence disallows.

    They can, of course, provide an "AI licence" which does grant this permission.

    3DIO said:

    I had no idea they added that stuff about AI to the "Standard Licence".  Every Daz product I ever purchased was purchased believing the licence could not restrict what I do with rendered images of Daz content, and as far as I'm concerned, that right was always covered by default in the Standard Licence.

    Again, this has a massive "I am not a lawyer" disclaimer, but the standard licence has granted the permission use use the assets for the purpose of "the creation and presentation of two-dimensional animations and renderings" and with the restriction that the "User may not in any case publish, market, distribute, transfer, sell or sublicense any renderings, animations, software applications, data or any other product from which any Content, or any part thereof, or any substantially similar version of the Content can be separately exported, extracted or de-compiled into any re-distributable form or format".

    Even without the AI clause being added later on, I think it would be a stretch to claim that this covered you to distribute a LORA; As AI advocates repeatedly like to tell us, models do not actually contain the original dataset (so it's not reasonably argued that the LORA is a rendered image and subject to the specified freedom of use), and there's also a strong argument that the model is highly imitatitive of the original content and ineligible on those grounds.

    There's always been these back-up clauses of a sort in the licence, because there are cases that would, quite reasonably, count as taking the mickey.

    For some examples, you probably culdn't just point a camera squarely at a flat plane with a texture on it, render out the image, then claim you have full commercial rights to that texture. Similarly, I imagine that rendering out a model from 40 different angles and feeding that all back into photogrammetry software to get a new 3D mesh out of it would, even though it has been gone purely via your rendered images, not be something you could claim full rights to.

    Once again - still not a lawyer, but while for many purposes you can think of yourself as being able to the rendered images mostly as you will, that is not actually the literal text of the licence, and I advise that you read the specific text to get a sense of what limitations might exist.

  • 3DIO3DIO Posts: 342
    edited May 10

    @TriCounter
    I don't see how anyone can put 2D render output under an AI license.  Rendered stills and movies do not contain any data that comprised any Daz product that was used in the render's creation.  It falls under a completely different format once the 3D data is captured to 2D, as well as automatic copyright of the render's author.

    In fact, if I'm understanding him correctly, Richard suggets that it doesn't apply to rendered output (even if I am still quite anxious to see what he comes back with).

    @Matt_Castle
    This is exactly why we need clarification on the matter.  The problem with the way the license is written is that, in effect, it renders every render a license violation.  This is because AI exists, therefore, any render we produce can be extracted from.  This is now against the Standard License agreement as far as I can tell.

    Creating a LoRA of my own work is my business, not Daz's or anyone else's for that matter.  I'm not wanting to distribute a LoRA.  It is purely the rendered, AI-assisted stills and movie output that results from its use that I'm wanting to distribute.

    Rendered stills and movies are simply 2D captures of 3D data that do not contain any Daz product data, just as they never have done and never will.

     

    Post edited by 3DIO on
  • Richard HaseltineRichard Haseltine Posts: 110,173

    3DIO said:

    @TriCounter
    I don't see how anyone can put 2D render output under an AI license.  Rendered stills and movies do not contain any data that comprised any Daz product that was used in the render's creation.  It falls under a completely different format once the 3D data is captured to 2D, as well as automatic copyright of the render's author.

    In fact, if I'm understanding him correctly, Richard suggets that it doesn't apply to rendered output (even if I am still quite anxious to see what he comes back with).

    @Matt_Castle
    This is exactly why we need clarification on the matter.  The problem with the way the license is written is that, in effect, it renders every render a license violation.  This is because AI exists, therefore, any render we produce can be extracted from.  This is now against the Standard License agreement as far as I can tell.

    I don't see that, if a third-party used rendered image to train AI that would not be the responsibility of the user - as long as they didn't  upload it to a host that granted others theright to use the hosted images for AI training, of course.

    Creating a LoRA of my own work is my business, not Daz's or anyone else's for that matter.  I'm not wanting to distribute a LoRA.  It is purely the rendered, AI-assisted stills and movie output that results from its use that I'm wanting to distribute.

    Rendered stills and movies are simply 2D captures of 3D data that do not contain any Daz product data, just as they never have done and never will.

     

  • kyoto kidkyoto kid Posts: 42,218

    ...all this makes my brain hurt.  Think I'll just stick to doing the best I can the "old school" way. with the tools I have.

  • wsterdanwsterdan Posts: 3,437

    Richard Haseltine said:

    I don't see that, if a third-party used rendered image to train AI that would not be the responsibility of the user - as long as they didn't  upload it to a host that granted others theright to use the hosted images for AI training, of course.

    That's basically how I read the situation. None of the images or videos I've been generating are shared with or made availble to other users in the AI engines I use, they're "mine" exclusively. I mean, anyone could grab something I uploaded to the forums here and use *that*, but that's the same with anything anyone posts here, or even the store images for that matter.

    For characters, I  either use my Webboids models or I run any DAZ characters through my own custom Toon modifiers before using the modified Toons to generate stills and videos. The reason for the extra step of custom tooning my characters first is because I sometimes use the 2D characters to generate 3D models that I print; should I ever decide to share these 3D meshes, I'm comfortable knowing that nothing I convert to 3D retains any semblance of the original DAZ "shapes" and are free from any copyright issues.

  • TheMysteryIsThePointTheMysteryIsThePoint Posts: 3,321
    edited May 11

    You guys do know that you guys are calling a "LoRA" is already trained, for the specific model that it is meant to adjust, right? That using it with your reference images is not "training", but inference?

    Post edited by TheMysteryIsThePoint on
  • Richard HaseltineRichard Haseltine Posts: 110,173

    So: 

    • yes, you can use your renders as training material or input for AI (which is, as far as I can see, what you are doing in most cases)
    • no, you cannot use the 3D data as training material without a special license from Daz (nor the promo images, of course) 
  • csaacsaa Posts: 1,008
    edited May 11

    TheMysteryIsThePoint said:

    You guys do know that you guys are calling a "LoRA" is already trained, for the specific model that it is meant to adjust, right? That using it with your reference images is not "training", but inference?

    Yes, the discussion about "LoRA" and generative AI as 2D images is a red herring, I believe. Richard Haseltine clued us in to where the real value lies, and most likely what Daz is trying to market:

    no, you cannot use the 3D data as training material without a special license from Daz

    The race in tech nowadays is to develop autonomous systems that, from the get-go, woefully lack any concept of the real world, the 3D one we all live our lives. Tech companies are busy building digital twins of the real world, and it's here that Daz's "3D data as training material" comes into use. 

    Cheers!

    Post edited by csaa on
  • ArtiniArtini Posts: 10,674

    Richard Haseltine said:

    So: 

    • yes, you can use your renders as training material or input for AI (which is, as far as I can see, what you are doing in most cases)
    • no, you cannot use the 3D data as training material without a special license from Daz (nor the promo images, of course) 

    Thanks for the confirmation.

    I am sometimes editing/improving my renders with AI.

    Has not tried to use my renders as training material for AI, but maybe will try it at some point.

     

  • 3DIO3DIO Posts: 342

    Richard Haseltine said:

    So: 

    • yes, you can use your renders as training material or input for AI (which is, as far as I can see, what you are doing in most cases)
    • no, you cannot use the 3D data as training material without a special license from Daz (nor the promo images, of course) 

     What a relief, and thanks for the confirmation, it's much appreciated.

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,879

    yes, thanks for this yes

    I really don't use my renders for  training (or whatever the correct term actually is) the software I use is actually called One Trainer BTW, for the simple reason I want realistic LoRas not ones that look like 3D renders

    Renders are the target not the source

    biut this is still good to know as an option if needed

Sign In or Register to comment.