Remixing your art with AI

12526272830

Comments

  • csaacsaa Posts: 982

    wsterdan said:

    I'm not sure if this will help, but here's the same procedure shown above, but using Gemini for free. I upload the four images I need (interior cockpit render and three character guides) and give it the first prompt:

    wsterdan,

    Wow, thanks! That certainly helps. Let me see how far I can run with this.

    Cheers! 

  • wsterdanwsterdan Posts: 3,296
    edited April 4

    Nano Banana Pro (and Gemini) handles things this way as well; if I say, "redraw the image showing character xxx..." there's a chance background might be altered, but if I say, "show character xxx..." the background is usually intact.

    Because I like to do a lot of "bridge on a starship" type images (inspired by Trek) I've worked out a method to generate a single high-res image of the bridge and the main characters. Once that's done, I'll use that image as my starting point for bridge interations and advice NB Pro to "show the captain turning his head and talking to science" and I'll get an image of just those changes.

    The second part of my system – once the base image is set – is to name the characters and use those names going forward by copy/pasting the naming section.

    For example, here's an old Smay/Chibi verson of some Justice League members:

    I asked NB Pro to "redraw the characters in a modern, 2d animated film style;" and got this:

     

    Now, I name the characters and use the names to change *some* of their poses leaving the others intact:

    "For reference, the names of the characters can be used for instructions: the male character in green on the far left is "Hal"; the male character second from the left in red is "Barry"; the female in the centre is "Diana"; the fourth charcter from the left wearing grey an blue is "Bruce" and the character on the far frght is "Clark".

    With the five characters, show "Dianna", "Bruce" and "Clark" laughing at a joke; no word balloons"

    And get this:

     

    Then, have the other two changing while the first three remain intact:

     

    "For reference, the names of the characters can be used for instructions: the male character in green on the far left is "Hal"; the male character second from the left in red is "Barry"; the female in the centre is "Diana"; the fourth character from the left wearing grey and blue is "Bruce" and the character on the far right is "Clark".

    with the five characters, show "Hal", and "Barry" talking to each other;  no word balloons"

    and get this:

    Finally, to show that the backgrounds remain intact I make a very youth-oriented version of the guys sitting around a table in a futuristic meeting hall:

     

    and prompt: "

    For reference, the names of the characters can be used for instructions: the male character in green on the far left is "Hal"; the male character second from the left in red is "Barry"; the female in the centre is "Diana"; the fourth charcter from the left wearing grey an blue is "Bruce" and the character on the far right is "Clark".

    with the five characters, show "Dianna", "Bruce" and "Clark" laughing at a joke; no word balloons"

    and get this:

    You might notice that when some of the characters are asked to perform, the others might show slight reaction to them like eyes turning or slight smiles.

    Of note: I started to try this using Gemini but was told, "There are a lot of people I can help with, but I can't depict some public figures. Do you have anyone else in mind?", no doubt in response to trademarked characters like Clark, Bruce and Diana.

    00 Chibi JLA Final-Large.jpg
    1439 x 797 - 436K
    01 Base JLA 00.jpeg
    2528 x 1696 - 824K
    02 Three Laughing 01.jpeg
    2528 x 1696 - 893K
    03 Two Talking 01.jpeg
    2528 x 1696 - 1M
    04 Background 01.jpeg
    2528 x 1696 - 1020K
    05 Background 01.jpeg
    2528 x 1696 - 1M
    Post edited by frank0314 on
  • TugpsxTugpsx Posts: 852

    This is an awesome workflow. Thanks for sharing your adventures.

    I am a bit curious about compute cost per image, if i recall some NB images can be upto 0.15c /image. It may take a few images to get the right template so I was wondering how well this is adaptable. 

  • wsterdanwsterdan Posts: 3,296
    edited April 4

    Tugpsx said:

    This is an awesome workflow. Thanks for sharing your adventures.

    I am a bit curious about compute cost per image, if i recall some NB images can be upto 0.15c /image. It may take a few images to get the right template so I was wondering how well this is adaptable. 

    You can shop around as I think prices are all over the place, and they vary depending on whether you're subscribing monthly or annually. I just subscribed annually to OpenArt.ai for their "Infinity" level. It works out to $28 US a month for 24,000 credits ($28 a month is a small fraction of what I used to spend here); NB Pro costs 40 credits a render, so 600 renders a month with Pro, or 4.7¢ an image. If all you do is use Nano Banana Pro, that's 600 images a month, but there's ways to work around this. For example, I'm sometimes using Gemini (Nano Banana 2) a few times a day for free; this allows me to test ideas at no cost, and the quality is almost identical to Pro, so I'll often use the results as part of my final images.

    As well, with any subscription there's usually "add-ons". If I go overboard having waaaay too much fun and don't watch my credits, I might run out early (I'm a bad boy, no question) but if I have a ways to go to the end of the month, I can purchase additional add-on packs of 5,000 credits for $15 US.

    As well, I might run a few variations on my NB Pro version using the base Nano Banana; it's not as good, but it's only 15 credits per image instead of 40. The quality and consistency might not be as good, but often they're "good enough".

    At the end of the day, developing an efficient workflow should help bring costs down. I find that taking ten minutes to set up proxies in DAZ Studio for tricky scenes can save me a mess of trial-and-error NB Pro renders, for example. I'm sure there's many methods others use that I haven't thought of yet, it's still very much a learning process for me.

    Post edited by wsterdan on
  • TugpsxTugpsx Posts: 852

    wsterdan said:

    Tugpsx said:

    This is an awesome workflow. Thanks for sharing your adventures.

    I am a bit curious about compute cost per image, if i recall some NB images can be upto 0.15c /image. It may take a few images to get the right template so I was wondering how well this is adaptable. 

    You can shop around as I think prices are all over the place, and they vary depending on whether you're subscribing monthly or annually. I just subscribed to OpenArt.ai for their "Infinity" level. It works out to $28 US a month for 24,000 credits ($28 a month is a small fraction of what I used to spend here); NB Pro costs 40 credits a render, so 600 renders a month with Pro, or 4.7¢ an image. If all you do is use Nano Banana Pro, that's 600 images a month, but there's ways to work around this. For example, I'm sometimes using Gemini (Nano Banana 2) a few times a day for free; this allows me to test ideas at no cost, and the quality is almost identical to Pro, so I'll often use the results as part of my final images.

    As well, with any subscription there's usually "add-ons". If I go overboard having waaaay too much fun and don't watch my credits, I might run out early (I'm a bad boy, no question) but if I have a ways to go to the end of the month, I can purchase additional add-on packs of 5,000 credits for $15 US.

    As well, I might run a few variations on my NB Pro version using the base Nano Banana; it's not as good, but it's only 15 credits per image instead of 40. The quality and consistency might not be as good, but often they're "good enough".

    At the end of the day, developing an efficient workflow should help bring costs down. I find that taking ten minutes to set up proxies in DAZ Studio for tricky scenes can save me a mess of trial-and-error NB Pro renders, for example. I'm sure there's many methods others use that I haven't thought of yet, it's still very much a learning process for me.

    Thanks 

  • TugpsxTugpsx Posts: 852

    Dartanbeck has been busy with an awesome project of Using Daz Study with ComfyUI 2026 remixing art with AI. Check it out over at YouTube. 

  • wsterdanwsterdan Posts: 3,296

    Tugpsx said:

    Dartanbeck has been busy with an awesome project of Using Daz Study with ComfyUI 2026 remixing art with AI. Check it out over at YouTube. 

    Will do, thanks!

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,665

    another mixed media video

  • wsterdanwsterdan Posts: 3,296

    Wow, lots of stuff happening here, love the soundtrack.

    How long are the clips you generate? Most of the video generators I've been looking at only make 15- or 30-second clips.

  • wsterdanwsterdan Posts: 3,296
    edited April 7

    Quick toon remix of Luthbel's Cthulhu https://www.daz3d.com/cthulhu-rising and The Antfarm's Never Dry https://www.daz3d.com/neverdry.

    image_Pf3CjEUm_1775515021314_raw.jpg
    1200 x 896 - 979K
    Post edited by wsterdan on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,665
    edited April 7

    wsterdan said:

    Wow, lots of stuff happening here, love the soundtrack.

    How long are the clips you generate? Most of the video generators I've been looking at only make 15- or 30-second clips.

    4 seconds, I queue them usually 30 videos in one go

    121 frames 30fps takes 25mins on my PC 1280x730 pixels and 2X upscaling  

    its considerably faster than rendering the images I animate, in DAZ studio 

    I simply do poses along the timeline in D|S with some camera movement

    a different pose each second and render a series 30 of them with the default timeline 

    the fps is irrelevant 

    playing it back would look ridiculous but that's not the intention as I am actually letting the AI decide how to get from one pose to the next over 121 frames

    the AI also adds camera movement whether I want it or not, if I don't have any it's actually worse

    adding subtle movement between my frames reigns it in a bit

    Post edited by WendyLuvsCatz on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,665

    wsterdan said:

    Quick toon remix of Luthbel's Cthulhu https://www.daz3d.com/cthulhu-rising and The Antfarm's Never Dry https://www.daz3d.com/neverdry.

     

    OMG, now I want to see how the AI animates Cthulhu's tentacles  

  • wsterdanwsterdan Posts: 3,296

    WendyLuvsCatz said:

    wsterdan said:

    Wow, lots of stuff happening here, love the soundtrack.

    How long are the clips you generate? Most of the video generators I've been looking at only make 15- or 30-second clips.

    4 seconds, I queue them usually 30 videos in one go

    121 frames 30fps takes 25mins on my PC 1280x730 pixels and 2X upscaling  

    its considerably faster than rendering the images I animate, in DAZ studio 

    I simply do poses along the timeline in D|S with some camera movement

    a different pose each second and render a series 30 of them with the default timeline 

    the fps is irrelevant 

    playing it back would look ridiculous but that's not the intention as I am actually letting the AI decide how to get from one pose to the next over 121 frames

    the AI also adds camera movement whether I want it or not, if I don't have any it's actually worse

    adding subtle movement between my frames reigns it in a bit

    Thanks very much for the valuable info, much appreciated. I've been avoiding AI-base animation so far (only because I'm enjoing toon stills so much), but I know I'll eventually have to give it a go. 

  • TugpsxTugpsx Posts: 852

    WendyLuvsCatz said:

    another mixed media video

    Wow that turned out great. Lots of potential thanks for sharing.  

  • EthinEthin Posts: 1,325

    Some AI conversions.

    My OC.

    AI reimagine.

     

    My OC.

    AI reimagine.

     

    My OC.

    AI reimagine.

     

  • wsterdanwsterdan Posts: 3,296

    Totally wild and totally awesome! I love 'em!

    Thanks for sharing, it's always a blast to see creative people being creative!

  • EthinEthin Posts: 1,325
    edited April 11

    I spent an hour or so going back and forth between Grok and Photoshop to create and refine the character, and then another hour or so to create and refine the backdrop with Grok and Photoshop. Composite and refinement of final image, all done in Photoshop.

    Had ChatGPT give me a basic prompt to build on. Animations were created on civitai's platform using Kling v2.5 Turbo.

     

    9u7gh97g79 04 copy.jpg
    1168 x 784 - 620K
    Post edited by Ethin on
  • wsterdanwsterdan Posts: 3,296

    Ethin said:

    I spent an hour or so going back and forth between Grok and Photoshop to create and refine the character, and then another hour or so to create and refine the backdrop with Grok and Photoshop. Composite and refinement of final image, all done in Photoshop.

    Had ChatGPT give me a basic prompt to build on. Animations were created on civitai's platform using Kling v2.5 Turbo.

    Fun stuff! Looking forward to seeing more. 

  • EthinEthin Posts: 1,325

    wsterdan said:

    Totally wild and totally awesome! I love 'em!

    Thanks for sharing, it's always a blast to see creative people being creative!

    wsterdan said:

    Fun stuff! Looking forward to seeing more. 

    Thanks! Your more than welcome. 

  • EthinEthin Posts: 1,325
    edited April 14

    .

    Terra VT Ref.jpg
    2590 x 2800 - 910K
    Terra VT Tpose 03.jpg
    976 x 1056 - 197K
    Terra VT Character Shot 01.jpg
    976 x 1056 - 180K
    Terra VT Character Shot 01b AIcomp02.jpg
    1248 x 832 - 403K
    Post edited by Ethin on
  • EthinEthin Posts: 1,325
    edited April 14

    .

    Terra 2021 test 02 AI post3.jpg
    960 x 1280 - 667K
    Terra VT Tpose Cowboy 01.jpg
    976 x 1056 - 173K
    Terra VT Cowboy posed 01.jpg
    976 x 1056 - 176K
    Terra VT Cowboy AIcompFin 01.jpg
    1248 x 832 - 316K
    Post edited by Ethin on
  • wsterdanwsterdan Posts: 3,296

    Fun stuff, Ethin! Very cute, looks like you're having a blast!

  • GreybroGreybro Posts: 2,622

    I am really enjoying these. This so much the way I think hobby art is going. I'd love to see DS find a way to stay in the mix because, A. I've spent years learning it and B. It really offers a leg up on specificity given the depth of the products library.

  • wsterdanwsterdan Posts: 3,296
    edited April 14

    Greybro said:

    I am really enjoying these. This so much the way I think hobby art is going. I'd love to see DS find a way to stay in the mix because, A. I've spent years learning it and B. It really offers a leg up on specificity given the depth of the products library.

    I agree 100%. I mean, generate a starting frame and an ending frame, then telll your AI to animate from start to finish, with or without lip sync, for one example. 

    The amazing thing is that despite what we can do today, it really feels like it's just the beginning... 

    Post edited by wsterdan on
  • GreybroGreybro Posts: 2,622

    wsterdan said:

    Greybro said:

    I am really enjoying these. This so much the way I think hobby art is going. I'd love to see DS find a way to stay in the mix because, A. I've spent years learning it and B. It really offers a leg up on specificity given the depth of the products library.

    I agree 100%. I mean, generate a starting frame and an ending frame, then telll your AI to animate from start to finish, with or without lip syn, for one example. 

    The amazing thing is that despite what we can do today, it really feels like it's just the beginning... 

    Absolutely. Can't wait to see where this goes.
  • 3DIO3DIO Posts: 134
    edited April 14

    Just thought you AI users might be interested to know that DaVinci Resolve/Studio 21 just dropped, and that it has a bunch of AI stuff added to it.  To an extent it uses something similar to what I've seen in this thread, since you can change, train, or generate voices, and even edit the features of people's faces.

    There's also a new AI-based focus system which looks very sophisticated, and all of this done locally on your computer.  I'm not sure how much of the functionality is included in the free version, but for the full Studio version (which I highly recommend), then of course you'll get every feature available.

    As far as I can tell, a lot of this stuff can be done live to a still or moving image, and they've added a photo mode incorporating a darkroom RAW processor as well :


     

    Post edited by 3DIO on
  • WendyLuvsCatzWendyLuvsCatz Posts: 40,665

    the DAZ Studio pose sequence is really a series of dforce animated drapes, I mostly only render the posed frames for AI animation.,as you can see, the cloth drapes poorly, hence my using AI.
    It also took many more hours to render.

  • wsterdanwsterdan Posts: 3,296

    WendyLuvsCatz said:

    the DAZ Studio pose sequence is really a series of dforce animated drapes, I mostly only render the posed frames for AI animation.,as you can see, the cloth drapes poorly, hence my using AI.
    It also took many more hours to render.

    I thought both parts were pretty impressive, but I can only imagine how long the DAZ renders took when compared to the AI. I just don't have a good eye for it or maybe because it was in constant motion, but I thought the cloth draped fairly well. I guess I was watching the dance and just not concentrating on the cloth sim.

    It was nice to see the comparison, thanks for sharing!

  • WendyLuvsCatzWendyLuvsCatz Posts: 40,665
    edited April 16

    wsterdan said:

    WendyLuvsCatz said:

    the DAZ Studio pose sequence is really a series of dforce animated drapes, I mostly only render the posed frames for AI animation.,as you can see, the cloth drapes poorly, hence my using AI.
    It also took many more hours to render.

    I thought both parts were pretty impressive, but I can only imagine how long the DAZ renders took when compared to the AI. I just don't have a good eye for it or maybe because it was in constant motion, but I thought the cloth draped fairly well. I guess I was watching the dance and just not concentrating on the cloth sim.

    It was nice to see the comparison, thanks for sharing!

    she doesn't dance at all in the cloth sim and I obviously skipped any frames where it pulled and stuck, instead of the actual keyframed posed one for those, I used an earlier or later unstuck draped one instead 

     

    this is just the DAZ render

     

    Post edited by WendyLuvsCatz on
  • 3DIO3DIO Posts: 134
    edited April 16

    It definitely does look far superior using the AI.  If I had to be critical, there were a couple of points in the video where I thought she could do with an exorcism due to the 360 head turn thing, but other than that, I thought it was pretty damn good, and couldn't fault the dynamics.

    I've been quietly learning to use AI through watching videos on how to use Comfy UI running local, open source AI tools.  Haven't actually knuckled down and tried it yet since I'm on AMD and I get the impression from most videos that it's just expected to have an Nvidia card for this stuff.  But if I ever do get an Nvida card, I will definitely have a play with the open source stuff.

     

    Post edited by 3DIO on
Sign In or Register to comment.