Remixing your art with AI

13233353738

Comments

  • edited July 25

    wsterdan said:

    Wow, lots of stuff happening here, love the soundtrack.

    How long are the clips you generate? Most of the video generators I've been looking at only make 15- or 30-second clips.

    4 seconds, I queue them usually 30 videos in one go

    121 frames 30fps takes 25mins on my PC 1280x730 pixels and 2X upscaling  

    its considerably faster than rendering the images I animate, in DAZ studio 

    I simply do poses along the timeline in D|S with some camera movement

    a different pose each second and render a series 30 of them with the default timeline 

    the fps is irrelevant 

    playing it back would look ridiculous but that's not the intention as I am actually letting the AI decide how to get from one pose to the next over 121 frames

    the AI also adds camera movement whether I want it or not, if I don't have any it's actually worse

    adding subtle movement between my frames reigns it in a bit

    Oh, i thought you were doing first frame last frame renders in daz to import into ai. Letting the ai do the movie render. But just that thought of 1st and last from Daz blew my mind. It's what i do when i make ai movie clips... it just didn't occure to me to do the same here with Daz. Seriously blew my mind :)
    Post edited by Barefoot Upto My Soul on
  • Top in daz of V3 Emilie and the bottom where i put her in the subway metro with backlighting. Rendered in Gemini Nano Banana ai free. Added headphones too.
    how_many_fingers_am_i_holding_up__by_barefootuptomysoul_def2c5m.jpg
    1920 x 1080 - 146K
    int__subway_metro_platform___rush_hour_by_barefootuptomysoul_dmg27oi.png
    1364 x 768 - 1M
  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389
    edited July 25

    Barefoot Upto My Soul I do both

    added my other videos separating AI and 3D on other page

    this thread moves faster than I can upload cheeky

    thanks wsterdan

    Post edited by WendyLuvsCatz on
  • Was having fun putting my friend in a daz scene via ai. i hope i am not spamming this board thread.
    3b9d096c438a44fda71d717984d67664.jpg
    1936 x 1080 - 466K
    d066832471a74ff3b3b9ef34d91e214d.jpg
    1080 x 1080 - 214K
    713cda10299d4cb0ab9fbb37e36cd9f0.jpg
    1080 x 1080 - 213K
    59f120b84ee04898a0f79e548169699e.jpg
    1080 x 1080 - 209K
  • csaacsaa Posts: 1,066
    edited July 25

    Barefoot Upto My Soul said:

    ... via ai. i hope i am not spamming this board thread.

    For all its worth, keep this in mind: good signal to noise ratio. The life (or death) of a forum discussion hinges on that. May the thought spread throughout the four corners of the world, and echo down the ages. laugh

    Cheers!

    Post edited by csaa on
  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389

    ooops, I didn't mean the comment about the thread moving fast in that way at all

  • 3DIO3DIO Posts: 552
    edited July 25

    WendyLuvsCatz said:

    am going to upload fully AI animated renders to my AI channel next and fully 3D CGI ones to my main

    I watch a lot of your videso since I'm always curious how the AI interprets the renders and animations you feed it.  I'm surprised, though, that you never make split-screen viideos where the original animation (or sequence of images) is playing on the left of the screen, while the AI interpretation of it is playing (in sync) on the right.

     

    Post edited by 3DIO on
  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389
    edited July 25

    3DIO said:

    WendyLuvsCatz said:

    am going to upload fully AI animated renders to my AI channel next and fully 3D CGI ones to my main

    I watch a lot of your videso since I'm always curious how the AI interprets the renders and animations you feed it.  I'm surprised, though, that you never make split-screen viideos where the original animation (or sequence of images) is playing on the left of the screen, while the AI interpretation of it is playing (in sync) on the right.

     

    not particularly interested in doing tutorials

    I just do this for fun 

    there are actual talented people who can do that stuff and explain it all, and do

    Post edited by WendyLuvsCatz on
  • 3DIO3DIO Posts: 552
    edited July 26

    Barefoot Upto My Soul said:

    Was having fun putting my friend in a daz scene via ai.

    Not too keen on that first one since it has a 'carboard cutout' vibe to it, but I think the second one looks great!  Really makes me look forward to playing around with this stuff!  The possibilities are infinite.  Crazy stuff, we live in scary but nevertheless amazing times for sure!

     

    Post edited by 3DIO on
  • 3DIO3DIO Posts: 552

    WendyLuvsCatz said:

    there are actual talented people who can do that stuff and explain it all, and do

    There's mainly two AI channels I watch on YouTube, and good as they are, neither of them do such a thing.  I don't recall I've seen any channel that specifically does that sort of thing.  For anyone thnking of a novel YouTube channel, I reckon doing such a thing would prove very popular!

    Basically a no-nonsense, zero-yapping, side-by-side for every video uploaded.  I'd bookmark such a channel in a heartbeat!

     

  • Okay animated the three images as first last and extend video to first last. Added some sound. Left out the cardboard wide image so aspect ratio remains square.

    Here it is on my DeviantArt gallery. https://www.deviantart.com/barefootuptomysoul/art/EXT-CYBERPUNK-CITY-DAY-1360530219

  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389

    smooth yes

  • smooth yes

    Thank you :)

    i hope you don't mind that i added you to my watch list. Seeing you and the others here on DeviantArt makes it feel less lonely there. Lots of cool renders everyone is posting there.

  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389

    Barefoot Upto My Soul said:

    WendyLuvsCatz said:

    smooth yes

    Thank you :)


    i hope you don't mind that i added you to my watch list. Seeing you and the others here on DeviantArt makes it feel less lonely there. Lots of cool renders everyone is posting there.

     

    I don't mind but I never go there, not uploaded anything in years

    YouTube is my platform  

  • 3DIO3DIO Posts: 552
    edited July 26

    Barefoot Upto My Soul said:

    Okay animated the three images as first last and extend video to first last. Added some sound. Left out the cardboard wide image so aspect ratio remains square.

    Here it is on my DeviantArt gallery. https://www.deviantart.com/barefootuptomysoul/art/EXT-CYBERPUNK-CITY-DAY-1360530219
     

    Can't remember the name of it now. but there's an AI product for ComyUI that allows you to control the ease-in, ease-out and paths for animations like that.  It had a limit of five seconds per take due to memory requirements, but it worked extremely well.

    Post edited by 3DIO on
  • 3DIO said:

    Barefoot Upto My Soul said:

    Okay animated the three images as first last and extend video to first last. Added some sound. Left out the cardboard wide image so aspect ratio remains square.

    Here it is on my DeviantArt gallery. https://www.deviantart.com/barefootuptomysoul/art/EXT-CYBERPUNK-CITY-DAY-1360530219
     

    Can't remember the name of it now. but there's an AI product for ComyUI that allows you to control the ease-in, ease-out and paths for animations like that.  It had a limit of five seconds per take due to memory requirements, but it worked extremely well.

    Any of these perhaps? It sounds like you're thinking of DragNUWA or the CameraCtrl / Wan-Move (Wan ATI) nodes for ComfyUI.

    ​Here are the main custom node suites that fit that exact description:

    ​DragNUWA / MotionCtrl: Uses drawn path trajectories with point-level motion control. It is famous for strict 5-second (around 16–24 fps) generation limits per take due to video diffusion memory constraints. ​ComfyUI-Keyframed (or FizzNodes): Provides explicit math-based curve interpolation like ease_in, ease_out, sine_wave, and exp_decay across motion vectors and prompts. ​FL_PathAnimator / Wan ATI Trajectory Control: A visual path editor node in ComfyUI that lets you draw keyframe paths and bezier curves directly on the frame canvas for object movement.

    ​DragNUWA is usually the top one people misplace by name when talking about drawn motion paths and that tight 5-second take limit!

  • Sometimes it's a real bitch slap getting the ai to render an image the way i want it. So i have to say close enough and just go to sleep for the night. These were putting my friend and me into a daz scene.
    int__cyberpunk_store___night_by_barefootuptomysoul_dm7rec1.jpg
    2176 x 1080 - 589K
    ext__aurora_resto_bar___afternoon_by_barefootuptomysoul_dm8g4re.png
    880 x 1210 - 2M
  • 3DIO3DIO Posts: 552
    edited July 27

    Barefoot Upto My Soul said:

    Any of these perhaps? It sounds like you're thinking of DragNUWA or the CameraCtrl / Wan-Move (Wan ATI) nodes for ComfyUI.

    ​Here are the main custom node suites that fit that exact description:

    ​DragNUWA / MotionCtrl: Uses drawn path trajectories with point-level motion control. It is famous for strict 5-second (around 16–24 fps) generation limits per take due to video diffusion memory constraints. ​ComfyUI-Keyframed (or FizzNodes): Provides explicit math-based curve interpolation like ease_in, ease_out, sine_wave, and exp_decay across motion vectors and prompts. ​FL_PathAnimator / Wan ATI Trajectory Control: A visual path editor node in ComfyUI that lets you draw keyframe paths and bezier curves directly on the frame canvas for object movement.

    ​DragNUWA is usually the top one people misplace by name when talking about drawn motion paths and that tight 5-second take limit!

    Thery're not the one I saw, but thanks for pointing them out, I hadn't seen those although I've seen similar.  In the one I meant, I believe the five second limit was due to memory on account it was capable of remembering what was outside the scene as well as what was in it (something to do with continuity when moving stuff in and out of view of the camera).  That said, it seems things have come-on leaps and bounds since then and they probably all do that now.

    Post edited by 3DIO on
  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389

    this was too long for my Tycath channel without YouTube verification 

    so having to break up the 3 tunes into a playlist instead 

    My Madcatlady subscribers hate AI so will get heaps of dislikes and some will unsubscribe cheeky

  • csaacsaa Posts: 1,066

    WendyLuvsCatz said:

    My Madcatlady subscribers hate AI so will get heaps of dislikes and some will unsubscribe cheeky

    WendyLuvsCatz,

    There'll always be nay-sayers. wink

    It is not the critic who counts; not the man who points out how the strong man stumbles, or where the doer of deeds could have done them better. The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood; who strives valiantly; who errs, who comes short again and again, because there is no effort without error and shortcoming; but who does actually strive to do the deeds; who knows great enthusiasms, the great devotions; who spends himself in a worthy cause; who at the best knows in the end the triumph of high achievement, and who at the worst, if he fails, at least fails while daring greatly, so that his place shall never be with those cold and timid souls who neither know victory nor defeat.

     Cheers!

  • algovincianalgovincian Posts: 2,694

    Always interesting to see how people are using img2img AI with their DS renders as input!

    Personally, I view post processing as a second stage of rendering, with DS/Iray being the first. This has always included (and still does) traditional 2D image editing like more dynamic, perceptual tone-mapping of 32-bit HDR renders, scripted actions in pShop, etc. And now, for me, img2img AI processing has been integrated as another tool in the process.

    The first example shows how an Iray render can be enhanced. In this case, the scene was lit with just sun/sky and a couple of light blocking planes. Also, a backdrop was used as opposed to a full environment.

    In this case, the original render was 800x1040 and only cooked for 400 iterations. This took 79 seconds to render on a 5060ti. The Post Denoiser was used as it would have been very noisy after only 400 iterations without it. The output from the AI was 1264x1648 (resized to 800x1040 for the comparison).

    As somebody pointed out, AI can be used to improve lighting, but it can be used to do so much more than that. In addition to enhancing the lighting, the resolution was also increased. Perhaps most importantly, the softness introduced by the post denoiser in DS was counteracted. Check out how much more detail the skin has, and how much better the hair looks.

    So more pixels, more detail and better lighting. All this happened locally on the same machine running a 5060ti in 25 seconds. Original DS render on top:

    I've spent literally years messing with this stuff designing workflows, running batches upon batches of images every night only to rinse & repeat again. It's always a competition between enhancing the image vs. staying true to the original source. I think in this case the resulting image has better lighting and more detail - all while remaining true to the original composition. It was much faster than cooking a higher res Iray render for thousands of iterations, too.

    Img2img AI can also be used to turn renders into digital paintings, ink drawing, watercolors, etc. The same trade-offs and considerations exist. I fear I've written way too much already, so I won't bore you all with the details this time. Original render on top, then a digital painting style, followed by some black & white linework, and finally a watercolor-ish storybook style:

    Sorry for the book! lol

    Please keep all the img2img examples coming!

    - Greg

     

  • Always interesting to see how people are using img2img AI with their DS renders as input!

    Sorry for the book! lol

    Please keep all the img2img examples coming!

    - Greg

     

    Every render style you did turned out beautiful. i am jealous :)
  • WendyLuvsCatzWendyLuvsCatz Posts: 41,389

    I like both the originals and AI results

  • Robert FreiseRobert Freise Posts: 4,694

    Very nice

  • ArtiniArtini Posts: 10,846

    Great looking images,  @algovincian

     

  • algovincianalgovincian Posts: 2,694

    Thanks. I feel that DS and img2img AI are a useful combo. IMHO, the things that make DS fun for users (composition, framing, character/clothing/hair design choices, posing, etc.) are still reflected in the end result and require the same skill to create.

    For existing DS users, img2img AI processing speeds up the render generation process, enhances the output, and increases resolution.

    For those coming from an AI image generation perspective, DS provides a way to exercise much greater control. 

    - Greg

  • 3DIO3DIO Posts: 552
    edited July 30

    algovincian said:

    For those coming from an AI image generation perspective, DS provides a way to exercise much greater control. 

    That's exactly how I see Daz Studio now that we have AI.  I think it makes a great roughing-out tool for stills and animation, and I think the closer you can get the original to how you want it to look, the better the result will be since you can use tighter adherance to the original.

    This highlights something positive about AI.  Because while people often complain (myself included) that others are creating stuff they otherwise wouldn't have the skill to create, there still is a benefit to being skilled in traditional process, since that skill will allow you to 'creatively drive' or 'conduct' AI in the right direction by using a much tighter adherence to your orignal.  In other words, I think these came out great because the result is very much what you had in your minds eye.

    We kinda know this by default due to how close the AI versions are to your original image, and that's a good thing since it means you were far more in control of the output than the AI, and only in those circumstances, can anyone still claim to be the artist when using AI (IMHO).

    I don't see AI as being "The Artist" in these examples, so to me, that's definitely a positive.

     

    Post edited by 3DIO on
  • Griffin AvidGriffin Avid Posts: 3,874
    edited July 30

    I animated the cover of my Daz-powered take on the Marvel Spider-Man character and story.

    It's the Dynamic Spider-Man Plus

    Post edited by Griffin Avid on
  • algovincianalgovincian Posts: 2,694

    Griffin Avid said:

    I animated the cover of my Daz-powered take on the Marvel Spider-Man character and story.

    It's the Dynamic Spider-Man Plus

    Cool animation! The flares add a lot.

    - Greg 

  • wsterdanwsterdan Posts: 3,543

    3DIO said:

    Because while people often complain (myself included) that others are creating stuff they otherwise wouldn't have the skill to create…

    Just as an amusing point of reference, for over a decade that's exactly what "real 3D artists and modelers" at other sites said about people using DAZ 3D and DAZ assets.

     

Sign In or Register to comment.