Remixing your art with AI

11920212224

Comments

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    looks like this is becoming my render thread cheeky

     

    half the animations are Ai, all the backgrounds are but the very short repeated DAZ ones are mostly because of the highly explosive Dforce cloth, could only do about 50 frames

    but repeated it from a few angles and this single character png series was very heavy to render

    Ai was much faster

    I reused it against different backgrounds in different positions animating the layer size and position 

  • ArtiniArtini Posts: 10,284

    Nice video and great composition, @WendyLuvsCatz

    You included many type of movements of the character and the clothes.

    I like it.

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    thanks Artini

  • DiomedeDiomede Posts: 15,388

    Came by to check on your thread, Wendy (haha).  You did not disappoint.  Love your King of the Dead music video.

    My computer died, so in replacing it and reinstalling software I intend to prioritize mixing 3D with AI.  I invite suggestions from everyone on 'must haves.'

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited August 7

    Diomede said:

    Came by to check on your thread, Wendy (haha).  You did not disappoint.  Love your King of the Dead music video.

    My computer died, so in replacing it and reinstalling software I intend to prioritize mixing 3D with AI.  I invite suggestions from everyone on 'must haves.'

    as much Nvidia VRAM as you can get your hands on basically for Ai

    Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions both beyond my hardware limitations 

    you didn't have your renderbeast for very long, I hope some things salvageable 

    Post edited by WendyLuvsCatz on
  • DiomedeDiomede Posts: 15,388

    Sadly, just 6 or 7 years for the render beast.  The local seller is accepting the old equipment as a trade in and is knocking off a few hundred dollars from the price.  I was just making some progress trying to learn some AI when the beast busted.  :(

  • ArtiniArtini Posts: 10,284

    Unfortunately such things happens.

    My Nvidia graphics card RTX 2080 just died after 5 and half years.

    I have no funds to buy a new card, so I have bought a Lenovo laptop during last year's Black Friday sales.

     

  • DiomedeDiomede Posts: 15,388

    Artini said:

    Unfortunately such things happens.

    My Nvidia graphics card RTX 2080 just died after 5 and half years.

    I have no funds to buy a new card, so I have bought a Lenovo laptop during last year's Black Friday sales.

    Sorry about your woes.  Yes, these things happen.  By now I expect it so I was good about backing things up.  Will see what slipped through the cracks.

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    it happens sadly, I lost lots of stuff when my drives died a couple years ago, 5TB or more of stuff crying

  • DiomedeDiomede Posts: 15,388

    WendyLuvsCatz said:

    Diomede said:

    Came by to check on your thread, Wendy (haha).  You did not disappoint.  Love your King of the Dead music video.

    My computer died, so in replacing it and reinstalling software I intend to prioritize mixing 3D with AI.  I invite suggestions from everyone on 'must haves.'

    as much Nvidia VRAM as you can get your hands on basically for Ai

    Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions both beyond my hardware limitations 

    you didn't have your renderbeast for very long, I hope some things salvageable 

    I had done exactly 2 Wan videos before the computer death throws.  One spilling a coffee cup for which I used only verbal prompts.  And another of a person putting an item on a small ramp on a table top and watching it slide down.  I used 2 Carrara renders as part of the slide video workflow, choosing the AI Wan template in which you submit the first image and the last.  The difference is that I used the depth maps to generate an AI first image and an AI second image, then had Wan calculate the tweeners.  Both of my attempts 'sucked' as stand alones.  But as proof of concept I was pretty happy with them. 

    I haven't been using LLMs very much until two weeks ago.  I had just downloaded Ollama's llava model for local use when the crash occurred.  Only submitted a couple prompts as tests.

    Do you have a preferred LLM for local use?  

  • DiomedeDiomede Posts: 15,388

    WendyLuvsCatz said:

    it happens sadly, I lost lots of stuff when my drives died a couple years ago, 5TB or more of stuff crying

    Oh no!!!  In a previous computer death I lost a lot of stuff related to my profession.  Not directly for clients, more like notes to myself on how I did things.  Now that I am retired, my stuff is more important to me.  smiley

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited August 8

    Diomede said:

    WendyLuvsCatz said:

    it happens sadly, I lost lots of stuff when my drives died a couple years ago, 5TB or more of stuff crying

    Oh no!!!  In a previous computer death I lost a lot of stuff related to my profession.  Not directly for clients, more like notes to myself on how I did things.  Now that I am retired, my stuff is more important to me.  smiley

    most of my Unreal, Twinmotion and iClone scenes from the time (done new ones since) and literally most of my third party3D content fom other places not for DAZ, Poser, Carrara or iClone namely heaps and heaps of obj files, tutorials etc

    sadly it wrecked all functionality of the DAZ to Unreal plugin too 

    I am slowly replacing it all as much still out there on the web, fortunately no Carrara files lost yes

    Post edited by WendyLuvsCatz on
  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Diomede said:

    WendyLuvsCatz said:

    Diomede said:

    Came by to check on your thread, Wendy (haha).  You did not disappoint.  Love your King of the Dead music video.

    My computer died, so in replacing it and reinstalling software I intend to prioritize mixing 3D with AI.  I invite suggestions from everyone on 'must haves.'

    as much Nvidia VRAM as you can get your hands on basically for Ai

    Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions both beyond my hardware limitations 

    you didn't have your renderbeast for very long, I hope some things salvageable 

    I had done exactly 2 Wan videos before the computer death throws.  One spilling a coffee cup for which I used only verbal prompts.  And another of a person putting an item on a small ramp on a table top and watching it slide down.  I used 2 Carrara renders as part of the slide video workflow, choosing the AI Wan template in which you submit the first image and the last.  The difference is that I used the depth maps to generate an AI first image and an AI second image, then had Wan calculate the tweeners.  Both of my attempts 'sucked' as stand alones.  But as proof of concept I was pretty happy with them. 

    I haven't been using LLMs very much until two weeks ago.  I had just downloaded Ollama's llava model for local use when the crash occurred.  Only submitted a couple prompts as tests.

    Do you have a preferred LLM for local use?  

    I don't think I have sufficient memory for the new one, I ran Llama before in Jan, but it stopped working 

    I hope the LLM didn't kill your PC

    surely your graphics card or something survived unless you are after a bigger one

    that is actually the main thing to spend on and sufficient power (not running one crippled by undervolting like me)

    Carrara and Ai have different demands and you don't have to try and do it in one computer

    my Ryzen3 is very CPU poor so no much good for Carrara native for example  hence I use Octane 

    you can probably pick up a secondhand PC for Carrara that is more CPU intensive and lacking in graphics 

    and a CPU poor one with lots of RAM and VRAM which is basically what I have (32GB RAM  11GB VRAM) but a weak CPU)

  • DiomedeDiomede Posts: 15,388

    WendyLuvsCatz said:

    Diomede said:

    WendyLuvsCatz said:

    Diomede said:

    Came by to check on your thread, Wendy (haha).  You did not disappoint.  Love your King of the Dead music video.

    My computer died, so in replacing it and reinstalling software I intend to prioritize mixing 3D with AI.  I invite suggestions from everyone on 'must haves.'

    as much Nvidia VRAM as you can get your hands on basically for Ai

    Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions both beyond my hardware limitations 

    you didn't have your renderbeast for very long, I hope some things salvageable 

    I had done exactly 2 Wan videos before the computer death throws.  One spilling a coffee cup for which I used only verbal prompts.  And another of a person putting an item on a small ramp on a table top and watching it slide down.  I used 2 Carrara renders as part of the slide video workflow, choosing the AI Wan template in which you submit the first image and the last.  The difference is that I used the depth maps to generate an AI first image and an AI second image, then had Wan calculate the tweeners.  Both of my attempts 'sucked' as stand alones.  But as proof of concept I was pretty happy with them. 

    I haven't been using LLMs very much until two weeks ago.  I had just downloaded Ollama's llava model for local use when the crash occurred.  Only submitted a couple prompts as tests.

    Do you have a preferred LLM for local use?  

    I don't think I have sufficient memory for the new one, I ran Llama before in Jan, but it stopped working 

    I hope the LLM didn't kill your PC

    surely your graphics card or something survived unless you are after a bigger one

    that is actually the main thing to spend on and sufficient power (not running one crippled by undervolting like me)

    Carrara and Ai have different demands and you don't have to try and do it in one computer

    my Ryzen3 is very CPU poor so no much good for Carrara native for example  hence I use Octane 

    you can probably pick up a secondhand PC for Carrara that is more CPU intensive and lacking in graphics 

    and a CPU poor one with lots of RAM and VRAM which is basically what I have (32GB RAM  11GB VRAM) but a weak CPU)

    Push come to shove, I can still use my old laptop for Carrara.  As I thought would happen, I have been drifting toward Blender one action at a time.  Even so, one of my favorite things about Carrara is rendering to a depth pass in PNG format that is easy to adapt (simple inversion).  Daz Studio's depth canvas and Blender's Mist render are in exr format and require more fiddling.  Another great thing is Philemo's strand hair to mesh plugin.  I love being able to have the two versions match!

    Thanks for the warning about Ollama.  One of my intended uses was to have it be part of a work flow to create LORA's for my Brash and Moxie characters, major settings/props, and the style.  I saw a workflow for LORA creation that uses an image to text analysis to generate the captions for the images being LORA-tized.  They used Ollama's llava model.  Would love to create LORA's for my space adventurers and then use WAN or whatever to calculate the tweeners for animations, especially directing with Carrara depth maps for the keyframes.

  • DiomedeDiomede Posts: 15,388

    WendyLuvsCatz said:

    Diomede said:

    WendyLuvsCatz said:

    Diomede said:

    ...My computer died, so ...

    as much Nvidia VRAM as you can get your hands on basically for Ai

    ...Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions

    ... I haven't been using LLMs very much until two weeks ago.  I had just downloaded Ollama's llava model for local use when the crash occurred.  Only submitted a couple prompts as tests...

    I don't think I have sufficient memory for the new one, I ran Llama before in Jan, but it stopped working 

    I hope the LLM didn't kill your PC...

    You are wise, Wendy.  A tech person told me my computer death was probably due to my particular use of the LLM in a comfyui node.  When I told him what I was trying to do, he actually said to me, 'Were you using this graphics card? And was it that years old? And...?'  He went on to describe my setup pretty accurately.  Apparently, the hardware side of the problem was a gradual degradation of the power supply, which the LLM spiked. He said the slow degredation is expected, and that the big problem can be headed off by replacing the power supply.  I understood about half of it, so I may have summarized it incorrectly, but that was the gist.  Very much aligns with what you said.

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Diomede said:

    WendyLuvsCatz said:

    Diomede said:

    WendyLuvsCatz said:

    Diomede said:

    ...My computer died, so ...

    as much Nvidia VRAM as you can get your hands on basically for Ai

    ...Wan2,2 out now and a LLM from OpenAi you can install locally no restrictions

    ... I haven't been using LLMs very much until two weeks ago.  I had just downloaded Ollama's llava model for local use when the crash occurred.  Only submitted a couple prompts as tests...

    I don't think I have sufficient memory for the new one, I ran Llama before in Jan, but it stopped working 

    I hope the LLM didn't kill your PC...

    You are wise, Wendy.  A tech person told me my computer death was probably due to my particular use of the LLM in a comfyui node.  When I told him what I was trying to do, he actually said to me, 'Were you using this graphics card? And was it that years old? And...?'  He went on to describe my setup pretty accurately.  Apparently, the hardware side of the problem was a gradual degradation of the power supply, which the LLM spiked. He said the slow degredation is expected, and that the big problem can be headed off by replacing the power supply.  I understood about half of it, so I may have summarized it incorrectly, but that was the gist.  Very much aligns with what you said.

    I actually undervolt my card using MSI afterburner because my PSU is not powerful enough and I cannot afford big electricity bills either

    I end the curve with a platau so the board never draws more than 200watts, mostly around 150 at most, 300 WILL crash my PC

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited September 19

    OK this is all Ai but LTX in the Pinokio Wan 2.1 app is the fastest Ai video animator I have used so far

    I finally got it working on fp16, it's BF16 but I found in the overall Pinokio settings I have to default to fp16 not let the app detect my hardware

    7mins a 4sec video on my PC (Wan2.2 takes over 4 hours) and you can in increments do up to 1800 frames apparently and it's 30fps albeit 480p on my PC with a 2080Ti

    I upscaled it in post which adds to the toony effect

    I think it would suit toony renders such as done by Diomede and yes, can use a start and finish image

    it would be lightning fast on a better PC than my potato, it uses CPU too and mine is a lousy Ryzen3 with fortunately 32GB RAM and it needs it

    Post edited by WendyLuvsCatz on
  • DiomedeDiomede Posts: 15,388

    Yay, looks great.  I have been slowly learning, too slow, on the 3D plus AI front.  Feel like I have finally made progress there.  Unfortunately, my next big hurdles are sound and the video editing software, neither of which I have spent much time with.  I hope to share a video combining 3D with AI here in the not too distant future.

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited September 19

    Diomede said:

    Yay, looks great.  I have been slowly learning, too slow, on the 3D plus AI front.  Feel like I have finally made progress there.  Unfortunately, my next big hurdles are sound and the video editing software, neither of which I have spent much time with.  I hope to share a video combining 3D with AI here in the not too distant future.

    I use the Blender video editor and Audacity but an older version of the latter, Audacity 2. Don't like the later Muse owned one at all which has questionable features. 

    Post edited by WendyLuvsCatz on
  • ArtiniArtini Posts: 10,284

    Looking great, @WendyLuvsCatz

    Great tip about Blender video editor. Need to finally find out how to use it.

    Probably will use AI to teach me.

    I did not know, that newer version of Audacity is so bad.

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Artini said:

    Looking great, @WendyLuvsCatz

    Great tip about Blender video editor. Need to finally find out how to use it.

    Probably will use AI to teach me.

    I did not know, that newer version of Audacity is so bad.

     

    apparently phones home but also doesn't have the same UI features I am used to or like my plugins  

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited September 28

    cycling between 7 DAZ studio renders using LTX Ai image to image

    Post edited by WendyLuvsCatz on
  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    well this is just weird ...

  • ArtiniArtini Posts: 10,284

    Nice kitties...

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999
    edited October 1

    changed this post to share a mixture of Ai animated 3D renders

    previous one is posted in the Carrara forum as not wanting to spam the forum with my renders cheeky

    Post edited by WendyLuvsCatz on
  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Ai animated Carrara 3D renders (yes shared there Carrara forum too, shoot me)

  • DiomedeDiomede Posts: 15,388

    These are great

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Diomede said:

    These are great

    thanks,

    I am doing more but they seem to be getting more random as to what the Ai does between rendered images as I proceed  cheeky

    some truly weird ones where continuing along a path should have been obvious 

  • ArtiniArtini Posts: 10,284

    Well made and interesting effects: fog, water and lights.

    I also like, how far planes appear on video, not like in my Unity animations,

    where vegetation begin to appear when one approach them from closer distance.

     

  • WendyLuvsCatzWendyLuvsCatz Posts: 39,999

    Ai is handy when I want to animate statue but they are reluctant cheeky

    Artini when it adds FX they look good but again it's stubborn. they were prompted everytime, pyrotechnics, magic power but absent in most

Sign In or Register to comment.