soundwaves and py Carrara

th3Digitth3Digit Posts: 16,621
edited December 1969 in Carrara Discussion

is there a script I can use in this py Carrara thing that will use soundwaves to drive stuff?
I can create NLA clips using morphs, translations etc and use the mimic plugin to move things by assigning them to phonemes
but this is pretty random
I need something that reads pitch, volume and beat
tried to figure out Casual's mcjAudioMation and got more confused
most things seem to use only midi files, I basically want a waveform oscillator/battery type thing

«1

Comments

  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    I guess what I am trying to do is like animusic where events are driven by sound
    I have a midi player piano prop from Rendo that I can use fenrics erc with to make the key movements drive stuff I suppose,
    it uses a pz2 created from the midi track
    but
    my music I wish to use does not convert to midi very well
    pretty awful actually

    I have figured out Casual's script at least

    Post edited by th3Digit on
  • wetcircuitwetcircuit Posts: 0
    edited December 1969

    Can ERC control any aspect of the emiter?

    I guess you are looking for something called "python audio analysis" ...?

    Maybe this: http://www.blendernation.com/2007/03/31/audio-analysis-script-with-tutorial/

  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    thx Holly, will look
    can save my wav file spectrum as numerical values from Audacity I see
    need a spreadsheet program Ithink
    but actually got as far as making them x,y co-ordinates! by hand but did not know what to do with it!
    ctrl v into Carrara's formula thingy crashed it
    not surprised


    my video http://youtu.be/WnIP3G874a4 using mimic and morphs with physics
    not representative of anything but an interesting music player Battery effect!

    I did put it in my Blender python scripts but Blender leaves me baffled as ever!

    Post edited by th3Digit on
  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    interestingly my spreadsheet idea to generate a graph was not so dumb
    I have no spreadsheet software on my desktop
    (hence my inability to join that runtime render contest lol!)
    yes, I SHOULD grab open office (or find my old download from my laptop) or something
    but
    you can indead create 3D waterfall graphs apparently of sound
    I really want to use the data from the sound to do other things though
    like make pretty patterns in the shadertab using a mixer function for example
    hence formula, py carrara or fenric's erc as possibe ways to do this
    but
    how to get those audacity specrtum analysis numbers into a format Carrara can read?
    that is the question
    Casuals script works quite well for amplitude, in studio
    I can indeed make a sphere move to the music or Genesis's pectorals!!!
    cannot get it out into Carrara though, .duf, dae, fbx or any other export failed abysmally.

    after bumping into furniture and kicking the guide dog in Blender trying to figure out that script
    I found yet more to stress me
    http://cgcookie.com/blender/2011/06/02/building-an-audio-visualizer-in-python/
    noooooooooooo!
    do not wanna use Blender (runs back to Carrara screaming!)

    mm I wonder if something like this http://www.milkdrop.co.uk/downloads.htm captured and made into image sequences could drive something else using erc?

    Post edited by th3Digit on
  • 3drendero3drendero Posts: 925
    edited December 1969

    Recommend http://portableapps.com/
    To have easy access to all open source apps.
    Includes one click installation and start menu for blender, gimp, audacity, openoffice...

  • 3drendero3drendero Posts: 925
    edited December 1969

    Maybe there is something to learn from this scene?
    http://pycarrara.sourceforge.net/page6.html
    Or PM f1oat?

  • wetcircuitwetcircuit Posts: 0
    edited December 1969

    or Genesis's pectorals!!!

    I love you WENDY!!!! :P

  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    3drendero said:
    Maybe there is something to learn from this scene?
    http://pycarrara.sourceforge.net/page6.html
    Or PM f1oat?

    lol! Rendero! I have py carrara plugin and read Frederic's info already
    and it went straight over my little head housing a littler brain!
    hence asking on forum
    I need a readymade script to stick in, I cannot write one
    even if it just moves a sphere up and down to the music!

    can do the latter in studio using Casual's script btw
    I saw what Fredric (f1oat) did with his trumpet and fingers
    as I said, I have a midi piano figure from Rendo made for Poser and have indeed gotten objects to track the movements of its notes but only single ones, no way to switch to each active one for example.

    Audacity puts out two rows of numbers for frequency and amplitude, if there was some way to read these numbers or put them in a format Carrara understands an image series for example, I could use them in a mixer in the shader room, displacement or something.
    Fenric's erc plugin can drive stuff using shaders too, and leaves me just as baffled
    this is why a third party software that converts wav to a visualization would work maybe.
    an image series can be opened in the texture map diffuse channel and animate along the timeline, just shades of black white and grey needed.

  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    it is very early morning, I go back to work this arvo
    but Casual suggested this https://sites.google.com/site/mcasualsdazscripts2/mcjaudiomationtocarrara
    which I will try to find time to try (in bed on android at moment, it IS 4am!)

  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    ok, I post on the forum I swear so I can just work it out with help elsewhere (Casual on facebook) and share the results! lol!
    Casual's camera pz3 worked and I can use Fenric's ERC to drive the displacement in a shader with the transform of the linked object
    so got one very trippy syncronized to music video going
    I can save my instrument tracks seperately and do multiple animations I guess too
    idea is looking good so far http://www.youtube.com/watch?v=2EfCkXKSlrw
    hopefully a hand strumming a guitar can follow a baseline etc

    mooginess253.png
    1920 x 1080 - 1M
    mooginess000.png
    1920 x 1080 - 832K
    mooginess057.png
    1920 x 1080 - 1M
    Post edited by th3Digit on
  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    this is what audacity outputs for spectrum analysis
    if only I could use it for plotting somehow
    Frequency (Hz) Level (dB)
    344.531250 -20.797096
    689.062500 -26.637238
    1033.593750 -27.277124
    1378.125000 -30.515930
    1722.656250 -34.295086
    2067.187500 -25.076914
    2411.718750 -29.332180
    2756.250000 -36.431911
    3100.781250 -26.854145
    3445.312500 -28.538439
    3789.843750 -41.011993
    4134.375000 -46.659691
    4478.906250 -46.778381
    4823.437500 -48.691738
    5167.968750 -47.086716
    5512.500000 -48.485313
    5857.031250 -47.242565
    6201.562500 -49.103146
    6546.093750 -52.284672
    6890.625000 -59.631161
    7235.156250 -67.323158
    7579.687500 -70.424667
    7924.218750 -73.606163
    8268.750000 -71.751381
    8613.281250 -73.710449
    8957.812500 -72.287674
    9302.343750 -77.733704
    9646.875000 -78.146339
    9991.406250 -77.887665
    10335.937500 -70.030792
    10680.468750 -66.754021
    11025.000000 -73.114220
    11369.531250 -77.196129
    11714.062500 -77.887817
    12058.593750 -78.730385
    12403.125000 -73.642387
    12747.656250 -76.823822
    13092.187500 -73.924301
    and so on...................................................................

  • wetcircuitwetcircuit Posts: 0
    edited December 1969

    :ahhh: AAAAAGH the MATRIX!!!

  • PjotterPjotter Posts: 266
    edited March 2013

    Wendy, I am not the biggest fan of your animations, but maybe I can help you out a bit. Houdini can do the things you want, but it is very expensive software. But maybe it can learn you things to do it your way. There is a very nice PDF as a starter. Visit his site for more info.

    Download here

    Two YouTube videos. There are more examples at vimeo.com. Search for CHOPS for Houdini (at Google).

    Video 1

    Video 2

    Also do a search for: music visualizer

    Post edited by Pjotter on
  • YofielYofiel Posts: 182
    edited December 1969

    I'd like to learn about what Python can do in Carrara. it. I have MAX/MSP from Cycling 74, which makes it easy for me to do things like manipulate real-time data from Audacity, and I know enough to program in it reasonably. But I never wrote any Python.

  • YofielYofiel Posts: 182
    edited December 1969

    And by astounding coincidence, the 64-bit version of Max/Msp/jitter was released 30 minutes ago. Jittrer integration with Carrara would be VERY interesting.

  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    f1oat needs to get back to coding for us!

  • DartanbeckDartanbeck Posts: 13,966
    edited December 1969

    Yeah! :-P

  • PjotterPjotter Posts: 266
    edited December 1969

    Pjotter said:
    Wendy, I am not the biggest fan of your animations, but maybe I can help you out a bit. Houdini can do the things you want, but it is very expensive software. But maybe it can learn you things to do it your way. There is a very nice PDF as a starter. Visit his site for more info.

    Download here

    Two YouTube videos. There are more examples at vimeo.com. Search for CHOPS for Houdini (at Google).

    Video 1

    Video 2

    Also do a search for: music visualizer

    And completely ignored again. I am wasting my time here on this forum. It looks like I do not belong to the (very small) Carrara elite here. I thought I help you out, looked for the info, spend time on it and what do I get, nothing. If someone helps me, I say thank you and / or respond. Yes, I know I am very weird.

    This happens very often here. Recently in other threads too. Well, I have had it here. Probably never post here again. Fun for helping out others is over.

  • wetcircuitwetcircuit Posts: 0
    edited March 2013

    Pjotter said:
    Pjotter said:
    Wendy, I am not the biggest fan of your animations, but...

    And completely ignored again....

    This happens very often here. Recently in other threads too. Well, I have had it here. Probably never post here again. Fun for helping out others is over.


    I have a small suggestion that perhaps you try to not INSULT the person right at the beginning of your "help".... especially since it had absolutely nothing to do with the topic at hand, it just seems really rude, and if it were me I'd take anything you said after that little dig with a grain of salt - IF i read it at all.... Why did you feel the need to go there?

    Everyone is human. If you have hurt feelings over your suggestion to buy $4500 software being ignored..., how would you feel if someone openly insulted your work? :smirk:

    Post edited by wetcircuit on
  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    I will get moderated again if I respond how I wish I could.
    just briefly
    yes, I have Houdini apprentice
    no I can barely do stuff all normal stuff like control a camera and render with it let alone plot soundwaves!
    and I have tried, (using Houdini that is)
    if you had looked at some of my youtube videos you would know I have gotten Carrara rigging and animation into Houdini.
    so not entirely ignorant off it.
    and I am not buying the starving artist version either!
    yes, I know what a music visualizer is
    my last video link had screen caps of one, Spectrum tab
    and can also do battery/mandella/kalidioscopy type thingys with various software
    I was exploring the posibility as I stated of using one to drive another action using Fenrics erc plugin
    was NOT ignoring you but if you start attacking people who do not respond to your suggestions because maybe it is not what they were seeking
    I will add to the list of oddly only Carrara forum members I ignore.

    Post edited by th3Digit on
  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    and while I was typing that lengthy some what edited response
    Holly pops in, hi there!
    what I would like and cannot find is f1oat/Fredric's py script for midi and actual project file!

  • evilproducerevilproducer Posts: 8,560
    edited December 1969

    and while I was typing that lengthy some what edited response
    Holly pops in, hi there!
    what I would like and cannot find is f1oat/Fredric's py script for midi and actual project file!


    Is he the one that used something like that to drive virtual speakers in a thread in the old forum? The thread would have been around the time Carrara 7 was released (if I recall.) It was very impressive.

  • DartanbeckDartanbeck Posts: 13,966
    edited December 1969

    Around the release of 8.0
    It's still there somewhere - I caught a glimpse one day.
    Yeah, that's it.

  • evilproducerevilproducer Posts: 8,560
    edited December 1969

    Around the release of 8.0
    It's still there somewhere - I caught a glimpse one day.
    Yeah, that's it.

    Ah, around 8. It's been awhile.

  • wetcircuitwetcircuit Posts: 0
    edited December 1969

    Can a MOVIE drive an ERC chain? Like can the overall brightness of an animation in a shader drive ERC? Or would it have to generate from a procedural for ERC to read it...?

  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    3Drendero posted the link for py Carrara the previous page
    http://pycarrara.sourceforge.net/page6.html
    I have it, was what I was asking about
    the video is on that site too but not the actual py script needed to use a midi file and drive events
    and even if it were, I would need it set up to actually work in a project out of the box as I do not know scripting and coding.
    Casual's script I also linked to drives a speaker cone to a music beat in studio
    it took his suggestion of linking it to a camera and using his pz3 script to get it into Carrara but it works.

  • th3Digitth3Digit Posts: 16,621
    edited December 1969

    Can a MOVIE drive an ERC chain? Like can the overall brightness of an animation in a shader drive ERC? Or would it have to generate from a procedural for ERC to read it...?

    this is what I was speculating
    yet to try it
    yet to do a video based on a music visualizer
    I imagine it would need to be very simple, shades of colours or brightness
    using the "matrix" spectral analysis data would be a better way if it can be gotten into Carrara in some form
  • th3Digitth3Digit Posts: 16,621
    edited March 2013

    a movie can certainly drive a seconday event like displacement in 3D view used perhaps with bullet physics on another object
    whether this need to be exported as morphs though to work?
    am actually thinking Poser dynamic cloth dyntomorph like type morph sequences
    what I hoped to do with fenrics objs exporter but it does not appear to support morphs and skinning.
    if it did, ocean primitives and rustling trees could also be exported, I do them manually frame by frame and add as morph targets in studio.

    Post edited by th3Digit on
  • wetcircuitwetcircuit Posts: 0
    edited December 1969

    yeah, I'd thought of the displacement-to-physics too..., but figured that should be avoided.

    I have never made anything with ERC. Faba is so cool. :coolhmm:

  • DartanbeckDartanbeck Posts: 13,966
    edited December 1969

    I have a link to the original detailed ERC thread from the old Daz forums right here.
    I agree, faba is amazing! ...and generous, imaginative, genius... :)

Sign In or Register to comment.