Literally dont know where i could ask that, so its here now.
On EDM festivals, on IBMs Watson AI, and other stuff they all use animations that react to the sound thats being playd. On festivals for example the animations make a animated jump when the beat kicks in, and they are not always prerendered. For example, this video
https://youtu.be/WFR3lOm_xhE?t=50s
notice how when watson talks it turns green, and also the light in the middle changed respectevly on when he talks. You get what i mean.
Or having that after effects cirlce waveform for audio, just that it moves live to a audio being playd.
How is that being made? Like with what software, or is there even a name for it so i can look it up? I never had any clue whatsoever.
Unity3D has a GetSpectrumData function that you can use to read audio data, and then hook it up to any type of visualization.
I'm sure there's tutorials about it somewhere, heres a video I see that someone made using it though:
https://www.youtube.com/watch?v=zvciEKEjuXI&feature=youtu.be
A VJ plays the video at a venue
https://en.wikipedia.org/wiki/VJing
There's a lot of tools that VJs develop to enhance their toolkit
https://twitter.com/FMS_Cat/status/1036195235385110528
A library like Essentia claims to be fast enough for real time data
There's a wrapper for openframesworks on github
https://github.com/leozimmerman/ofxAudioAnalyzer
sadly the tutorial uses C# which i dont know. I know Lua and python, which made me think, are there librarys or plugins/programms that use python to do that? then i could easily link it to my AI
There's lots of python resources too, but they're much more hacky, less consistent, aren't hooked directly to a graphics engine, and don't have extensive various tutorials surrounding them.
A short google brought up this: Audio spectrum extraction from audio file by python
There's probably also something worthwhile in processing.py
https://github.com/jdf/processing.py
Someone was kind enough to even provide a converted sample code for the input demo (microphone)
https://github.com/jdf/processing.py/issues/194
As a footnote, this library is generally written in java, So you would be reading a lot of java docs, but essentially the methods should remain the same, regardless of language
There's a lot of tutorials out there for processing, Tutorials \ Processing.org
So if you really feel like it, you could expand your horizons on becoming more familiar with some alien languages
Sorry, you need to Log In to post a reply to this thread.
