How to create audio visualizer in HISE

[Tania Ghosh]

How to create audio visualizer in HISE

Created in Cinema 4D.

[ustk]

@Tania-Ghosh you need FFT and strong paint routine skills, BUT, the paint routine is not optimized enough for such object size, hence you'll end up with a huge cpu and lags… although this might be unlocked by the upcoming SNEX integration but I am not sure of that at all... Another solution would be a RAW interface (C++), you can find info on this in the doc and a project example, but to achieve such a visualizer you'll need a strong level that I'm not even aware of

[Rudra Ghosh]

@Tania-Ghosh
ZGameEditor
https://www.zgameeditor.org/index.php/Main/Download

Which is pretty good for such things(used by ImageLine as ZGameEditor Visualizer). But it needs Embarcadero Delphi or Free Pascal.
May be in Future you will get such integration to create your own visualizer in HISE.

[Rudra Ghosh]

@Tania-Ghosh Till then use image Sequences (Stitched) as Audio Visualizer.

HISE Project link..
https://easyupload.io/rdt11b

HiseSnippet 1346.3oc4X0raabCDlqkXPjpUQRaNzSsKL5AkhTCImebAJJhh0Owp0NVPxUs4jA0tTRDgK4hc45DUC+tzGkbrG6w9Xji8TaGtTq1ccTTTMPLRZ2CFlCmg7aFN7aFpdARGZXnL.YU53Y9Tj0l3AyDpoMmRXBT2VHKLdug6i1alOILj5hrrJ7X8TVkJhh+d0C2ivIBGZpHDZnj4POf4wToR603GXbdGhK8XlWFsuWitNRQSIWFAvn.tFxm37LxD5SHZ01.irtVaWlRFLPQTzPjUw8jtyFLU9bgQ+grP1HNUOnNZ.rPFwcjbWMh0RQMmx3t8Rb2PD3X8Rc9BFm+V3CYtrExSCB2HdB6TKxFOr1XUvqdV3Ua8gmUF3Uz.uahG3DZkUZ5vZ3RUnEtoRw4ZTGbyAq57C4SQMkfFB01djmQ6D.CVXQ06Vq1crg+b6usR4JkgChPk8oj.6ihT9QJ8Qs82YGmRr8Dpp83wTGU0sRmcKigYMc39fIIaIXTSomuT.Cpt0v8i0OU2VrP+2n15Imu95+c6PpRm5Dzjv4ifbjpiiDNJlTT81UJeVkx1v2v80pMjvinUaKlvDT8h1h5vFQ4gcjAZP2g3.mWUS8h3MNJH.11CnmR4Uqc6upNDTzatckxmWobhaZ.hhDXfR0clG4RfhsT7DohdDfoxmUtT4yKaewoFOdoyoiAARNGVzkMsY6VggUEQdinA2AhqfyuPQH6Ie5I9Mmdl81ii4HIihRQWAScjOU7lRZQyOG0ouyQEnpJN48imm7NfyboAHFjiVDCLKwnMkM3ouD8icaQTjj0.VNXK7oAJlF8VsnmBbKlKDkvsngOSI8AZhE4MvMhUuiuHK40rrzVgJp+.1uPypfGIU+ecTiwLtWnBV1td.EEx5Kvm0q+Qee6lGeRmiNnU69mCYU8hT.o419hIH3PYfV8vEKxKG034LW0zEBdUPioT1joobk2HrQnCgSM4oon4OeHJiatowMqjvJPDTdrWdMrNKMqehPyx5SijAPDoOwkEElUIi77Q.DhondF54cLoFJ5KTI70kw0evt6t6N0uOZzjkHL0Xis4cczrK55fDzqy7A7uR2HNQkmTVe0c9DvUgbreZFNQHSkyuemvTutv8l3dLkyzki2MVBdga.uqw675dUvFh8TvVD24muhKxc8EMfv774zGm.kMwo7zqnODDpEkSxE99o74ZOswR5Toq3TfZomjSBtXvuPdOtv5watDur3ZmgDWu8ClL5OAGGx+PBvwoDe3.3afAV82CfaeYjhIlbHAJkAkUvOAppAT5NT.pBnritsBqMzM.XFWSOVCnATga7f+F9lOYc8Xq4SVOYxrgjOMgV5QQtL4ARc4+33wsLRr0hr6A4dzf5qfS32W22l3u1uMAZE1ANOx0hPLu9wAPGoPLJ6VogYaAAh2tY0uuTpzcBl8sQCHZRuA5FKgkO6hzGZHMHjlSVGFe9yi97Wq+i9sdr8dThZ6mSNE4oCGlih3FYvV+wuUBwAbEuUIywiApax7Wj5q35Q88VH6K9d8Ctt555nv5A22R4xRIXzTtrMTGiC2SVPLOlDwUIR2IGJOTJj9SkBlS97L3x8jIzfrXeoNziTJHWOUxsZzmxojvLIzeYiCfmdQBt3Uk+Ewh5qerXUmWeF1.Wa8Ma6+azsXg+W1s3URUnqh8vi3DHOww7.Yct70ik.9sHlSuD9P8X65IONFiqscMfK2kchiiNb+00QnkayNWBat6kvl6cIr49WBadvkvlcuD17MqzFcwnGEojdlqhffdsi+QJrrVTe2p.5e.jmvapJ

Cheers !!

[Tania Ghosh]

@Rudra-Ghosh Wow !!.. Nice. Thank you

[ustk]

But this is not an audio visualizer

[Rudra Ghosh]

Hahaha.... exactly.... ... Unfortunately, right now there is no option (such Visualizer) in HISE. Till then it's like "getting a sugar candy for a crying girl"..

[Tania Ghosh]

@Rudra-Ghosh Who is Crying? I am asking HISE developers to make such Audio Visualizer.

[dustbro]

@Tania-Ghosh said in How to create audio visualizer in HISE:

Who is Crying?

I believe the translation was trying to say "it's only a temporary solution". Hopefully @Rudra-Ghosh wasn't calling you a Crying Girl

[Tania Ghosh]

@dustbro Oh..

[ustk]

@Rudra-Ghosh @Tania-Ghosh I don't think there will ever be such a thing in Hise since this is not what it is meant to do, or there will be a never-ending list of things to add, this is why I said you can make your own, Hise is open to C++ development in many different ways.

There's only one Hise developer, and a very very busy one, who tries to make the audio engine always better, not to say correcting flaws here and there
So I imagine we won't see an Audio Visualizer soon unless a charitable soul shares one

[d.healey]

@ustk Couldn't you make a crude audio visualiser by linking the output of a gain meter to a paint routine?

[ustk]

@d-healey But in this case, you only have the amplitude content, no frequency information...

[dustbro]

@ustk I'm thinking... the audio analyzer has frequency and gain info. We might be able to connect that data to a visualizer.

[ustk]

@dustbro yeah it makes use of the FFT. I tried to use FFT from the core library with no success, apparently, it's full of bugs. I don't know where the FFT of the analyzer is taken from though, probably directly from the JUCE library...

[ustk]

I knew I asked Christoph not long ago:
https://forum.hise.audio/topic/3370/fft-core-library-module/3

[Rudra Ghosh]

@Tania-Ghosh For simple Fast Fourier Transformation(FFT).
JUCE FFT Tutorial: The fast Fourier transform
Table of Contents
Getting started
The demo project
The Fast Fourier Transform
Processing Audio Data
FFT Initialisation
Displaying the Spectrogram
Learn how to display incoming audio data as a spectrogram by using the FFT class of the DSP module. Understand the benefits of using a Fast Fourier Transform.
SimpleFFTTutorial.zip

[Lindon]

@dustbro said in How to create audio visualizer in HISE:

@ustk I'm thinking... the audio analyzer has frequency and gain info. We might be able to connect that data to a visualizer.

so the audio analyzer already IS a visualizer.....

[Rudra Ghosh]

@Tania-Ghosh Try FFT experiment with the source code. Here I have created sln file.
SFML

FFT with SFML.zip

You will also get an exe file(compiled) ... set Audio name and buffer size to up and run it.

[Tania Ghosh]

@Rudra-Ghosh Thanks