Dynamic EQ Yet?

[iamlamprey]

Hello HISE friends, I haven't used the develop branch properly so just checking to see if dynamic EQs are possible yet? Either with FFT or some sort of SNEX shenanigans?

[d.healey]

@iamlamprey We're all hanging out on the new_layout branch. What do you mean by dynamic EQ? If it's what I think then yes it's possible with scriptnode.

[iamlamprey]

@d-healey Something like gullfoss - 200 or however many little filters all jumping around depending on the gain of their inputs.

[d.healey]

@iamlamprey I know nothing about gullfoss (sounds like something to do with seabirds). I think you might be interested in exploring the clone node, but we'll need Christoph to give us more details about it because I've forgotten how to use it after he showed me it briefly

[iamlamprey]

@d-healey I'll have to have a look at these new branches then, been focussing on marketing the last few months

cheers

[d.healey]

@iamlamprey said in Dynamic EQ Yet?:

focussing on marketing the last few months

Got any tips?

[iamlamprey]

@d-healey Probably nothing you don't already know and actively do - find places where people are selling similar things and email them

Namely affiliate stores like pluginBoutique and review pages like SampleLibraryReview or BedroomProducersBlog.

Might get some slots sorted out for Black Friday with VI-Control as well if there's any left

I've had multiple people suggest I try and find influencers or content creators on youtube/instagram/tiktok but I'm clearly searching for the wrong things because I can't find any

[hisefilo]

@d-healey said in Dynamic EQ Yet?:

Got any tips?

Got some tips. I mean just one tip. Focus on excelent innovative product ideas.
In my super short experience, press, affiliates, advocates, influencers, retailers will come to you

[iamlamprey]

@hisefilo said in Dynamic EQ Yet?:

innovative product ideas.

I think ML might have some potential for innovation - I managed to turn a tree-smack into a taiko from a few minutes of training using Magenta

unfortunately it's mono and only 16khz so there's some work left to be done

before:

after:

[hisefilo]

@iamlamprey said in Dynamic EQ Yet?:

think ML might have some potential for innovation -

Absolutelly. I think this kind of things are the best marketing you can invest your time in

[hisefilo]

@iamlamprey said in Dynamic EQ Yet?:

tree-smack

I always dreamed with the idea of a ML algo that can learn articulations from real players. Also learning from styles.... Like if you can choose to play a trumpet into a Miles style

[iamlamprey]

@hisefilo I'm sure it's possible, just need someone infinitely smarter than me to develop it

my ultimate plugin would be a 5mb vst that the end user opens, types "aggressive guitar" or "soft piano" and gets an ML-derived physical model with unlimited expressivity...

[hisefilo]

@iamlamprey I think you are smart enough. I i know nothing about ML. But I guess you can train a model to classify audios depending on spectal data? I mean a ppp C4 note from trumpet will always look similar, no matter the trumpet

[iamlamprey]

@hisefilo I'm only smart enough to use someone else's model, writing my own would result in my head exploding at least 3 times

But I guess you can train a model to classify audios depending on spectal data? I mean a ppp C4 note from trumpet will always look similar, no matter the trumpet

I believe a guided model could be taught what a ppp trumpet C4 sounds like (and every other note), with a big enough model on the actual instrument, you could then teach that new model the disparities of different players... in theory so...

"now that we know what the instrument sounds like, here's it being played by different musicians"

[lalalandsynth]

@d-healey Yes, optimize your website and work hard on the SEO.
That is the cheapest marketing you can get and effective.
And yet us little guys seem to ignore it a lot of the time.

This is what I am doing with my synth website these days , its a lot of boring work but worth doing.

[UrsBollhalder]

@iamlamprey said in Dynamic EQ Yet?:

@hisefilo said in Dynamic EQ Yet?:

innovative product ideas.

I think ML might have some potential for innovation - I managed to turn a tree-smack into a taiko from a few minutes of training using Magenta

unfortunately it's mono and only 16khz so there's some work left to be done

before:

after:

Did you use NSynth? Machine learning is a really interesting subject. I’ve been diving into it as well in recent weeks…

[iamlamprey]

@UrsBollhalder I used DDSP from Magenta:

https://github.com/magenta/ddsp

Starting with training a model using the autoencoder:

https://colab.research.google.com/github/magenta/ddsp/blob/main/ddsp/colab/demos/train_autoencoder.ipynb

Then bringing that into the timbre transfer demo

https://colab.research.google.com/github/magenta/ddsp/blob/main/ddsp/colab/demos/timbre_transfer.ipynb

The resynthesis tools in DDSP were exactly what I was looking for in terms of realistic synthesis of sounds - it uses a combination of Additive Synthesis, Subtractive Noise and deconvolution and sounds pretty good

The main issues I came across were the samplerate limitation (16khz) and the fact that it only train as mono signals, I'm not well-versed in python so I couldn't figure out how to fix those two things...

[UrsBollhalder]

@iamlamprey Yes. I've been going through those repos as well!
How much time did it take you to compute those algos? I am not sure why they use the reduced sample rate etc. Probably to make it more accessible for web audio use! Upping the quality will probably just influence to time it'll take to compute things! Amazing stuff!!!

[iamlamprey]

@UrsBollhalder It was pretty fast, I used about 10 mins of samples, which I left running overnight so about 12-14 hours total for a relatively accurate resynthesis.

I think the 16k samplerate is for the actual training, once you start going to 44.1 or something higher like 96k the training would take a lot longer...

Probably the same thing for mono vs stereo (half the channels = half the time)