NI Insolvency

[David Healey]

@resonant I'm not afraid of it (I made a whole HISE AI workshop). I just see a lot of vague comments without any specifics which is why I ask.

If I can write a prompt and a plugin pops out then all our plugins are worthless because the end user can write the same prompt I can.

[resonant]

@David-Healey said in NI Insolvency:

@resonant I'm not afraid of it (I made a whole HISE AI workshop). I just see a lot of vague comments without any specifics which is why I ask.

If I can write a prompt and a plugin pops out then all our plugins are worthless because the end user can write the same prompt I can.

What I'm referring here isn't creating plugins with AI.

As said, it's about using AI to analyze and then using DSP to process or generate DSP in a shorter way. For example, removing reverbs, or properly removing snare drum from a mix, or creating very realistic physical models…etc. That’s what I call AI Workbench.

[hisefilo]

@David-Healey this is a specific use of ai replacing sampling. https://acestudio.ai/
Click on violin to see the end of sampling.

This is ACE-Step model trained with hours and hours of violin performances.

[David Healey]

@resonant said in NI Insolvency:

What I'm referring here isn't creating plugins with AI.

Dan suggested this.

@resonant said in NI Insolvency:

That’s what I call AI Workbench.

Would that need to be part of HISE when other tools are already available to do those things?

@hisefilo said in NI Insolvency:

his is a specific use of ai replacing sampling.

ACE studio (and other similar tools) is not an instrument. It's a performance system. You can't play it in real-time. The current system of generative AI is not real-time capable, a new system is needed in order to replace virtual instruments.

[hisefilo]

@David-Healey i can live with it. Playing with an ugly sampled violin. Then render with Ai

[David Healey]

@hisefilo said in NI Insolvency:

Playing with an ugly sampled violin.

A sampled violin you say... but you just told me ACE studio will replace samples

[hisefilo]

@David-Healey lol you got the point. It’s matter of time to get ai realtime generation on every home studio or top notch producers.

[resonant]

@David-Healey said in NI Insolvency:

Would that need to be part of HISE when other tools are already available to do those things?

Yes, like scriptnode, or sampler or synth stuff in Hise, like other tools are already available to do those things.

[David Healey]

@resonant Can this kind of thing already be done using ONNX in scriptnode?

[hisefilo]

@David-Healey good question!!!!!

[resonant]

@David-Healey Probably, are there any examples?

[David Healey]

@resonant Not sure, I haven't explored that side of HISE, but searching the forum will probably bring something up.

[hisefilo]

@David-Healey I see an opportunity on the dataset creation. Dataset is everything. Models can be copied. Improved.

The quality of the final product is strongly driven by dataset quality (i.e. 200 hours of a clarinet soloing. Tagged by the features you want)

[David Healey]

@hisefilo Maybe an opportunity for a colab

[dannytaurus]

@David-Healey @resonant

What I'm referring here isn't creating plugins with AI.

Dan suggested this.

Yes, I believe this will be the intermediate stage. Where AI can help anyone make the tools they need use to create their music.

The stage after is to simply describe what kind of music (the specific parts) you want to make. That will remove the need for plugins.

Instead of downloading a bunch of different reverb plugins, you just tell the DAW exactly what type of reverb you want and it will create a custom one. Then if you make a really cool reverb you can share it with other people, heck even sell it if it's good enough. Wait... we've come full circle to selling plugins at this point!

Parallel to this is also likely the stage where the end-user just describes what music they want o listen to and it's generated on the fly.

Ahh.. but this is all supposition. Nobody really knows where this will all go.

It might all collapse in on itself and turn out to be a big disappointment. Or it might wipe out humanity entirely.

[dannytaurus]

I'll add, with some amount of caution, that in my specific music niche I think there will always be a hard requirement for music made by humans, with tools made by humans, pressed onto vinyl made (supervised?) by humans, and played on arcane gramophones by humans.

[David Healey]

@dannytaurus said in NI Insolvency:

Parallel to this is also likely the stage where the end-user just describes what music they want o listen to and it's generated on the fly.

We already have this, Suno.

I also think live musicians playing virtual instruments will still be a thing. People like to play.