Serum 2 - Spectral Sampler

[clevername27]

@DanH Ha, OK. If there is a specific technology you'd like to use in your plugin, I can tell you how to do it. I can't tell you how to do it in HISE—but I can tell you how to do it. Feel free to ask away…

[d.healey]

@DanH said in Serum 2 - Spectral Sampler:

One of the features people seem to be going most wild for is the Spectral Sampling. I wonder if this is something we might see in Hise one day?!

What is spectral sampling?

[DanH]

@d-healey sorry should have written spectral sampler. It's actually a spectral re-synthesis engine that takes whatever sample you throw into it and re-synthesises it, with interesting results. You can then warp it using multiple filter / fm options.

[clevername27]

@DanH @d-healey (My plugin basically does this.)

[DanH]

@clevername27 pray tell....

[d.healey]

@DanH said in Serum 2 - Spectral Sampler:

It's actually a spectral re-synthesis engine that takes whatever sample you throw into it and re-synthesises it

You can do this with Loris (GPL)

Also Paraphrasis (which uses Loris) might be of interest to you.

[clevername27]

@DanH See the videos here. The main thing my software does is convert audio recordings to these models—which can then be resynthesised. To be clear, much of this processing occurs outside of the HISE plugin. (Please excuse the idiot in the photo.)

Virtual Audio Workstation – Music Technology Research, Development & Deployment

(virtualaudioworkstation.com)

[DanH]

@clevername27 This is an awesome pug-in! Congrats! When you say the processing happens outside the Hise plug-in where does it happen exactly?

[clevername27]

@DanH Thank you, kindly. It happens in other software I've written (stand-alone, command-line, boring-looking).

[Allen]

I have an unfinished prototype does "spectral granular" with warp functions. Been considering including that in my synth for a long time though. I'll try if i can find a way to implement that in hise.

[clevername27]

@Allen I'd be interested in learning more…

[DanH]

@Allen very interested in the warp functions!

[Allen]

@clevername27
It's actually not really complicated, just a bunch of voices playing back different positions of a spectrum in different speed ratios.
I got this idea from a m4l device called "Pathways"
https://youtu.be/ljljrQ9QPiY?feature=shared

[Allen]

@DanH
I store the whole spectrum data in a N x 512 grayscale matrix, the pixel with the highest value in each column will be the fundamental frequency. And basically you can manipulate the spectrum according the pixel values in each column like shifting the vertical relative distance between each selected pixels and the fundamental frequency, or smearing the values horizontally.
Most functions which processing columns can be done in the play back stage by directly changing the frequency and amplitude of partials but those functions processing rows (time axis) will definitely need a separate buffer and some interpolation to make it smooth.

[clevername27]

@Allen interesting - what does this allow you to do?

[Allen]

@clevername27
I guess this will allowing users does some weird sound designing stuff, like something similar to the sounds in aphex twin or autechre's tracks
I want it to be a "creative spectral sampler/osc" for some creative usages instead of a precise spectrum processing tool.
Actually I decided not include this thing in the initial release of my synth months ago cuz the CPU usage and the tunning is still big problems but after the serum 2 is released i feel like i really need to have that kind spectral thing in my synth anyway.

[ustk]

@Allen I was working on an instrument inspired by spectrum drawing and other collision stuffs, a bit like what pathways does but extended. I still have to work on that FFT in third party nodes that will be intersected to play just a part of the bins but in a smooth way. I think the smooth rendering of those bins is where the difficulty lies…