Serum 2 - Spectral Sampler

[clevername27]

@DanH @d-healey (My plugin basically does this.)

[DanH]

@clevername27 pray tell....

[d.healey]

@DanH said in Serum 2 - Spectral Sampler:

It's actually a spectral re-synthesis engine that takes whatever sample you throw into it and re-synthesises it

You can do this with Loris (GPL)

Also Paraphrasis (which uses Loris) might be of interest to you.

[clevername27]

@DanH See the videos here. The main thing my software does is convert audio recordings to these models—which can then be resynthesised. To be clear, much of this processing occurs outside of the HISE plugin. (Please excuse the idiot in the photo.)

Home - Under Construction - Virtual Audio Workstation

The virtual audio workstation A Music Production Methodology About the researcher Bill Evans, PhD Evans is an audio scientist, engineer […]

Virtual Audio Workstation (virtualaudioworkstation.com)

[DanH]

@clevername27 This is an awesome pug-in! Congrats! When you say the processing happens outside the Hise plug-in where does it happen exactly?

[clevername27]

@DanH Thank you, kindly. It happens in other software I've written (stand-alone, command-line, boring-looking).

[Allen]

I have an unfinished prototype does "spectral granular" with warp functions. Been considering including that in my synth for a long time though. I'll try if i can find a way to implement that in hise.

[clevername27]

@Allen I'd be interested in learning more…

[DanH]

@Allen very interested in the warp functions!

[Allen]

@clevername27
It's actually not really complicated, just a bunch of voices playing back different positions of a spectrum in different speed ratios.
I got this idea from a m4l device called "Pathways"
https://youtu.be/ljljrQ9QPiY?feature=shared

[Allen]

@DanH
I store the whole spectrum data in a N x 512 grayscale matrix, the pixel with the highest value in each column will be the fundamental frequency. And basically you can manipulate the spectrum according the pixel values in each column like shifting the vertical relative distance between each selected pixels and the fundamental frequency, or smearing the values horizontally.
Most functions which processing columns can be done in the play back stage by directly changing the frequency and amplitude of partials but those functions processing rows (time axis) will definitely need a separate buffer and some interpolation to make it smooth.

[clevername27]

@Allen interesting - what does this allow you to do?

[Allen]

@clevername27
I guess this will allowing users does some weird sound designing stuff, like something similar to the sounds in aphex twin or autechre's tracks
I want it to be a "creative spectral sampler/osc" for some creative usages instead of a precise spectrum processing tool.
Actually I decided not include this thing in the initial release of my synth months ago cuz the CPU usage and the tunning is still big problems but after the serum 2 is released i feel like i really need to have that kind spectral thing in my synth anyway.

[ustk]

@Allen I was working on an instrument inspired by spectrum drawing and other collision stuffs, a bit like what pathways does but extended. I still have to work on that FFT in third party nodes that will be intersected to play just a part of the bins but in a smooth way. I think the smooth rendering of those bins is where the difficulty lies…