Forget sampling!

ustk

@clevername27 sampled or trained? Unfortunately, I’not sure any law will ever save us from this AI era… Maybe just to learn that we don’t always have to say yes until it can be regulated, but it’s a bit late I’m afraid

d.healey

Well the purpose of copyright is to promote progress...

Christoph Hart

Actually I was working on something like this too - it's a bridge between HISE and ChatGPT that allows you to define parameters and it will build the instrument for you.

I'm having trouble at the moment with some complex DSP networks (eg. if you use an oversampling node in combination with a fix32 node, it will fail to detect the sound characteristic), but the basic stuff is working and I expect a release within the next weeks and when GPT4's plugin system is public, it will be a part of the official ChatGPT site (so you just need to select "HISE plugin builder" from the list and type it in the chat box.

This is the current prototype. Feel free to check it and report back if you find bugs:

HiseSnippet 2603.3oc6YssbaabFlzxHIRIwIoSRObQmA0SuPdnJLOHRJNd5XBPRvyjfDfRh5hlYIvBhkBD.DXAO0wOC80IWlGg9Hj9FjK58s6BPJBZqnQiZchRZ0E1Z+2++c+9Or+GfjbsUgdd1twhenxJGXr3eBi7JKrQIC.xJV8xwh+Ll1.OLzkMjjvJGfmGTKV73GTkRH9gOMVvOe+qE.l.KU3NRwhctMRE1BMEg2QUpXSjooHPCpflFg6SKVW01pjsosOAOGvjLlCP8ZvXXG.ksmvDK9GTQCgsckw.LzKV7mJXqsR1vdgUH+mi7PiLgzEohISNnPxh1lZTDSoFqjAxTSZqd6EibnR6rBGDZE9Rl1HMzMz2YM97fMX2IQT6Q7mrO7NXO3kJJ7RFAd2BjhGAROMDReAirpKxAuaGJd9Xl5VDmiNfX1iBkPdi8ju5oLkrIbXg4lBtFJ5RVbiDGmKYxSXI+yKd0QGQL8dX14.W110KWWxDrB5lh8OyFDNvMFhCrHAjO94TVX2vyyIReaBm9dHb5mu+UiMHBUwZLxBxo5BIlQEWfkmisKtFvRyjHNU.xY5AwUr.DqYUWj1wXWe3IrmQ26nHvmxEABpJ1gwvkLsUuNfYBmQP5cx2laiteaaM3wjkAVPKfYWKyUukBPveT.PTcZPtLZrE.66BIvmhQLWG+oB.WOB6mwk7Uru7kr0pKWgii6sw+9hiCTQJhv1NagQHbodwfM.t382IcxSOaeXJArflTu61fCBNKYO0w1hr33mGtcfuI7Wo.Qh7F.221GSbNGq6aohQ1VGO9EG8WO5PjNwrf73z.X.ms0KN5PBwCGSESzldhjCGoxJS7krske9IrYRyQw6FdBeyeb3+4wsv.ggA6FvflKXAuIwD.0TfKIGF0RwVURgbNA2JA7srUAlB19VZdDCwIrOWknHtPMpNb3aN5M67icsnQLjWzVigGy6Q7pcrwHcjJfpOmvtSyNgEEnbaLAazMhQ6OrOkWcCKtPGpQhFiRuwsGEqsE4NfcsNN37N5MGw91aoqeq6QcOt1lAw82x1zXC26Rvis7mNB5dBwoaRBl2xHIox9YpX9gyTEMQpZXzRDFsspagvccfV+PoWisIDi7aCpWlXwno21PivmCzEinPHdY3bRshvjcGxTF5cMIDOf2MwkjL03fc+zsoBoV8XHRBuOhIzCDa4txICKtZ2BTwEHMrwNBqJZ.QiMvQYI16l0kju2Vy2Df2uH.sx2lMH168x7Re5Y4gvqhVY7+ZUFtuP7KXjPXUiaGiO4VvHwq79.iapm9oLUz0gp3c.7oLhW99o3Yzq+YgW+GyHSRZETLJ3x+0AqYu.LGxVEZAcoFuz2QuM+86auMN26da5phIW+lxad6cvxvoHERHuWThC7HUugy5S8lQoWxlTF41156esHQIuUYjoESBBK3mRxYh2KL3f6pGqTOvdrd5i6dr9vsM+tqOksM+FoYk8.RIeWWZtP3Le3dAFe+q2rEw2pdcT5srscBaZQKJY5oOhvprCb+MdaWwA2OWws7jfpVhHSXfducAgapNR5qNHs7S9mwYxjOImkRtlmUJ0ZNk0BbWl35NCKMp43xb4gZmywon0imS55NUzaUE.gFbMkVdID.qYNZ1RwL54m1ImR2qyKWnY6NWBJw228ZQQvv1xH2pRbYJwIvO+htXYU0SmMxWB3wetlcydoyyIA4O0utlLZ0jZ0Pp1mal1z1yvSPLumeZorm1FVqA2UyGJsn.euL1FhijVzn.O4RPSaHfGVRuPV+TybxMQp03YimMAsp2.AqD886wOsNXYFioiaU8hNoZUYd4NkDtPdZOS85RIaKNXhmctQiFH1qh9LfyxEs83ZDbkSFIVVpWa9g863NDbpyZ9dKFTgWeRxN34XGA27bFtR8TlU2VSSt0jQmOY05LNsLpKQN0gUUwbV4zxmbwf5U5snckjJsHWY07KGTujYl7iPmkeXtA1Uj5dUVioH2SQ45CQiFHLVnSmbthNqZ16hI8ubr50WAbrqWMshPmBq7GZrZxUkGcpW8jWx2SmaTmYfRmVSqMeudB9Kx.z45l37D0uZdo7yxH2RiGJpb4UKq3zzpW0UkktX5YCU3hQiDBGv5DlWRRx358RUCWDs+RCCRqjubSk3WVgSpNemtro4lRK4FeuFSI0l2zQ6t.X1hcHc8YQysti3mWrLz51HSebHS6cMZxnvWL68nPARZGXGg+xOGpZuWtlOKDieHCesxx82TsN32IS9LGZRZIJ0dXqssEwWXagTiZZ5CwtnwigtQQ7spF7XLI6BIoz78pxTFpBV8NTCYNZgqPJsfDnEkwZjD96VWuXvwcCg+12TT1mLJRzhnC+19PSHvauxhUTsoSU8.M62cZu3L2yPiOkITIYCJZ+3qatmsEegdgGe.7SXBb+OVseeFylfwGsFvmwr4swiUS3cNPwA+xdfhvO5w31.RFWx.lLjJcxj93Ugzuh.YrS5.zweBsW7v0IoqCaj2RKXw+h7ylMSQWGeylo1tYTU7q1NzBc9jcCs7UAq0scmtalkT+jNyRpnm7asW58K0f8stg8h+i0+9uMjzVt9tdeyuqHU8DIpWji8itgX5nDIC6mJZcEx5zQG7uMJx2A36dcXO2xPh1n00Sknr627AoEbeSO3EzuPPpnBtib5njqAb0neNv2+iM8A+BXroT+BerouiL1T1raFaRrA+ZWxXS8WmPozHdatDUOOQhtoSjHwXfe6IpNSEA5UNO0hyW1BzoL55gfkxyEmYNIegxUWL9r4WptJktX09BxWpLaP1RsJw4yI0hqUVTxKlKlznpdNTxl8lsXxnAn5jN7qzQ1ePg5MljLakB9UWl4rZ5omYzLqUOAtqxeU9Q407qaYgLcW1UXpSgFETDbUG3kgupokvnYivq7crkEKgyleHmB4bZunwjoqal2Ky554rm0IQcmJxUR1zuTYWO8ryZonmwZshmesgMFnk0pOVNcCnTa0k8ac0zgcDyONiRMHWUwVBIVZ3uPpSJEjR990355LYUCukUEJMp8PM0BJR9BIl4IgsDWUtOPu85A8pYX0ZT1V9oZd4hKFVCJmGstoqncqRNi0O2YHu4x9URcYKBVK6jkS2ownIF75kypwYzebkQ7NMFpLiysqRy50pH2cMZbYyTsMM34xWPne4SKOrv.qyDvp0Z6f6mYYeazrBfg8ztFm9x94jT55rVvvztURmniH8h6dDo1UZ0s7v++7Q+GkT4vsXTFM0wDtcln.L9qH8YpC7MwuOmTZGkur36LwxerXKjED399ank32S+0uM5PKr+78qQev+y70nu6WejlVdb6E+MLjlmRyF3JY+owW9iQm3+XbGSApt1esZ3ejN5i9OJfBQusBpybHSa5Z1TwB9C2QjiIIWxXjBKnuVUkFu9mH8Kd6xj9AHSlGfLm9.jI6CPlbO.Yx+.j4r6TFZ2e79X6ogw7DBRUB5+Kd7a5MM9Aw92.g9nlB

Frankbeat

Great in every aspect, man!

hisefilo

@Christoph-Hart wrapping it into a midichain fixed the oversampling issue here. This is awesome man. Can stop playing with it!

d.healey

@Christoph-Hart Love it

ulrik

@Christoph-Hart no bugs what I can see

sletz

Actually I was working on something like this too - it's a bridge between HISE and ChatGPT that allows you to define parameters and it will build the instrument for you. ==> can Faust native support help here ?

Lindon

just loving this thread....

ustk

@Christoph-Hart I particularly love the degree of humanisation in that system... Technology at its best! :thumbs_up:

sletz

FaustGPT coming : https://gitlab.com/dhuck/synthesis-synthesis ?

Adam_G

absolutely brilliant

sletz

I asked ChatGPT to write a presentation of FaustGPT , here is the answer:

FaustGPT is a DSP program generation model for audio built using the Faust language. Faust is a programming language dedicated to creating digital audio processes, such as guitar effects, synthesizers, or real-time audio processing tools. FaustGPT uses machine learning to learn how to generate DSP programs from input-output examples, allowing users to quickly create custom audio effects without having to write the code themselves.

FaustGPT uses a GPT (Generative Pre-trained Transformer) type neural network architecture, which is pre-trained on a large amount of audio data to enable faster and more accurate generation of DSP programs. Users can provide input-output examples for specific audio effects, such as reverb or distortion, and the model will automatically generate the corresponding DSP code.

FaustGPT allows musicians and sound engineers to create custom audio effects without having to learn the Faust programming language or spend time writing DSP code. This makes the creation of new effects more accessible and faster, allowing users to focus on creating unique music and sound experiences.

sletz

Some progress: http://www.vaporwav.in

sletz

FAUSTGPT: https://chat.openai.com/g/g-uTlRVzd8P-faustgpt

d.healey

@sletz Aha that's clever

Dan Korneff

@sletz very cool. I'm gonna test this out tonight

virtuscapeaudio

Do you guys think that this will indeed get rid of us all? Or is there still a way to stand out and maintain sales? I can't tell if these comments are sarcasm or everyone is indeed worried about the sampling business at large.

d.healey

@virtuscapeaudio I don't see it replacing sampling any time soon. Most of the physical modelling algorithms have been around since the 80s and haven't changed much. Wind instruments, plucked strings, and percussion models tend to sound the most realistic but the advantages over sampling are minimal.

I used to think physical modelling was the way to go but it only gets you to the point where you have a sound. To make it useful you still need to do all the scripting stuff you would with sampled sounds, and sample sounds are more realistic. The only real advantages are that it can be more precise than sampling and more dynamic. You don't have to worry about phasing between velocity layers. And generally it uses a lot less RAM and disk space, but is heavier on CPU.

With lazy loading (purge until played) and modern massive hdds/ssds the RAM and disk space for a sample library isn't really an issue these days.

So while I still like the idea of physical modelling, and not having to edit 1000s of samples. In the long run if I want a realistic sounding instrument the fastest way to get there is just to record it.

virtuscapeaudio

@d-healey Great! I share your sentiments here. ....and I just loaded the HISE snippet from @Christoph-Hart and burst out laughing out loud haha. I needed that and I indeed just got Rick Rolled lololol

Forget sampling!

18

1.7k

11.8k

102.6k