Forget sampling!

MikeB

@d-healey You still have a few weeks/months :-)

I recently read that an AI has been put on all the music on the internet. So on tens of billions of songs.
The task is to disassemble and separate them into their components - to see/hear and learn the STEMS of each piece of music.

The goal is to get the following via text input:

Play me a guitar solo in Cmin in the style of "Samba pa ti" and "comfortably numb" with the guitar of Jimmy Hendrix.

Out comes a melody as a sample that is copyright free to use.

So I can (I do not - because with me the way (the play) is the goal) but all unmusical people times quickly create a supposedly own song without much effort.

I could also then enter: Give me the samples from C1 to C4 of Mark Knopfler's favorite guitar.

And already I have a samples library.

Matt_SF

@MikeB works very well!!

clevername27

A.I. will destroy us all. Tools like this will run into copyright issues, because they have sampled copyrighted materials.

Dan Korneff

:cat_face_with_tears_of_joy: :cat_face_with_tears_of_joy: :cat_face_with_tears_of_joy:

ustk

@clevername27 sampled or trained? Unfortunately, I’not sure any law will ever save us from this AI era… Maybe just to learn that we don’t always have to say yes until it can be regulated, but it’s a bit late I’m afraid

d.healey

Well the purpose of copyright is to promote progress...

Christoph Hart

Actually I was working on something like this too - it's a bridge between HISE and ChatGPT that allows you to define parameters and it will build the instrument for you.

I'm having trouble at the moment with some complex DSP networks (eg. if you use an oversampling node in combination with a fix32 node, it will fail to detect the sound characteristic), but the basic stuff is working and I expect a release within the next weeks and when GPT4's plugin system is public, it will be a part of the official ChatGPT site (so you just need to select "HISE plugin builder" from the list and type it in the chat box.

This is the current prototype. Feel free to check it and report back if you find bugs:

HiseSnippet 2603.3oc6YssbaabFlzxHIRIwIoSRObQmA0SuPdnJLOHRJNd5XBPRvyjfDfRh5hlYIvBhkBD.DXAO0wOC80IWlGg9Hj9FjK58s6BPJBZqnQiZchRZ0E1Z+2++c+9Or+GfjbsUgdd1twhenxJGXr3eBi7JKrQIC.xJV8xwh+Ll1.OLzkMjjvJGfmGTKV73GTkRH9gOMVvOe+qE.l.KU3NRwhctMRE1BMEg2QUpXSjooHPCpflFg6SKVW01pjsosOAOGvjLlCP8ZvXXG.ksmvDK9GTQCgsckw.LzKV7mJXqsR1vdgUH+mi7PiLgzEohISNnPxh1lZTDSoFqjAxTSZqd6EibnR6rBGDZE9Rl1HMzMz2YM97fMX2IQT6Q7mrO7NXO3kJJ7RFAd2BjhGAROMDReAirpKxAuaGJd9Xl5VDmiNfX1iBkPdi8ju5oLkrIbXg4lBtFJ5RVbiDGmKYxSXI+yKd0QGQL8dX14.W110KWWxDrB5lh8OyFDNvMFhCrHAjO94TVX2vyyIReaBm9dHb5mu+UiMHBUwZLxBxo5BIlQEWfkmisKtFvRyjHNU.xY5AwUr.DqYUWj1wXWe3IrmQ26nHvmxEABpJ1gwvkLsUuNfYBmQP5cx2laiteaaM3wjkAVPKfYWKyUukBPveT.PTcZPtLZrE.66BIvmhQLWG+oB.WOB6mwk7Uru7kr0pKWgii6sw+9hiCTQJhv1NagQHbodwfM.t382IcxSOaeXJArflTu61fCBNKYO0w1hr33mGtcfuI7Wo.Qh7F.221GSbNGq6aohQ1VGO9EG8WO5PjNwrf73z.X.ms0KN5PBwCGSESzldhjCGoxJS7krske9IrYRyQw6FdBeyeb3+4wsv.ggA6FvflKXAuIwD.0TfKIGF0RwVURgbNA2JA7srUAlB19VZdDCwIrOWknHtPMpNb3aN5M67icsnQLjWzVigGy6Q7pcrwHcjJfpOmvtSyNgEEnbaLAazMhQ6OrOkWcCKtPGpQhFiRuwsGEqsE4NfcsNN37N5MGw91aoqeq6QcOt1lAw82x1zXC26Rvis7mNB5dBwoaRBl2xHIox9YpX9gyTEMQpZXzRDFsspagvccfV+PoWisIDi7aCpWlXwno21PivmCzEinPHdY3bRshvjcGxTF5cMIDOf2MwkjL03fc+zsoBoV8XHRBuOhIzCDa4txICKtZ2BTwEHMrwNBqJZ.QiMvQYI16l0kju2Vy2Df2uH.sx2lMH168x7Re5Y4gvqhVY7+ZUFtuP7KXjPXUiaGiO4VvHwq79.iapm9oLUz0gp3c.7oLhW99o3Yzq+YgW+GyHSRZETLJ3x+0AqYu.LGxVEZAcoFuz2QuM+86auMN26da5phIW+lxad6cvxvoHERHuWThC7HUugy5S8lQoWxlTF41156esHQIuUYjoESBBK3mRxYh2KL3f6pGqTOvdrd5i6dr9vsM+tqOksM+FoYk8.RIeWWZtP3Le3dAFe+q2rEw2pdcT5srscBaZQKJY5oOhvprCb+MdaWwA2OWws7jfpVhHSXfducAgapNR5qNHs7S9mwYxjOImkRtlmUJ0ZNk0BbWl35NCKMp43xb4gZmywon0imS55NUzaUE.gFbMkVdID.qYNZ1RwL54m1ImR2qyKWnY6NWBJw228ZQQvv1xH2pRbYJwIvO+htXYU0SmMxWB3wetlcydoyyIA4O0utlLZ0jZ0Pp1mal1z1yvSPLumeZorm1FVqA2UyGJsn.euL1FhijVzn.O4RPSaHfGVRuPV+TybxMQp03YimMAsp2.AqD886wOsNXYFioiaU8hNoZUYd4NkDtPdZOS85RIaKNXhmctQiFH1qh9LfyxEs83ZDbkSFIVVpWa9g863NDbpyZ9dKFTgWeRxN34XGA27bFtR8TlU2VSSt0jQmOY05LNsLpKQN0gUUwbV4zxmbwf5U5snckjJsHWY07KGTujYl7iPmkeXtA1Uj5dUVioH2SQ45CQiFHLVnSmbthNqZ16hI8ubr50WAbrqWMshPmBq7GZrZxUkGcpW8jWx2SmaTmYfRmVSqMeudB9Kx.z45l37D0uZdo7yxH2RiGJpb4UKq3zzpW0UkktX5YCU3hQiDBGv5DlWRRx358RUCWDs+RCCRqjubSk3WVgSpNemtro4lRK4FeuFSI0l2zQ6t.X1hcHc8YQysti3mWrLz51HSebHS6cMZxnvWL68nPARZGXGg+xOGpZuWtlOKDieHCesxx82TsN32IS9LGZRZIJ0dXqssEwWXagTiZZ5CwtnwigtQQ7spF7XLI6BIoz78pxTFpBV8NTCYNZgqPJsfDnEkwZjD96VWuXvwcCg+12TT1mLJRzhnC+19PSHvauxhUTsoSU8.M62cZu3L2yPiOkITIYCJZ+3qatmsEegdgGe.7SXBb+OVseeFylfwGsFvmwr4swiUS3cNPwA+xdfhvO5w31.RFWx.lLjJcxj93Ugzuh.YrS5.zweBsW7v0IoqCaj2RKXw+h7ylMSQWGeylo1tYTU7q1NzBc9jcCs7UAq0scmtalkT+jNyRpnm7asW58K0f8stg8h+i0+9uMjzVt9tdeyuqHU8DIpWji8itgX5nDIC6mJZcEx5zQG7uMJx2A36dcXO2xPh1n00Sknr627AoEbeSO3EzuPPpnBtib5njqAb0neNv2+iM8A+BXroT+BerouiL1T1raFaRrA+ZWxXS8WmPozHdatDUOOQhtoSjHwXfe6IpNSEA5UNO0hyW1BzoL55gfkxyEmYNIegxUWL9r4WptJktX09BxWpLaP1RsJw4yI0hqUVTxKlKlznpdNTxl8lsXxnAn5jN7qzQ1ePg5MljLakB9UWl4rZ5omYzLqUOAtqxeU9Q407qaYgLcW1UXpSgFETDbUG3kgupokvnYivq7crkEKgyleHmB4bZunwjoqal2Ky554rm0IQcmJxUR1zuTYWO8ryZonmwZshmesgMFnk0pOVNcCnTa0k8ac0zgcDyONiRMHWUwVBIVZ3uPpSJEjR990355LYUCukUEJMp8PM0BJR9BIl4IgsDWUtOPu85A8pYX0ZT1V9oZd4hKFVCJmGstoqncqRNi0O2YHu4x9URcYKBVK6jkS2ownIF75kypwYzebkQ7NMFpLiysqRy50pH2cMZbYyTsMM34xWPne4SKOrv.qyDvp0Z6f6mYYeazrBfg8ztFm9x94jT55rVvvztURmniH8h6dDo1UZ0s7v++7Q+GkT4vsXTFM0wDtcln.L9qH8YpC7MwuOmTZGkur36LwxerXKjED399ank32S+0uM5PKr+78qQev+y70nu6WejlVdb6E+MLjlmRyF3JY+owW9iQm3+XbGSApt1esZ3ejN5i9OJfBQusBpybHSa5Z1TwB9C2QjiIIWxXjBKnuVUkFu9mH8Kd6xj9AHSlGfLm9.jI6CPlbO.Yx+.j4r6TFZ2e79X6ogw7DBRUB5+Kd7a5MM9Aw92.g9nlB

Frankbeat

Great in every aspect, man!

hisefilo

@Christoph-Hart wrapping it into a midichain fixed the oversampling issue here. This is awesome man. Can stop playing with it!

d.healey

@Christoph-Hart Love it

ulrik

@Christoph-Hart no bugs what I can see

sletz

Actually I was working on something like this too - it's a bridge between HISE and ChatGPT that allows you to define parameters and it will build the instrument for you. ==> can Faust native support help here ?

Lindon

just loving this thread....

ustk

@Christoph-Hart I particularly love the degree of humanisation in that system... Technology at its best! :thumbs_up:

sletz

FaustGPT coming : https://gitlab.com/dhuck/synthesis-synthesis ?

Adam_G

absolutely brilliant

sletz

I asked ChatGPT to write a presentation of FaustGPT , here is the answer:

FaustGPT is a DSP program generation model for audio built using the Faust language. Faust is a programming language dedicated to creating digital audio processes, such as guitar effects, synthesizers, or real-time audio processing tools. FaustGPT uses machine learning to learn how to generate DSP programs from input-output examples, allowing users to quickly create custom audio effects without having to write the code themselves.

FaustGPT uses a GPT (Generative Pre-trained Transformer) type neural network architecture, which is pre-trained on a large amount of audio data to enable faster and more accurate generation of DSP programs. Users can provide input-output examples for specific audio effects, such as reverb or distortion, and the model will automatically generate the corresponding DSP code.

FaustGPT allows musicians and sound engineers to create custom audio effects without having to learn the Faust programming language or spend time writing DSP code. This makes the creation of new effects more accessible and faster, allowing users to focus on creating unique music and sound experiences.

sletz

Some progress: http://www.vaporwav.in

sletz

FAUSTGPT: https://chat.openai.com/g/g-uTlRVzd8P-faustgpt

d.healey

@sletz Aha that's clever

Forget sampling!

19

1.7k

11.8k

102.6k