Passing Large Data Objects into ScriptProcessors

[Lindon]

@aaronventure said in Passing Large Data Objects into ScriptProcessors:

@Lindon you mentioned you can't figure out how to pass an array to a panel.

Your array should be stored in a variable on its own, and then you should pass that variable to the panel via setValue(variable).

no thats not quite what I said.. I said I cant pass an array to a panel in a ScriptProcessor - check out either of the snippets I posted.

[aaronventure]

@Lindon

Weird, can't get setAttribute to work here either.

Globals work fine.

HiseSnippet 1241.3oc6XEnaaaCDkxNpHVqqXEae.2DFvrQBbry55FZPwbiSRgwZRMlyBFPQWAsDsEWjHEnnRlWP.1m79C1NJIGK63zEXjLrMTAACSd7t6w63cOZ2WI8XIIREwp1wShYDqGZOXhPGzMfxEjd6Qrdj8gzDMSA4Ss6jXZRBymXYU8klIrpsFI64O9tcogTgGa1TDxIRtG6U7Htd1r86787vvCn9ri4QkV8S5zySJ5JCkoHdpZ2hDS8NkNlcD0rrJ1DqGruOWKUCzTMKgXs1tR+ICBjmKxW+I7D9vPlYPax.zP4SefLz2fXyrjtA7P+9S22IDhkc+YQgp4QgOy9PtO+p4mEM9jLAvLMJGOrpLO7pNG7ZWFdsJAuk.IqRPZsbH8X6AdJdrdlDCd9H6dBL4Lhhg8xPIesjJaT0tqDWgP2LhdJ6.EN3JMp+zVs1DvOZriiCF5SzvYTErfeZCOGxNSzbLSOWXota9RmENZ6ZLkihMF7zJTwV3PtHjKXvnTgmlKEfTrapVKEsMHSICq6IihkBDiah9OLk0v4BmZ7QP8OGMRCXqsfXE6LTN3QCQaMFMAvEbMLj4QSSXfNfAwTAKDPLljIiSC4+FyG7wvelbOSRzoFZ5ZF7ESmDJo9HFuv8EtOycW2K2AEgun+RXZswOZIPgwgxgzPPwFwTL77MvS.FMYxlvDYJ7KoIFbI9RM5J.wzhXC+Z.MwHeHiI.OECOc3CSXZzW8MftcSzemX140KPUicfbrj8doC9AhpTQHFky7Zj7r7ccA3nCMSHUFDGfvbSfJ7MKP.I7n3vIkguNOnLjEJOuI5nBaLdogD70Y5QHL31cZtptaQVzsgA9E4xtXBZHV0Vewjb1QLsZiM1oz4fijZ1qE0yx2NW5.KJZznkJqvjgL0REa5pndeJVWjFMjoJeZyrPrTa95W6at9sb6Eu7nSoEJE8vS.uNlItolNjhPpoVu.U3R0YU5OpnROO.R3XAcM6hnIICxka5R9wd6Q0zoFBsI5mXlRyMaAq8XmgcfyagTydOVxoZYb1ZKxi3t9V31e8JW14sclb0feeXGx0aUgMIk9ogT87cNMzEEBvzwbsqLsjDIb8jx6r6r1o2VH9X69bsWvxwXkkfQLneefwBRnO1d+QiXd5Y.bM6C9o6GFmxte8a3l.OLiJAGwTsuKtGP7s9d.VUuO38W6+v79ep80ndWJ++fJ1NEs2yoZvl6KuadtXC+8raBjM21ueU1Nmxuv7M8wdQMoGGXXOeN7Fr0J3.0boXrQocgmAtz71ttNvkucGGT5Jb+.3Bzn4teF243qHOQg3KpdhLj0LVwMn8kYgAD.vFfVYt9SAjGO0.MZjo5B58JIdqisLSpulxaunxHaIb2vVBefm7eA7jUKwS9.cQa4hBRyAfLuttc9IoRrj3yb7Dmy80AylnWm.FebftbSOxJSIS94RTxjuXYV5FA81F6XaU.37u7AJ8+WPo+CxTyOh4PpVwMI4iRiFfTpdLz6BL0apbspXpwxG2ZZ9e.S3mM3OwmBgsMisJD1dpv+Q7QD0SIemWd0ugkb8rYv8sH6OFnl8glwv0J5IjHjz9cddyapqo31qphe0pp3SVUE+5UUwmtpJ9Mqphe6euhl6T8hTsLJuzjPNr+9YMosr1WPwS4YUDj+BL5aEgJ

[d.healey]

@aaronventure said in Passing Large Data Objects into ScriptProcessors:

How are they worse than latching onto a referenced parameter via setAttribute?

With Global both scripts must be aware of the global variables. Using set attribute is no different than interacting with any other HISE module. The module doesn't need to be aware of the place (or places) it is being controlled from. It is self contained and can operate independently of the UI script.

[d.healey]

@Lindon said in Passing Large Data Objects into ScriptProcessors:

I think this just doesnt scale....it will be nearly unmanageable

Given Christoph's lack of responsiveness lately I suspect he is busy with some project and you may have a wait for your feature request.

I would flip around the way you are doing things. Currently you have a GUI that you want to pass to a processing script. Instead I would build a standalone arp script and then figure out how to build a GUI that can communicate with it.

I don't know the details of what you are doing but the simplest solution to me seems like a few sliderpacks.

You say there would be 20 sets of controls, and I assume the scale issue would arise if you wanted to add more sets in the future. You obviously don't want to end up with 1000s of sliderpacks. So we need to find a solution to this.

I don't know what your 20 controls are, but assuming each can be represented with a single slider pack, we add 2 slider packs to our arp script. 1 is a visible sliderpack that we interact with and has 20 sliders, the other is hidden, and is used for data storage and can have as many sliders as necessary to store all the data we need, giving us unlimited "virtual" sets.

Then we have a knob to switch between our virtual sets. Pulling values from the big slider pack and displaying them on our smaller slider pack. I can write this for you if you like, it won't take very long at all.

Now on your main UI script you need to add a hidden 20 slider sliderpack, and a knob. You connect these up via processor/parameter ID to the ones in the arp script. You can continue to use your data blob as you currently do in the UI script, and forward that data to the arp script which will do the work. The arp script can also be used independently of the UI script, making it suitable for other projects with different requirements.

Edit: I just saw you said "128 steps, each step has around 20 attributes". So that definitely is more complex... maybe this is a time to use the global object and then take a shower.

[Christoph Hart]

Given Christoph's lack of responsiveness lately I suspect he is busy with some project and you may have a wait for your feature request.

Lol I haven't looked at the forum for 4 hours...

Without understanding exactly what you're trying to do, I would recommend using one of those:

https://docs.hise.audio/scripting/scripting-api/fixobjectarray/index.html

as a global variable in the Interface onInit array, then create a fixed size array of 128 elements with whatever data structure you need for your arp.

[d.healey]

@Christoph-Hart said in Passing Large Data Objects into ScriptProcessors:

Lol I haven't looked at the forum for 4 hours...

Lol I meant that we hadn't had an update in a week! That's practically glacial for HISE, also you're usually busy with theatre work around this time, no?

[Christoph Hart]

@d-healey ah yeah, no theatre this year, but I have been working on a new feature (a multipage dialog system that will be used inside HISE as well as a floating tile on compiled plugins).

[d.healey]

@Christoph-Hart said in Passing Large Data Objects into ScriptProcessors:

(a multipage dialog system that will be used inside HISE as well as a floating tile on compiled plugins).

Oh yes I saw the commits for the broadcaster wizard. Looks like it will be very helpful.

[Lindon]

@d-healey said in Passing Large Data Objects into ScriptProcessors:

Edit: I just saw you said "128 steps, each step has around 20 attributes". So that definitely is more complex... maybe this is a time to use the global object and then take a shower.

That seems to be the plan.....just using Christophs suggestion for fixedobject array.

[Lindon]

@Lindon said in Passing Large Data Objects into ScriptProcessors:

@d-healey said in Passing Large Data Objects into ScriptProcessors:

Edit: I just saw you said "128 steps, each step has around 20 attributes". So that definitely is more complex... maybe this is a time to use the global object and then take a shower.

That seems to be the plan.....just using Christophs suggestion for fixedobject array.

I predict that at some point in the future someone is going to ask for a way to pass a large data blob into a ScriptProcessor..... :-)

[Christoph Hart]

@Lindon said in Passing Large Data Objects into ScriptProcessors:

I predict that at some point in the future someone is going to ask for a way to pass a large data blob into a ScriptProcessor..... :-)

And I predict that I will respond to it in the same way. Some things can be changed, but this is not the case here, the API needs to be as fast as possible so I can't switch it to a var value.

[Lindon]

@Christoph-Hart said in Passing Large Data Objects into ScriptProcessors:

@Lindon said in Passing Large Data Objects into ScriptProcessors:

I predict that at some point in the future someone is going to ask for a way to pass a large data blob into a ScriptProcessor..... :-)

And I predict that I will respond to it in the same way. Some things can be changed, but this is not the case here, the API needs to be as fast as possible so I can't switch it to a var value.

So maybe an alternative, not using scriptProcessor.setAttribute but say scriptProcessor.setPanelData(PanelId, DataBlob)