HISE Transformation to the new age

[dannytaurus]

@David-Healey said in HISE Transformation to the new age:

I mean users who don't understand the code they are "writing" because the inner workings are being hidden from them.

Yes, but it's all just abstractions all the way down to the metal. JUCE is an abstraction of pure C++ APIs. HISE is an abstraction of JUCE. And AI agents coding will be an abstraction of HISE.

One could argue that HISE scripters are ignorant of the inner C++ workings of the plugin they're building.

I see a lot more threads popping up asking me to fix AI slop

This is very much the start. Give it time.

[David Healey]

@dannytaurus said in HISE Transformation to the new age:

This is very much the start. Give it time.

This is what people have been telling me for years :)

[dannytaurus]

@David-Healey said in HISE Transformation to the new age:

This is what people have been telling me for years :)

Nah, this is the start. The last few years were just getting LLM to get the language working.

[David Healey]

@dannytaurus said in HISE Transformation to the new age:

Nah, this is the start.

Tell me that again in 5 years

I'm not quite as cynical as I seem, I use AI all the time, I'm just cautious.

I also am concerned about AI inbreeding which is a real problem with limited solutions at the moment.

[dannytaurus]

@David-Healey said in HISE Transformation to the new age:

Tell me that again in 5 years

I'm marking my calendar

[Christoph Hart]

@David-Healey I don't want to be condescending, but have you tried using an AI agent with the latest models? Not like the local LLMs that you can run on your GPU and not one-shotting generic prompts into a ChatGPT window? You literally sound like me 2 weeks ago and I would have agreed 100% with you then and 0% with you now :)

I see a lot more threads popping up asking me to fix AI slop

Look it at this way: you're just one part of a very slow and ineffective Ralph loop.

[David Healey]

@Christoph-Hart said in HISE Transformation to the new age:

but have you tried using an AI agent with the latest models?

Na I played around with OpenCode and Big Pickle and got bored waiting for it to fail, so then I went back to work :)

I'm waiting for someone to show me something impressive enough to get me interested in it to the point where I'll put some money down.

[Christoph Hart]

@David-Healey Yes I also tried Big Pickle, it has nothing to do with what Opus 4.5 / 4.6 can crank out. I'll try to remember a few of the things that stood out to me in my progress of last week.

• oneshotting a HTTP RestServer for HISE that accepts HTTP requests with a correct threading model.
• finding a bug in a compiled network code that caused a voice to not be killed. It explored it's way through the DLL boundary to the internal class that handles modulation chains and found the one bool flag that I forgot to set
• iteratively increasing the robustness and approximation to what looks like flawless HiseScript code by feeding the conversation history back to itself and just tell it to "learn from your mistakes"
• don't get me started on web dev, it's game over there.
• let it crawl through the HISE source code, extract every single LAF method I define in the ScriptLAF class, analyse the function body, connect it to the correct hise component class (eg. "drawAhdsrGraph" will most likely affect a hise::AhdsrGraph) and write a one-liner description to every obj property that matches exactly what it does, then create a JSON object that I can use for the MCP server. Then let it write a guideline.md file that instructs it to repeat that process whenever I need. Bash script on steroids.
• paste in long weird template compiler errors and get a 5 word sentence back what the problem is and how to solve it. It also wrote this beauty of a C++ template code that a human will never understand, but it works perfectly:

struct VoiceSetter : container::Helpers::sub_tuple<renderer<Oscillators, NumOutputs>...>
	{
		using GainModVS = typename core::extra_mod<NumVoices>::VoiceSetter;
		using GateVS = typename envelope::extra_mod_gate<NumVoices>::VoiceSetter;
		// Use empty tuple when addModToOutputs() is false, otherwise tuple of NumOutputs VoiceSetters
		using GainModTuple = std::conditional_t<addModToOutputs(),
			template_helpers::repeat_tuple_t<GainModVS, NumOutputs>,
			std::tuple<>>;
		using GateTuple = std::conditional_t<addModToOutputs(),
			template_helpers::repeat_tuple_t<GateVS, NumOutputs>,
			std::tuple<>>;
		// Delegating constructor for when we have outputs to manage
		template <size_t... Is>
		VoiceSetter(render_group& t, bool forceAll, std::index_sequence<Is...>) :
			container::Helpers::sub_tuple<renderer<Oscillators, NumOutputs>...>(t.oscillators, forceAll),
			gainModSetters{ GainModVS(t.outputGainMods[Is], forceAll)... },
			gateSetters{ GateVS(t.outputGates[Is], forceAll)... }
		{}
		// Delegating constructor for when we have no outputs to manage
		VoiceSetter(render_group& t, bool forceAll, std::index_sequence<>) :
			container::Helpers::sub_tuple<renderer<Oscillators, NumOutputs>...>(t.oscillators, forceAll),
			gainModSetters{},
			gateSetters{}
		{}
		// Public constructor - dispatches to appropriate delegating constructor
		VoiceSetter(render_group& t, bool forceAll) :
			VoiceSetter(t, forceAll,
				std::conditional_t<addModToOutputs(),
				std::make_index_sequence<NumOutputs>,
				std::index_sequence<>>{})
		{
		}

		GainModTuple gainModSetters;
		GateTuple gateSetters;
	};

compared to the complexity of these tasks, even a mid-tier HISE project should be trivial to implement as soon as the knowledge gap between C++ and HiseScript is solved (and that's my task now).

[David Healey]

@Christoph-Hart said in HISE Transformation to the new age:

template code that a human will never understand

Is there a version that a human would be able to understand or is this the sort of thing that even if a human wrote it would still be gibberish?

How is it for adding features or fixing bugs in the HISE codebase? This is where I would be most interested.

[dannytaurus]

@Christoph-Hart said in HISE Transformation to the new age:

Ralph loop.

Are you doing this with a single AI model? I recently read a workflow for Rails that used different AI models/platforms to provide code review of the first model's work.

Seems like this would help to prevent infinite loops, which were a huge problem with earlier models.

[dannytaurus]

@David-Healey said in HISE Transformation to the new age:

Na I played around with OpenCode and Big Pickle and got bored waiting for it to fail, so then I went back to work :)

I had no idea you hadn't already tried this out properly.

Do a $20/mo plan somewhere, for one month, and I think you might be converted.

Heck, you don't even need to pay - most of them have a free plan that resets token limits every day, or few hours.

[dannytaurus]

@David-Healey said in HISE Transformation to the new age:

How is it for adding features or fixing bugs in the HISE codebase?

https://github.com/christophhart/HISE/pulls?page=1&q=+is%3Apr+author%3Aweavermedia

All my PRs, except the oldest two, were made in Cursor with Claude.

[David Healey]

@dannytaurus I'll take a look at it this evening