Agentic coding workflows

[Bart]

@HISEnberg said in Agentic coding workflows:

@Bart I haven't tried it but looks like that may be in the works: https://github.com/christoph-hart/hise_cpp_raw_template/blob/main/AGENTS.md

Thanks HISEnberg.

It does appear like its on the menu

Testing last week I found it can add Hise modules within one of the projects files, but couldn't directly add the modules to the current Hise project it's interacting with.

Also found it gets in to a loop of shutting down and re-opening Hise when the AI needs to create a new project. It seems not able to create new Hise projects, nor load xml's yet.

These few limitations almost make it useable for me atm, but will test again soon

[Christoph Hart]

@Bart FYI I'm working on a TUI app at the moment that allows you to remote control HISE and perform all kinds of actions - the same command set is also exposed as an CLI interface for the LLM to use (and you can use the TUI app as a "log viewer" to trace back what the LLM did).

This will include a feature complete builder mode with full undo support where you can add / remove modules and change parameters from the command line:

https://github.com/christoph-hart/hise-cli/issues/5

[HISEnberg]

@Christoph-Hart excited to see what is in the works here!

[Christoph Hart]

@HISEnberg haha yes that is some funky stuff, my favorite part is how I replicated the module tree in ASCII art:

I've also pulled in the entire setup.hise.dev stuff into this app - this bypasses some of the quirks of the website approach - now people just have to download this self-contained binary TUI app and type in /setup and it will perform all the steps from the setup workflow.

It also acts as logger for monitoring what the LLM does - if you have the TUI open and the LLM calls

hise-cli -builder add Sampler

then this shows up in the chat history with an "LLM" tag.

I'm probably moving all the runtime functionality out of the MCP server as soon as the hise_cli is ready so the MCP becomes a read-only documentation / explorer tool that sits on the HISE doc server - currently it needs to be run locally so it can connect to the HISE Rest server, but since the Hise-cli is doing the same thing too it's easier to separate these tasks.

The MCP server also integrates with the new doc website and uses a small embedding model and a vector database for looking up docs & code examples - I evaluated different approaches, but that gives me the advantage of checking the quality of the MCP search.

[Bart]

Are these Hise settings working?

Recompile On File Change
Auto Start Rest Server

Not working here with Windows, on a month old develop build.

[ustk]

@Bart Recompile On File Change does work here on mac, the other things I don’t know…

[Christoph Hart]

on a month old develop build.

A month old develop build is ancient material when you want to work with the AI tooling.

Recompile On File Change is disabled if the rest server is running - the rationale is that the LLM will make multiple edits and then send a recompile message when it's done - a recompilation after every filesave might interfere with this.

[ustk]

@Christoph-Hart clever move…

[Bart]

@Christoph-Hart said in Agentic coding workflows:

Recompile On File Change is disabled if the rest server is running

That makes perfect sense!

Sort of assumed most of the agentic workflow updates might be automatically accessible via the MCP server.

Updated Hise today, but the Auto Start Rest Server is still not working.

Enabling the Toggle Rest API Server option in the tools menu wouldnt be so bad * but random Hise crashes and the agent randomly closing Hise makes it annoying, then forgetting to toggle the rest server makes the agent opens a new Hise instance - uggh

If the agent launches Hise itself - I can see it ping the console with incoming requests, so the REST server seems to be connected in that circumstance, but then the agent isn't able to do anything, it gets stuck at the Hise welcome screen.

Relatively confident (not really) I've got CLI / REST / MCP / LSP working to some degree.
Made the agent modify the module tree - eeeeeeekkk AMAZING!

Is there a shortlist of what agentic workflows can do so far..

[Christoph Hart]

@Bart explore the hise-cli tool, that's where the bulk of my current time is being spend on. The goal is to enable automation of every UI interaction that an agent might perform:

• load / switch projects
• set project settings / preprocessors
• compile DLL / networks
• start / quit HISE
• compile scripts
• modify the module tree
• modify the UI tree
• edit script callbacks
• edit DSP networks.

hise-cli --help

gives you and your robot the entry point. for a context based help, use

hise-cli -builder --help

gives you all commands for the builder mode.

it gets stuck at the Hise welcome screen.

Yeah you might want to deactivate that one (it's a setting that you can toggle off).

[Bart]

@Christoph-Hart So practically everything

Wow it's really nice.. Being able to modify the module tree and the interface components without scripting them, marvelous.. Enough to get me started - keep at it!

[David Healey]

@Christoph-Hart Is it possible to tell the AI not to do some of those tasks? I'm thinking tokens are expensive and I don't want to waste them on starting and quitting HISE :p