Mystery solved. I had a default preset set in project preferences. This completely breaks the save in DAW behaviour. Removing the default preset solves the issue.

It would be nice to have both though. On first load we get the default preset, then after that it reverts to the regular behaviour.