Ah now I understand. You can use a constant pitch modulator, however it will play the original note and pitch it to the desired frequency which might sound bad.
If you're rolling with one SynthGroup, there is no way to make this work otherwise because the messages are passed to both samplers without modification.
As long as you don't apply FM from the one to the other, there's no need putting them into one SynthGroup.