It was caused by having different sample rates in 2 different samplers. I had to convert all to 41.1khz which is what I started my project at.