6" is definitely more than we see in virtually high quality bolt guns that do not have some other problem. The most likely cause is barrel threads / shoulder that are not perfectly straight and square to the bore. This can easily cause enough runout on the suppressor that the bullet doesn't quite kiss the endcap, but gets close enough to be "blown off course" and this often screws up accuracy some too.
Next would be harmonics / bedding, or other rifle-system issue, that is exacerbated by the suppressor. Typically we see this in bolt guns where a lot more is happening dynamically during firing, but we also see it sometimes due to an incorrect bedding job or something causing a weird barrel harmonic. This can often but not always be debugged by replacing the suppressor with a rigidly mounted weight of the same mass to see if it's replicable without the suppressor on.
We'd be happy to examine any or all of your system. We accuracy-proof-test suppressors all the time and it basically always comes down to the mount (in our case the CB or BA brake) being on the barrel somehow wrong.
Give me a call tomorrow and we can figure out what to look at next