As the distance increases, effects of mirage, wind, muzzle velocity variances, spin drift, gyroscopic effects, all become amplified. It's really as simple as that.
Even assuming it's a cloudy day and no wind whatsoever, a simple muzzle velocity inconsistency of, say, a 30fps spread would open...