I suspect "parallax"...i.e. you are not looking through the scope consistently each time. Changing cheek pressure, stock weld, etc will result in shifting groups. You can test this by purposely looking through the scope using different cheek pressure, head position, etc. This results in multiple groups depending upon the angle the eye is at as it looks through the scope/sight.
definition: the effect whereby the position or direction of an object appears to differ when viewed from different positions, e.g. through the viewfinder and the lens of a camera.
A simple everyday example of parallax can be seen in the dashboard of motor vehicles that use a needle-style speedometer gauge. When viewed from directly in front, the speed may show exactly 60; but when viewed from the passenger seat the needle may appear to show a slightly different speed, due to the angle of viewing.
The further the distance, the easier it is to observe this effect.
Target shooters have used small apertures on their scopes to reduce parallax error. Here is a home made one.
Congratulations, you have just made your scope virtually parallax free. If your head is in the wrong position you won’t be able to see anything through your scope. Now move your head around until an image appears. This is your perfect head position.
White Oak Lens Reducer
Our unique “ghost ring” design is a lens with a chamfer around the center hole. It ships with two lenses, a clear and a smoke tinted. Both are transparent which allows you a full field of view so you can still see surrounding targets and target numbers but acts as a ghost ring centering your eye in the 3/64 diameter hole.
There are obvious disadvantages to this fix , even for target shooting, but it does demonstrate that this is a common problem and that the fix is consistency in looking through the scope with the same head position every time.