When you pull the trigger and the bullet starts to move, the rifle starts to move as well. In that fraction of a second the rifle will interact with your body, or a bag, or whatever it’s in contact with. If the rifle does not interact with something consistently, you’ll get a POI shift bc the barrel moves differently each time before the bullet exits.
A lot of guys like to pin the stock into the rear bag in prone, and then they’ll lean into the rifle on a barricade. These are very different pressures on the rifle so you’ll get a POI shift between the two positions.
The answer? What a lot of people do is basically free recoil everything- Set the rifle on the bipod and the bag and pull the trigger without disturbing it; balance the rifle on the barricade and pull the trigger without disturbing it, etc…. That works well for some people because of small calibers and brakes but if you get any amount of actual recoil, you’ll run into problems.
My solution is to always anchor the rifle into my shoulder and let the rifle interact with my body weight. So don’t pin the stock into the rear bag, pull the stock into your shoulder and use the bag to steady it. Don’t lean into the rifle on the barricade, pressure down on the barricade and pull the rifle into your shoulder. You want to do this with a relaxed shoulder so the rifle doesn’t just bounce off as that will give you a lot of poi shift. The advantage to doing it this way as you can control any amount of recoil pretty easily once you learn how to do it. People will say it doesn’t matter because brakes can eliminate recoil. But the skills that allow you to manage recoil are the exact same skills that give you the ability to shoot well with any rifle, from any surface, on any day. Learning recoil management is what makes you a better shooter. A lot of people can shoot small groups with bad fundamentals. You’ll never see anyone manage significant recoil with bad fundamentals.