What are you using to set your firing position? This sounds to me like you are basing it on the cheek weld to get a good look down the scope. You may need to adjust length of pull, scope position and cheek piece position.
I would assume a good prone position, without the rifle and then have someone hand you the rifle with your eyes closed. Settle into the rifle so that everything feels good with the shoulder and cheek against the stock. Now open your eyes. If you are not looking at a full scope picture and a natural aim towards the target, the gun does not fit you and you need to adjust.