There are potentially several reasons to explain the inconsistent group sizes when changing hi/lo magnification at 100 yd, as has been mentioned in the replies above. One point that needs clarification, however, is with regard to parallax. Parallax error increases with magnification as was stated, but it actually increases as distance decreases. The closer your target, the more critical it is to make sure your parallax is correctly adjusted. At 100 yd, parallax error can be pretty dramatic and will only be further amplified with higher magnification.
If the error is due to a tendency to follow the previous shot hole with the crosshair, one trick to get away from that is to purposely set your elevation half to one MOA high/low. That way, you're not aiming directly at your POI or shooting out your aiming point. It's much easier to hold steady and pay attention to what your crosshair is doing as you shoot when your POA isn't shot up or surrounded by a bunch of holes in the target.