A small angle at the barrel nut can move it enough out at the gas block journal.
You can lap or otherwise true your upper received to make sure the barrel seat is square to the receiver bore.
The human eye is pretty good at spotting angles so if you take the handguard off and just look at the barrel, you'll probably see any problem. You could also put a straight edge on the flat top and measure down to the barrel close to the barrel nut and out at the gas block journal. Add half the diameter of the barrel where you measure and that will tell you if there is any slope.
The act of taking it apart and carefully inspecting everything is the first thing to do. Then put it back together paying attention to anything that might not line up properly. Repeat until you have either identified or resolved the problem.