@Bobinmi
I have two XYLO chassis and now 5 different barreled actions (with their own scopes) that I swap between them. Honestly, whatever is my primary gun that season, I set it up and leave it - for convenience and speed. However, I have never had an issue with the barreled actions holding/repeating zero. I use a fix-it stick to torque my action screws and I follow the same procedure every time I install a barreled action. This has yielded good results for me.
One of the barreled actions is a Vudoo 22 that I have used for a trainer rifle, but it spends most of it's time in a McMillan fiberglass stock when I carry it squirrel hunting. No issues going from one stock/chassis to the other, the barreled actions maintain zero.
I did the switch barrel thing for a while, and it was cost effective, but I always ended up with the wrong barrel on the action the night before the match and no way to confirm zero. Swapping barreled actions I wouldn't be afraid to shoot without confirming zero - after having done it more than a few times. Also, if you find you don't like swapping them out...save up an buy another one. Starting with only one chassis/stock won't hold you back too long and you'll find out if it works for you or not. Do whatever you can to get as many rounds down range as possible, especially in competition - then you'll know what you want and need.
Someone posted a pic of you up on the roof defending the garden:
Bonus points if you know the cult 80's movie!
Good Luck,
R