I have a similar goal. The plan is to start off building a really nice lower that I will swap between different uppers (cannot afford to give each upper a dedicated lower). Then I'll buy a complete upper and tweak a few parts.
Honestly, you could buy a complete upper the way you want it then...