If you don't intend to reload your own cartridges tuned for your rifle, I wouldn't spend too much. You could spend, as you say $4-$5k, but without ammo worked up specifically for your chamber/barrel you'd be wasting a lot of accuracy.
At 800+ consistency of powder burn, quantity, neck tension...