It is understandable to try to do something just a little bit different, but the rifle you describe sounds pretty damn good to me. Just get a hundred pieces of Lapua brass, load it to 260 Rem pressures, and that brass should last you a very long time. Or load it to almost 6.5x284 speeds and the brass should help you burn that barrel out, then the sky is the limit about what you can change it to.
The Swede did not last as long as it has for nothing. Accuracy just happens to be a large part of it. There are a few nominal differences with case head sizes, but correct me if I'm wrong, Remington used the standard 30-06 diameter when they made the Swede. I don't know about the Winchester/FN. You probably already knew this though.