A bigger objective may have some better light gathering properties. So if you don't plan on any dusk/dawn shooting/hunting you may as well go with the smaller objective.
It will save a little weight and you may be able to achieve lower scope over bore height with lower (lighter) rings.