Your muzzle velocity will NOT change significantly with temperature. Varget is very temperature stable. Might be a 10 fps difference in that range of temps. It is all about air density. Colder air is more dense and will decelerate the bullet more. Running your scenario in my ballistic calculator with the temp shift and a 10 fps reduction at 30 deg F: POI shift is 0.04" at 100 yards, 0.90" at 300 yards, 5.60" at 500 yards.
So, it is negligible at 100 yards but becomes much more significant with distance. BTW, that is really slow for a 55 grain bullet. I run just over 3000 fps with a 75 grain bullet in my .223.