It's normal for the SD to increase with colder temperatures. I have shot 22LR in temperatures down to -30 degrees Celsius. Some ammo is far more sensitive than others. SKLRM is one of the worst in cold temperatures. SD's could go to 30+ in colder temperatures.
You can mitigate this somewhat by using biathlon ammo like SK Biathlon or ELEY Match Biathlon, depending on the temperature.
Eley ammo seems far less temperature sensitive that some Lapua or SK products.