It's bad correlation to refer annealing to increasing accuracy. Is more of allowing better consistent case to case which leads to accuracy.
You anneal so you reverse the effects of work hardening the case. By doing that it becomes softer, more malleable and after sizing, less springback...