Well the flip side is when you need the gun and seconds count, you can't fire it beacuse its on safe, you don't have a round chambered, or you cannot deactive the saftey.
If you want a VERY good reason why grip safteys and the other silly lawyer made shit are bad ideas, read this AAR : My CCW...