Same here. Long sessions (300+ cases) make me use gloves, but if it needs more than that, something else needs fixed.
If you do want to use a case holder, K&M has another one that holds the case by the body taper, rather than the rim. I'd look at that one instead. But as @padom said, try it...