That's been the way all through history, no truly bad evil monster has ever been able to get their terror done without a whole bunch of "The King's Men" doing the whole "Just following orders" business.
Too many people let the "Just Following Orders" types get away with it later on, the history of this country is packed with examples.
You start holding the "Just following orders" types personally responsible for both their individual actions as well as group actions they were a part of, then things start looking different once people realize that's the new normal.
But unfortunately it won't happen because every government including the ones that come up after the overthrow of the last tyrant all find that they must excuse those "just following orders" from responsibility otherwise their minions might have qualms about the whole "just following orders" business and the government couldn't exercise their absolute power.