In line with what a sibling comment says, it stops being about the person themselves, and what their actual performance is, but about adherence to arbitrary rules. The computer says you took X number of unauthorized breaks this past year, so no raise/promotion for you. Employee has still been getting their assigned job done, and has been doing it perfectly well, and has stellar feedback from customers? So what! It's the rules that matter more.

Often a manager will not have any say over these things. "The metrics speak for themselves!"

Regardless, I don't think we should design systems with the assumption that the people in charge of them will be compassionate and reasonable. There are a lot of petty, corrupt (in the moral sense, not financial) people out there in positions of power over others.