The general consensus during my own time as an inmate was that the wardens were indeed the enemy. Can they be liked from a distance or respected but disliked? Absolutely. Is the general populace capable of this? I've never seen evidence of it.

Interestingly, disliking from a distance often leads to attempted murder here.