If a manager ever did that to me there would be a problem.I would take it as a act of aggression and defend myself with physical force. No manager in the world can cuss at you or get violent in any way.
While yes a workplace can make any rule they want they have to prove it first so don't let him see you do it.