He is plenty of other things besides a wife-beater, but he certainly is that. Moreover, I think it's very clear that that is indeed one of Pym's defining traits as a character, and that that was one of his defining incidents. Generally speaking, though, five separate incidents is sufficient to establish a pattern, especially in the continued absence of any contrary evidence.