It's just that everyone remembers the bad ones. Little games like Soldier throwing himself a birthday party or Gambler giving memories to the team that picks the highest card from a deck...they don't leave much of an impression. The others are more...memorable.