It's not ridiculous. Hmm... I'm not sure how I would handle it, especially if he's kind of persistent about you joining them. I guess I'd just voice my concerns about traveling when so many other people will be. Maybe offer to visit another time? A time when his wife is conveniently not present, if that ever happens?