So don't tell them but at least talk to them even if it's just about the weather.
Professor Egg is quite the fascinating man. He taught Muggle Studies at Hogwarts actually. His book caused quite a lot of controversy and I think still does so many years later.