You don't have to say that. Just say it's a coincidence. Or that you get that all the time and you don't see the resemblance.
I guess it's not that weird, anyway. There was time.. back in my world or whatever.. where they got me confused with this princess of this European country. I don't really get why she didn't have an accent, but.. Well. Lookalikes. It happens, right?