So don't lose another friend. If he doesn't want to talk about it, don't push it. Tell him you want to be friends. Make sure that's clear. Ask him if he can handle that. If he can, you guys should be fine. I mean, I've worked with plenty of women who harbored secret, dark fantasies about me. You learn to get used to it.
You shouldn't take a lightsaber to anyone for the sake of my honor.