No, it does not quite work that way. For example, I have been in the apartment that belongs to a man named Peter Kelly - whose counterpart is Johnathan Harker - numerous times, yet Dracula could not enter it during the full moon. He needs to be invited in, not me.
Of course, I would understand if you still avoided letting me into your apartment.