Every time we've woken up in our bodies we've had them. They only ever get cleared when someone is lost in the dimensional stabilizer and for all we know that could be a different version of the person entirely. Maybe no one's memory ever gets wiped. Besides, when we get out of this, I don't think it's going to be with their permission so hopefully they won't have any say over it.