That's fine. For example, Eliot can get an episode from any point in the show, more likely than not, Julia will be in that episode. But I can't use Eliot's canon point as an excuse to bring in any episode for Julia I want. I can only choose from the first two seasons for Julia.
So Sam is still limited to whatever his canon point is. If someone else brings in an episode from a future canon point that Sam is in and you okay it, then you're fine.