Surely you were not instrumental to neither his nor your own coming here?
[It's silly to blame oneself for things one is not responsible for. Sure, Sebastian blames his own and the young master's presence here on his own weakness, but Sebastian isn't, well, a Muggle.]