Or, you know, call. [Or better yet, don't leave at all.] Leaving without a word and with no one knowing where you've gone... of course people would worry.
[No need to admit how worried she'd been at the time. Clearly you'll never know because it's not like your brother was creepily watching over her or anything.]