Oh come on! Now, I'm really curious! You can't say something like that to me only to not tell me, it's not allowed.
Then I'll definitely make sure to say something because birthdays are fun and you shouldn't forget your own birthday. Unless you're old and trying to forget your age, then I can understand.