Oh god, no. I wouldn't let that happen, either. But growling is just his way of saying "back off".
Although since he does let them put him in doll clothes, I think it might take quite a lot before he'd ever become that irritated with them.
[Amycus]
Whatever you think would be best for the girls. How fast do they usually fall asleep into story time? I think I'm going to go ahead and mark ahead how far I think we can get in a night.