It's impossible to get everything just right. And of course every little noise wakes you up. I had to catch myself and be like - oh, wait, he's just awake he doesn't need me sometimes.
The bottle gets easier, and they do get used to going longer between feedings. By the end of the first year it can be much better. At least Harry was.