And it's impossible for me to be accepting of the fact that they worked with HYDRA, apparently willingly, regardless of who they were fighting against and for what reason. It was bad enough already that they messed with Steve's mind without his consent. That's the point I'm making.
Other than the fact that he attempted to destroy the planet publicly, I can't comment regarding Ultron. But as someone who's had more experience than HYDRA then almost anybody else, I can comment regarding them.