It's pretty new, relatively. It's 2012 there, only seven years ago. The city itself has been around since the 1600's, officially.
The name is more complicated. It technically wasn't named after a place. The city used to be called New Amsterdam, after a city in Europe, but when the English took it over, they renamed it after the Duke of York and Albany, brother to their king.