I know what you mean, I know a couple of professors who came to their subject that way. Mine was mostly driven by my childhood love of space and that I had a really good grasp of numbers. Plus the fact that my dad worked for NASA, guess I had the genetic disposition for astrophysics!