In my universe, the Gallifreyans were the oldest, most powerful race, the first master Time Travel, and for the longest while, the only ones. We have a connection with time, and are able, among other things, to feel its passage. The Time Lords established themselves as keepers of time, making sure that no other races would mess with it, usually observing, not making changes in the course of Time. I'm the exception.