Actually, I believe that makes you a better survivalist. You already know hardship and are already very self-aware of how your body works against the world around you. Your mind would take a shorter period of time to figure out an obstacle than those who never had issues in the modern world.