"There are the ones under Arkham...the tunnels and caves are there according to Jonathan, but he doesn't venture down there."
It was probably because he nearly died in them too many times. After about the fifth time, avoiding was usually ones best choice when they didn't want to watch their life bleed away again.