While traveling and cartographing each area a little by little, I noticed there seemed to be some inhabitants in the castle. They seemed to be armed. And armored, heavily.
I know little in the way of fighting. But when it wants to work, my hat can be used as a portal to help aid transport, if unreliable in this realm. I'm also mapping out the region, area by area. Could take some time.