You can access the first castle again pretty much as soon as you can sail.
it's weird camelotcrusade if you speak to Kitano he gives this story about how you can't buy a boat and have to see the master of the guards first but I just clicked on the boat next to him and sailed away - I jacked his boat
and he didn't mind
