On my second playthrough I went in there before getting the heart out of curiosity. Which kinda sucked because that way I got a quest that would fail if I gave the heart to Guilford right away... not that said quest offered any reward. Nor did the one about escaping the place.
Denying the ghost also fails the quest.
So what's the problem? Why do you not just complete the ghost's quest?