My copy of Castle came with a foreword I read after finishing the novel, and it definitely sounds like Jackson's own experiences with these places and the people who lived there are hugely informative in her books.

Hill House is the other one I have bookmarked for sure!