You can't talk about Oak Island without talking about the people who lived there