The oldest structure in South Florida has been attacked by Seminoles, undergone restorations, and still sits at the tip of Key Biscayne.